Jul 20 09:36:54.600891 ip-10-0-142-133 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 20 09:36:54.600903 ip-10-0-142-133 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 20 09:36:54.600913 ip-10-0-142-133 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 20 09:36:54.601224 ip-10-0-142-133 systemd[1]: Failed to start Kubernetes Kubelet. Jul 20 09:37:04.843975 ip-10-0-142-133 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 20 09:37:04.843988 ip-10-0-142-133 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4b298b4a35e64394a45ffaed5b59c36c -- Jul 20 09:38:40.412186 ip-10-0-142-133 systemd[1]: Starting Kubernetes Kubelet... Jul 20 09:38:40.852632 ip-10-0-142-133 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 09:38:40.852632 ip-10-0-142-133 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 09:38:40.852632 ip-10-0-142-133 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 09:38:40.852632 ip-10-0-142-133 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 09:38:40.852632 ip-10-0-142-133 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 09:38:40.852632 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.807982 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 09:38:40.852632 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811901 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:38:40.852632 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811912 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:38:40.852632 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811917 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:38:40.852632 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811920 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:38:40.852632 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811923 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:38:40.852632 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811927 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:38:40.852632 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811930 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:38:40.852632 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811934 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811937 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811940 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811943 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811947 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811950 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811953 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811962 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811966 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811968 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811971 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811976 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811980 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811984 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811987 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811991 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811994 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811997 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.811999 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812002 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:38:40.854813 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812006 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812010 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812014 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812017 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812021 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812024 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812027 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812029 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812032 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812034 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812037 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812039 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812041 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812044 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812047 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812049 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812054 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812057 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812060 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:38:40.888495 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812063 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:38:40.872883 ip-10-0-142-133 systemd[1]: Started Kubernetes Kubelet. Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812066 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812069 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812072 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812074 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812078 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812081 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812083 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812086 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812089 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812091 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812094 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812096 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812099 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812102 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812104 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812107 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812110 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812113 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812116 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:38:40.906934 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812119 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812121 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812127 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812129 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812132 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812135 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812137 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812140 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812142 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812145 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812147 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812150 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812153 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812155 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812158 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812160 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812163 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812167 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812170 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812172 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:38:40.936375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812175 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812178 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812181 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812183 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812185 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812188 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812190 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812193 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812195 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812197 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812200 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812203 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812207 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812938 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812947 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812952 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812956 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812959 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812962 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:38:40.952375 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812965 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812967 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812970 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812973 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812976 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812978 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812981 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812983 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812986 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812989 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812992 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812994 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812997 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.812999 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813002 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813004 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813006 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813009 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813013 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:38:41.102727 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813016 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813019 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813022 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813025 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813028 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813031 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813035 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813037 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813041 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813044 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813046 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813049 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813052 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813054 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813057 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813060 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813062 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813065 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813067 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813070 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:38:41.104451 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813072 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813075 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813077 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813080 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813082 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813085 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813087 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813090 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813092 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813095 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813097 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813099 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813102 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813104 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813107 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813110 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813112 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813114 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813117 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813120 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:38:41.105496 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813125 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813128 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813130 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813133 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813135 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813138 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813141 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813143 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813145 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813150 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813153 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813155 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813158 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813160 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813163 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813165 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813167 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813170 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813173 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813175 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:38:41.106538 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813178 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813180 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813182 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813185 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813187 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813190 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813192 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813195 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813198 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813200 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813203 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813205 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813215 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813218 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813590 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813595 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813598 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813601 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813605 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:38:41.110177 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813608 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813612 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813615 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813618 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813621 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813623 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813625 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813628 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813630 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813633 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813635 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813640 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813642 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813644 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813647 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813649 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813652 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813654 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813657 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:38:41.110764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813659 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813661 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813664 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813666 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813669 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813671 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813675 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813678 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813680 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813683 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813685 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813688 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813690 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813693 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813695 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813697 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813700 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813702 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813705 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813707 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:38:41.255627 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813710 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813712 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813715 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813717 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813722 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813725 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813727 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813730 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813732 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813735 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813737 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813740 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813742 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813745 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813747 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813751 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813755 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813758 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813761 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:38:41.256400 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813764 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813767 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813769 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813772 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813774 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813777 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813779 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813781 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813784 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813786 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813789 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813791 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813794 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813796 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813799 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813802 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813804 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813807 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813810 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813813 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:38:41.257023 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813815 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813817 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813820 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813822 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813826 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813828 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813831 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813833 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813836 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813838 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813859 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813863 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813868 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813872 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813875 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.813878 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813941 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813948 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813955 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813959 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813963 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 09:38:41.257621 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813967 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813970 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813974 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813977 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813980 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813983 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813986 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813989 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813994 2577 flags.go:64] FLAG: --cgroup-root="" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813997 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.813999 2577 flags.go:64] FLAG: --client-ca-file="" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814002 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814005 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814009 2577 flags.go:64] FLAG: --cluster-domain="" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814011 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814014 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814017 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814021 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814024 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814027 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814031 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814034 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814038 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814041 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 09:38:41.258230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814044 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814047 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814051 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814055 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814058 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814060 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814063 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814066 2577 flags.go:64] FLAG: --enable-server="true" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814069 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814073 2577 flags.go:64] FLAG: --event-burst="100" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814076 2577 flags.go:64] FLAG: --event-qps="50" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814079 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814082 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814085 2577 flags.go:64] FLAG: --eviction-hard="" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814093 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814096 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814100 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814103 2577 flags.go:64] FLAG: --eviction-soft="" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814106 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814109 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814112 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814115 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814118 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814120 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814123 2577 flags.go:64] FLAG: --feature-gates="" Jul 20 09:38:41.258904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814127 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814129 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814132 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814135 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814138 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814142 2577 flags.go:64] FLAG: --help="false" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814145 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814148 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814151 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814154 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814158 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814161 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814164 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814166 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814169 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814172 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814175 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814178 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814180 2577 flags.go:64] FLAG: --kube-reserved="" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814184 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814186 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814189 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814192 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814196 2577 flags.go:64] FLAG: --lock-file="" Jul 20 09:38:41.259575 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814199 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814202 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814205 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814210 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814212 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814215 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814218 2577 flags.go:64] FLAG: --logging-format="text" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814221 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814224 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814226 2577 flags.go:64] FLAG: --manifest-url="" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814229 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814233 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814236 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814241 2577 flags.go:64] FLAG: --max-pods="110" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814244 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814247 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814250 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814253 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814257 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814260 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814263 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814270 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814273 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814276 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 09:38:41.260254 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814279 2577 flags.go:64] FLAG: --pod-cidr="" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814281 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814286 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814289 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814292 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814295 2577 flags.go:64] FLAG: --port="10250" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814298 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814302 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01753f99dc649be9c" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814305 2577 flags.go:64] FLAG: --qos-reserved="" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814308 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814310 2577 flags.go:64] FLAG: --register-node="true" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814313 2577 flags.go:64] FLAG: --register-with-taints="" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814317 2577 flags.go:64] FLAG: --registry-burst="10" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814320 2577 flags.go:64] FLAG: --registry-qps="5" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814322 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814325 2577 flags.go:64] FLAG: --reserved-memory="" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814329 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814332 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814335 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814338 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814341 2577 flags.go:64] FLAG: --runonce="false" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814343 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814347 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814350 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814353 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 09:38:41.260937 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814356 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814359 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814362 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814365 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814368 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814371 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814373 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814376 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814379 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814382 2577 flags.go:64] FLAG: --system-cgroups="" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814384 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814390 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814392 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814395 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814400 2577 flags.go:64] FLAG: --tls-min-version="" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814402 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814405 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814407 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814410 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814413 2577 flags.go:64] FLAG: --v="2" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814416 2577 flags.go:64] FLAG: --version="false" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814420 2577 flags.go:64] FLAG: --vmodule="" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814424 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.814427 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814537 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:38:41.261587 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814540 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814543 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814546 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814549 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814553 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814556 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814559 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814561 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814564 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814566 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814571 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814574 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814578 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814580 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814583 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814585 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814588 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814590 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814593 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:38:41.262233 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814595 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814598 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814601 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814604 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814606 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814609 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814612 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814614 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814617 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814620 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814622 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814625 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814627 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814630 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814632 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814635 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814637 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814641 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814643 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814646 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:38:41.262750 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814649 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814651 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814654 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814656 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814659 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814662 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814664 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814667 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814669 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814671 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814674 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814676 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814679 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814682 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814686 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814690 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814692 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814695 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814697 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:38:41.263263 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814700 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814702 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814705 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814707 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814710 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814712 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814715 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814718 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814720 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814722 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814726 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814729 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814731 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814734 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814738 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814741 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814744 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814747 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814750 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:38:41.263822 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814753 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814755 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814758 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814760 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814763 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814766 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814768 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814770 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814774 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814776 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814779 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814781 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814784 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814787 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814789 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814792 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814794 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814797 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814799 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814802 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:38:41.264377 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.814804 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:38:41.264993 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.815363 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 09:38:41.264993 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.822493 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 09:38:41.264993 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.822509 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 09:38:41.264993 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.822528 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 09:38:41.264993 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.822537 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 09:38:41.264993 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822591 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:38:41.264993 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822596 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:38:41.264993 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822599 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:38:41.264993 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822602 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:38:41.264993 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822605 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:38:41.264993 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822607 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:38:41.264993 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822610 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:38:41.264993 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822613 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:38:41.264993 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822616 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:38:41.264993 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822618 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822621 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822623 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822626 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822628 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822631 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822634 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822636 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822639 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822641 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822644 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822646 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822649 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822651 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822655 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822658 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822662 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822666 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822668 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822671 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:38:41.265385 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822674 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822677 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822680 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822682 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822685 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822687 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822690 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822693 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822695 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822699 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822702 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822705 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822708 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822711 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822713 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822716 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822719 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822723 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822726 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:38:41.265939 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822729 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822731 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822734 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822736 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822739 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822742 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822744 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822747 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822749 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822752 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822755 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822757 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822760 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822762 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822765 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822769 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822773 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822775 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822778 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822781 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:38:41.266422 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822783 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822786 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822790 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822793 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822796 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822799 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822801 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822804 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822807 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822809 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822811 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822814 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822816 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822818 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822821 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822823 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822826 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822828 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822831 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822833 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:38:41.266976 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822835 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:38:41.269611 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822838 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:38:41.269611 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822840 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:38:41.269611 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822857 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:38:41.269611 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822861 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:38:41.269611 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822863 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:38:41.269611 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822866 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:38:41.269611 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822869 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:38:41.269611 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822872 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:38:41.269611 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822874 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:38:41.269611 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.822877 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:38:41.269611 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.822882 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 09:38:41.269611 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824309 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:38:41.269611 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824322 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:38:41.269611 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824329 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:38:41.269611 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824332 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824335 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824338 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824341 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824344 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824347 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824350 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824353 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824357 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824361 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824364 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824368 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824371 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824374 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824377 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824381 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824384 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824387 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824390 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824393 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:38:41.270217 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824396 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824398 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824401 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824404 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824407 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824409 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824412 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824415 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824417 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824420 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824422 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824426 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824429 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824432 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824434 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824437 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824439 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824442 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824444 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824447 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:38:41.432438 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824449 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824452 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824454 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824457 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824459 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824462 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824464 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824469 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824473 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824476 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824479 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824482 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824484 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824487 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824489 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824493 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824497 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824500 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824503 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:38:41.433056 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824505 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824508 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824510 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824513 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824517 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824519 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824522 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824524 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824527 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824530 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824532 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824535 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824537 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824540 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824543 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824545 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824548 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824550 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824553 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:38:41.433579 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824555 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824559 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824562 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824565 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824567 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824569 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824572 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824574 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824577 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824580 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824582 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824585 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824587 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824589 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824592 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824594 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824597 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:38:41.434115 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:40.824601 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:38:41.434549 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.824606 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 09:38:41.434549 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.824726 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 09:38:41.434549 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.826614 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 09:38:41.434549 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.827790 2577 server.go:1019] "Starting client certificate rotation" Jul 20 09:38:41.434549 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.827889 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 09:38:41.434549 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.827928 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 09:38:41.434549 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.830074 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 09:38:41.434549 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.831182 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 09:38:41.434549 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.841068 2577 log.go:25] "Validated CRI v1 runtime API" Jul 20 09:38:41.434549 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.842888 2577 log.go:25] "Validated CRI v1 image API" Jul 20 09:38:41.434549 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.843625 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 09:38:41.434549 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.847049 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a64392c1-3999-4982-8049-aecf25c465c2:/dev/nvme0n1p4 ed7241d9-45b2-4978-b2c9-dcc735aa5b5f:/dev/nvme0n1p3] Jul 20 09:38:41.434994 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.847063 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 09:38:41.435061 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.852998 2577 manager.go:216] Machine: {Timestamp:2026-07-20 09:38:40.851742575 +0000 UTC m=+0.325843598 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199040 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28c2ff2eec48c2aee8b935cdf4c074 SystemUUID:ec28c2ff-2eec-48c2-aee8-b935cdf4c074 BootID:4b298b4a-35e6-4394-a45f-faed5b59c36c Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:09:4e:fd:cb:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:09:4e:fd:cb:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:81:e8:d4:35:e9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 09:38:41.435061 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.853143 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 09:38:41.435061 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.853243 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 09:38:41.435061 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.856086 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 09:38:41.435061 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.856118 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 09:38:41.435061 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.856866 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 09:38:41.435061 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.856880 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 09:38:41.435061 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.856888 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.856904 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.858115 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.860750 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.860891 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.860918 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.860929 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.860940 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.860949 2577 kubelet.go:398] "Adding apiserver pod source" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.860958 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.861377 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.861396 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.863713 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.865143 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.867098 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.867124 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.868127 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.868140 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.868147 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.868152 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.868160 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.868165 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.868173 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.868178 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.868185 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.868190 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.868198 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.868203 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.868949 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.868961 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.872030 2577 server.go:1268] "Started kubelet" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.872464 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.872507 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.872546 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.873950 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:40.874221 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:40.874271 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.874327 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.875084 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 20 09:38:41.435360 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:40.877409 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.881450 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.882001 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:40.882153 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-133.ec2.internal\" not found" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.882662 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.882659 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.882681 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.882839 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.882875 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.883049 2577 factory.go:153] Registering CRI-O factory Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.883062 2577 factory.go:223] Registration of the crio container factory successfully Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.883113 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.883193 2577 factory.go:55] Registering systemd factory Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.883205 2577 factory.go:223] Registration of the systemd container factory successfully Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.883226 2577 factory.go:103] Registering Raw factory Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.883240 2577 manager.go:1196] Started watching for new ooms in manager Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.883973 2577 manager.go:349] Starting recovery of all containers Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:40.883166 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-133.ec2.internal.18c3f5f788efc9c7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-133.ec2.internal,UID:ip-10-0-142-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-133.ec2.internal,},FirstTimestamp:2026-07-20 09:38:40.871991751 +0000 UTC m=+0.346099318,LastTimestamp:2026-07-20 09:38:40.871991751 +0000 UTC m=+0.346099318,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-133.ec2.internal,}" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:40.892457 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:40.892585 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.897612 2577 manager.go:354] Recovery completed Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.901660 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.903308 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.903328 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.903337 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.904492 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.904505 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.904521 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.904534 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.905337 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.905358 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:38:41.436386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.905370 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:38:41.437278 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:40.905911 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-133.ec2.internal.18c3f5f78acdd379 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-133.ec2.internal,UID:ip-10-0-142-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-133.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-133.ec2.internal,},FirstTimestamp:2026-07-20 09:38:40.903320441 +0000 UTC m=+0.377421461,LastTimestamp:2026-07-20 09:38:40.903320441 +0000 UTC m=+0.377421461,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-133.ec2.internal,}" Jul 20 09:38:41.437278 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.906020 2577 policy_none.go:49] "None policy: Start" Jul 20 09:38:41.437278 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.906036 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 09:38:41.437278 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.906047 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 09:38:41.437278 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.907072 2577 policy_none.go:47] "Start" Jul 20 09:38:41.437278 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:40.913835 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-133.ec2.internal.18c3f5f78ace01c9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-133.ec2.internal,UID:ip-10-0-142-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-133.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-133.ec2.internal,},FirstTimestamp:2026-07-20 09:38:40.903332297 +0000 UTC m=+0.377433318,LastTimestamp:2026-07-20 09:38:40.903332297 +0000 UTC m=+0.377433318,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-133.ec2.internal,}" Jul 20 09:38:41.437278 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:40.917143 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-133.ec2.internal.18c3f5f78ace2518 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-133.ec2.internal,UID:ip-10-0-142-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-133.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-133.ec2.internal,},FirstTimestamp:2026-07-20 09:38:40.903341336 +0000 UTC m=+0.377442357,LastTimestamp:2026-07-20 09:38:40.903341336 +0000 UTC m=+0.377442357,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-133.ec2.internal,}" Jul 20 09:38:41.437278 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:40.926137 2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-133.ec2.internal.18c3f5f78acdd379\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-133.ec2.internal.18c3f5f78acdd379 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-133.ec2.internal,UID:ip-10-0-142-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-133.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-133.ec2.internal,},FirstTimestamp:2026-07-20 09:38:40.903320441 +0000 UTC m=+0.377421461,LastTimestamp:2026-07-20 09:38:40.905347693 +0000 UTC m=+0.379448714,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-133.ec2.internal,}" Jul 20 09:38:41.437278 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.935308 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fssts" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:40.937758 2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-133.ec2.internal.18c3f5f78ace01c9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-133.ec2.internal.18c3f5f78ace01c9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-133.ec2.internal,UID:ip-10-0-142-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-133.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-133.ec2.internal,},FirstTimestamp:2026-07-20 09:38:40.903332297 +0000 UTC m=+0.377433318,LastTimestamp:2026-07-20 09:38:40.905364689 +0000 UTC m=+0.379465710,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-133.ec2.internal,}" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.940803 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fssts" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.974382 2577 manager.go:337] "Starting Device Plugin manager" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:40.974447 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.974461 2577 server.go:87] "Starting device plugin registration server" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.974704 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.974715 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.974841 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.974934 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:40.974944 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:40.975893 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:40.975943 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-133.ec2.internal\" not found" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.016488 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.017677 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.017736 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.017768 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:41.017819 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.020282 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.075366 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.076332 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.076363 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.076377 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.076403 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.083392 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:41.083410 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-133.ec2.internal\": node \"ip-10-0-142-133.ec2.internal\" not found" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:41.114358 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-133.ec2.internal\" not found" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.118423 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-133.ec2.internal"] Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.118483 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.119513 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:38:41.437564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.119538 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.119547 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.121077 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.121220 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.121243 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.145644 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.145799 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.145808 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.145649 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.145876 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.145886 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.147076 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.147096 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.148614 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.148636 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.148659 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:41.167345 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-133.ec2.internal\" not found" node="ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:41.170765 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-133.ec2.internal\" not found" node="ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.185072 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64613b0dcac4a25dbe698c524fa81100-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal\" (UID: \"64613b0dcac4a25dbe698c524fa81100\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.185097 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/537e8aec3c3624c3b67c0e0e826a6719-config\") pod \"kube-apiserver-proxy-ip-10-0-142-133.ec2.internal\" (UID: \"537e8aec3c3624c3b67c0e0e826a6719\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.185116 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/64613b0dcac4a25dbe698c524fa81100-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal\" (UID: \"64613b0dcac4a25dbe698c524fa81100\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:41.214560 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-133.ec2.internal\" not found" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.285232 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64613b0dcac4a25dbe698c524fa81100-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal\" (UID: \"64613b0dcac4a25dbe698c524fa81100\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.438366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.285261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/537e8aec3c3624c3b67c0e0e826a6719-config\") pod \"kube-apiserver-proxy-ip-10-0-142-133.ec2.internal\" (UID: \"537e8aec3c3624c3b67c0e0e826a6719\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.438966 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.285278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/64613b0dcac4a25dbe698c524fa81100-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal\" (UID: \"64613b0dcac4a25dbe698c524fa81100\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.438966 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.285305 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/64613b0dcac4a25dbe698c524fa81100-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal\" (UID: \"64613b0dcac4a25dbe698c524fa81100\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.438966 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.285344 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/537e8aec3c3624c3b67c0e0e826a6719-config\") pod \"kube-apiserver-proxy-ip-10-0-142-133.ec2.internal\" (UID: \"537e8aec3c3624c3b67c0e0e826a6719\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.438966 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.285353 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64613b0dcac4a25dbe698c524fa81100-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal\" (UID: \"64613b0dcac4a25dbe698c524fa81100\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.438966 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:41.315329 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-133.ec2.internal\" not found" Jul 20 09:38:41.438966 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:41.416031 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-133.ec2.internal\" not found" Jul 20 09:38:41.558510 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.470196 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.558510 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.474050 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-133.ec2.internal" Jul 20 09:38:41.558510 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:41.516840 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-133.ec2.internal\" not found" Jul 20 09:38:41.701416 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:41.617262 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-133.ec2.internal\" not found" Jul 20 09:38:41.887544 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:41.717789 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-133.ec2.internal\" not found" Jul 20 09:38:41.887544 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:41.818336 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-133.ec2.internal\" not found" Jul 20 09:38:41.887544 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.827490 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 09:38:41.887544 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.827632 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 09:38:42.048810 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.900111 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:38:42.048810 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:41.918960 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-133.ec2.internal\" not found" Jul 20 09:38:42.048810 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.932046 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:38:42.048810 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.933055 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:38:42.048810 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.933083 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:38:42.048810 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.933094 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:38:42.048810 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.948175 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 09:33:41 +0000 UTC" deadline="2027-12-20 06:54:10.785040363 +0000 UTC" Jul 20 09:38:42.048810 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.948210 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12429h15m28.836833426s" Jul 20 09:38:42.048810 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.948910 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:38:42.048810 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.983195 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-133.ec2.internal" Jul 20 09:38:42.048810 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.991936 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 09:38:42.048810 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:41.992993 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal" Jul 20 09:38:42.048810 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.007259 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 09:38:42.048810 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.016504 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:38:42.329068 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:42.168044 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64613b0dcac4a25dbe698c524fa81100.slice/crio-cb433438eed8445deaff4a7c64811d13797c87cb1f3a15ff176a4e7582e38bd9 WatchSource:0}: Error finding container cb433438eed8445deaff4a7c64811d13797c87cb1f3a15ff176a4e7582e38bd9: Status 404 returned error can't find the container with id cb433438eed8445deaff4a7c64811d13797c87cb1f3a15ff176a4e7582e38bd9 Jul 20 09:38:42.329068 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:42.168916 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537e8aec3c3624c3b67c0e0e826a6719.slice/crio-2013a0c3a17d3e75b34492f77110ebb68aa4f0b90f70ccf9bf7d813e5dd627b8 WatchSource:0}: Error finding container 2013a0c3a17d3e75b34492f77110ebb68aa4f0b90f70ccf9bf7d813e5dd627b8: Status 404 returned error can't find the container with id 2013a0c3a17d3e75b34492f77110ebb68aa4f0b90f70ccf9bf7d813e5dd627b8 Jul 20 09:38:42.329068 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.182764 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.862429 2577 apiserver.go:52] "Watching apiserver" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.872314 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.873479 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-nsxxs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal","openshift-multus/multus-additional-cni-plugins-qvlqv","openshift-multus/multus-v6qzc","kube-system/konnectivity-agent-b7qq8","openshift-cluster-node-tuning-operator/tuned-ghcmk","openshift-multus/network-metrics-daemon-4fbtw","openshift-network-diagnostics/network-check-target-84zkv","openshift-network-operator/iptables-alerter-6skng","openshift-ovn-kubernetes/ovnkube-node-2bvnv","kube-system/global-pull-secret-syncer-jqgr4","kube-system/kube-apiserver-proxy-ip-10-0-142-133.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k","openshift-dns/node-resolver-ctds5"] Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.875116 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:42.875201 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.877214 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.878887 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.880620 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.881283 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.881282 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ttkbh\"" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.881287 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.881564 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.881776 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.881974 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.882023 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.882076 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.882675 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.882688 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.882688 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xm7ld\"" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.883277 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b7qq8" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.884097 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.884430 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8tnzg\"" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.884748 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.885899 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fwpzl\"" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.886004 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.886040 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 09:38:42.908725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.886309 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6skng" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.886932 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.887462 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jz444\"" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.887697 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.887801 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nsxxs" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.888879 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.890295 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.889111 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.892252 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.892417 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.892463 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.892734 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ctds5" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.892759 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x2ghp\"" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.892905 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kbvld\"" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.893594 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.895511 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-79h7l\"" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.895647 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.895652 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.895815 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.897186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:42.897248 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.897669 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-run-multus-certs\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.897702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-device-dir\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.897729 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/285cd32a-2da4-4818-9d9b-5e1bf8152dba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:42.910827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.897756 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-multus-cni-dir\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.911975 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.897780 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-cnibin\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.911975 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.897806 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-etc-kubernetes\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.911975 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.897860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bb703a13-b2ef-43d5-9cb8-219136053fd0-cni-binary-copy\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.911975 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.897961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-var-lib-cni-bin\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.911975 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.897992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsm4v\" (UniqueName: \"kubernetes.io/projected/bb703a13-b2ef-43d5-9cb8-219136053fd0-kube-api-access-lsm4v\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.911975 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898020 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:42.911975 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898047 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/285cd32a-2da4-4818-9d9b-5e1bf8152dba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:42.911975 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898081 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs\") pod \"network-metrics-daemon-4fbtw\" (UID: \"2068181e-6e30-401a-89fc-af0528dc5aea\") " pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:42.911975 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:42.911975 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898153 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-socket-dir\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:42.911975 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898184 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-registration-dir\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:42.911975 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898209 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-multus-socket-dir-parent\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.911975 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898234 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-sys-fs\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:42.912789 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285cd32a-2da4-4818-9d9b-5e1bf8152dba-system-cni-dir\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:42.912789 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/285cd32a-2da4-4818-9d9b-5e1bf8152dba-cnibin\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:42.912789 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/285cd32a-2da4-4818-9d9b-5e1bf8152dba-cni-binary-copy\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:42.912789 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898386 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-run-k8s-cni-cncf-io\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.912789 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-multus-conf-dir\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.912789 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898465 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60837e18-5538-4452-b5f1-bf6167fd7fb3-agent-certs\") pod \"konnectivity-agent-b7qq8\" (UID: \"60837e18-5538-4452-b5f1-bf6167fd7fb3\") " pod="kube-system/konnectivity-agent-b7qq8" Jul 20 09:38:42.912789 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60837e18-5538-4452-b5f1-bf6167fd7fb3-konnectivity-ca\") pod \"konnectivity-agent-b7qq8\" (UID: \"60837e18-5538-4452-b5f1-bf6167fd7fb3\") " pod="kube-system/konnectivity-agent-b7qq8" Jul 20 09:38:42.912789 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/285cd32a-2da4-4818-9d9b-5e1bf8152dba-os-release\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:42.912789 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwq2q\" (UniqueName: \"kubernetes.io/projected/285cd32a-2da4-4818-9d9b-5e1bf8152dba-kube-api-access-lwq2q\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:42.912789 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898568 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:42.912789 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-hostroot\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.912789 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898590 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 09:38:42.912789 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bb703a13-b2ef-43d5-9cb8-219136053fd0-multus-daemon-config\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.912789 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:42.898629 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:38:42.913793 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p726n\" (UniqueName: \"kubernetes.io/projected/2068181e-6e30-401a-89fc-af0528dc5aea-kube-api-access-p726n\") pod \"network-metrics-daemon-4fbtw\" (UID: \"2068181e-6e30-401a-89fc-af0528dc5aea\") " pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:42.913793 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/285cd32a-2da4-4818-9d9b-5e1bf8152dba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:42.913793 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898749 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-system-cni-dir\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.913793 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898774 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-os-release\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.913793 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898810 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-run-netns\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.913793 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-var-lib-cni-multus\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.913793 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898883 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-var-lib-kubelet\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:42.913793 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.898915 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkmmz\" (UniqueName: \"kubernetes.io/projected/0233a3ec-3051-479b-a07e-c348b1d845c8-kube-api-access-gkmmz\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:42.913793 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.899939 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 09:38:42.913793 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.899943 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xtf86\"" Jul 20 09:38:42.913793 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.900009 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 09:38:42.913793 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.900125 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 09:38:42.913793 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.900145 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 09:38:42.913793 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.900193 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 09:38:42.983808 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.937275 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cjpnw" Jul 20 09:38:42.983808 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.953197 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cjpnw" Jul 20 09:38:42.983808 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.963935 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:38:42.985003 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.984736 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 09:38:43.065948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:42.999983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/285cd32a-2da4-4818-9d9b-5e1bf8152dba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.065948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-var-lib-cni-multus\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.065948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000071 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-kubernetes\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.065948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000129 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-var-lib-cni-multus\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.065948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000178 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-tmp\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.065948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000223 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b88caf79-cea9-46b2-8e58-9789262ec4c3-host-slash\") pod \"iptables-alerter-6skng\" (UID: \"b88caf79-cea9-46b2-8e58-9789262ec4c3\") " pod="openshift-network-operator/iptables-alerter-6skng" Jul 20 09:38:43.065948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-node-log\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.065948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000269 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-cni-netd\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.065948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000300 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkmmz\" (UniqueName: \"kubernetes.io/projected/0233a3ec-3051-479b-a07e-c348b1d845c8-kube-api-access-gkmmz\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:43.065948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000327 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-run-multus-certs\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.065948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000360 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtnrw\" (UniqueName: \"kubernetes.io/projected/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-kube-api-access-qtnrw\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.065948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000386 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bgv9\" (UniqueName: \"kubernetes.io/projected/cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed-kube-api-access-4bgv9\") pod \"node-resolver-ctds5\" (UID: \"cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed\") " pod="openshift-dns/node-resolver-ctds5" Jul 20 09:38:43.065948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-run-netns\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.065948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-ovnkube-config\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.067314 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/285cd32a-2da4-4818-9d9b-5e1bf8152dba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.067314 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-multus-cni-dir\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.067314 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-run-ovn\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.067314 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b3179ca-a114-4b20-8411-0b3638da7500-kubelet-config\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:43.067314 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bb703a13-b2ef-43d5-9cb8-219136053fd0-cni-binary-copy\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.067314 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000629 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-systemd\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.067314 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-run\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.067314 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000670 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-host\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.067314 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-var-lib-openvswitch\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.067314 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000713 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-env-overrides\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.067314 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000737 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-ovn-node-metrics-cert\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.067314 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000757 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b3179ca-a114-4b20-8411-0b3638da7500-dbus\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:43.067314 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000764 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/285cd32a-2da4-4818-9d9b-5e1bf8152dba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.067314 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000782 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/285cd32a-2da4-4818-9d9b-5e1bf8152dba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.068221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000807 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed-hosts-file\") pod \"node-resolver-ctds5\" (UID: \"cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed\") " pod="openshift-dns/node-resolver-ctds5" Jul 20 09:38:43.068221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000833 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/285cd32a-2da4-4818-9d9b-5e1bf8152dba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.068221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000847 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-ovnkube-script-lib\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.068221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs\") pod \"network-metrics-daemon-4fbtw\" (UID: \"2068181e-6e30-401a-89fc-af0528dc5aea\") " pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:43.068221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000905 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.068221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000914 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-run-multus-certs\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.068221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000954 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:43.068221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.000979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-sys-fs\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:43.068221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001003 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285cd32a-2da4-4818-9d9b-5e1bf8152dba-system-cni-dir\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.068221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001010 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-multus-cni-dir\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.068221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001028 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/285cd32a-2da4-4818-9d9b-5e1bf8152dba-cnibin\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.068221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-run-k8s-cni-cncf-io\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.068221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-multus-conf-dir\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.068221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b88caf79-cea9-46b2-8e58-9789262ec4c3-iptables-alerter-script\") pod \"iptables-alerter-6skng\" (UID: \"b88caf79-cea9-46b2-8e58-9789262ec4c3\") " pod="openshift-network-operator/iptables-alerter-6skng" Jul 20 09:38:43.077360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001139 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/208beea5-1d93-485f-9171-6e37de3aa513-serviceca\") pod \"node-ca-nsxxs\" (UID: \"208beea5-1d93-485f-9171-6e37de3aa513\") " pod="openshift-image-registry/node-ca-nsxxs" Jul 20 09:38:43.077360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-kubelet\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.077360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001194 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/285cd32a-2da4-4818-9d9b-5e1bf8152dba-os-release\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.077360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001218 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwq2q\" (UniqueName: \"kubernetes.io/projected/285cd32a-2da4-4818-9d9b-5e1bf8152dba-kube-api-access-lwq2q\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.077360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-sysconfig\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.077360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p726n\" (UniqueName: \"kubernetes.io/projected/2068181e-6e30-401a-89fc-af0528dc5aea-kube-api-access-p726n\") pod \"network-metrics-daemon-4fbtw\" (UID: \"2068181e-6e30-401a-89fc-af0528dc5aea\") " pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:43.077360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-system-cni-dir\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.077360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-os-release\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.077360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-run-netns\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.077360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-var-lib-kubelet\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.077360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-modprobe-d\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.077360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001413 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-tuned\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.077360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001419 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bb703a13-b2ef-43d5-9cb8-219136053fd0-cni-binary-copy\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.077360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001438 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-run-systemd\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.078449 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001437 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/285cd32a-2da4-4818-9d9b-5e1bf8152dba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.078449 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001462 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-etc-openvswitch\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.078449 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-device-dir\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:43.078449 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001537 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-run-k8s-cni-cncf-io\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.078449 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001563 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-system-cni-dir\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.078449 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001568 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-multus-conf-dir\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.078449 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001607 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-run-netns\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.078449 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001624 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-os-release\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.078449 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001634 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-var-lib-kubelet\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.078449 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.001608 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:38:43.078449 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001667 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/285cd32a-2da4-4818-9d9b-5e1bf8152dba-os-release\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.078449 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.001711 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs podName:2068181e-6e30-401a-89fc-af0528dc5aea nodeName:}" failed. No retries permitted until 2026-07-20 09:38:43.501693055 +0000 UTC m=+2.975794066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs") pod "network-metrics-daemon-4fbtw" (UID: "2068181e-6e30-401a-89fc-af0528dc5aea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:38:43.078449 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001732 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285cd32a-2da4-4818-9d9b-5e1bf8152dba-system-cni-dir\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.078449 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-cnibin\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.080582 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001778 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-device-dir\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:43.080582 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001788 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-etc-kubernetes\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.080582 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/208beea5-1d93-485f-9171-6e37de3aa513-host\") pod \"node-ca-nsxxs\" (UID: \"208beea5-1d93-485f-9171-6e37de3aa513\") " pod="openshift-image-registry/node-ca-nsxxs" Jul 20 09:38:43.080582 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001819 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/285cd32a-2da4-4818-9d9b-5e1bf8152dba-cnibin\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.080582 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001882 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-run-openvswitch\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.080582 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001970 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-etc-kubernetes\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.080582 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.001967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-cni-bin\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.080582 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-var-lib-cni-bin\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.080582 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002045 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-cnibin\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.080582 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002054 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsm4v\" (UniqueName: \"kubernetes.io/projected/bb703a13-b2ef-43d5-9cb8-219136053fd0-kube-api-access-lsm4v\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.080582 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002078 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-host-var-lib-cni-bin\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.080582 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002095 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-sys-fs\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:43.080582 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002141 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed-tmp-dir\") pod \"node-resolver-ctds5\" (UID: \"cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed\") " pod="openshift-dns/node-resolver-ctds5" Jul 20 09:38:43.080582 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-systemd-units\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.080582 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:43.081480 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-sys\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.081480 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002360 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-log-socket\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.081480 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.081480 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lspll\" (UniqueName: \"kubernetes.io/projected/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-kube-api-access-lspll\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.081480 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002442 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:43.081480 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-socket-dir\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:43.081480 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002494 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-registration-dir\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:43.081480 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002561 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:43.081480 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-multus-socket-dir-parent\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.081480 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002604 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-sysctl-d\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.081480 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-var-lib-kubelet\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.081480 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002658 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-socket-dir\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:43.081480 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4x4k\" (UniqueName: \"kubernetes.io/projected/208beea5-1d93-485f-9171-6e37de3aa513-kube-api-access-t4x4k\") pod \"node-ca-nsxxs\" (UID: \"208beea5-1d93-485f-9171-6e37de3aa513\") " pod="openshift-image-registry/node-ca-nsxxs" Jul 20 09:38:43.081480 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002705 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-registration-dir\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:43.083355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29bls\" (UniqueName: \"kubernetes.io/projected/b88caf79-cea9-46b2-8e58-9789262ec4c3-kube-api-access-29bls\") pod \"iptables-alerter-6skng\" (UID: \"b88caf79-cea9-46b2-8e58-9789262ec4c3\") " pod="openshift-network-operator/iptables-alerter-6skng" Jul 20 09:38:43.083355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/285cd32a-2da4-4818-9d9b-5e1bf8152dba-cni-binary-copy\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.083355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002901 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0233a3ec-3051-479b-a07e-c348b1d845c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:43.083355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002912 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-multus-socket-dir-parent\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.083355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.002899 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60837e18-5538-4452-b5f1-bf6167fd7fb3-agent-certs\") pod \"konnectivity-agent-b7qq8\" (UID: \"60837e18-5538-4452-b5f1-bf6167fd7fb3\") " pod="kube-system/konnectivity-agent-b7qq8" Jul 20 09:38:43.083355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.003038 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60837e18-5538-4452-b5f1-bf6167fd7fb3-konnectivity-ca\") pod \"konnectivity-agent-b7qq8\" (UID: \"60837e18-5538-4452-b5f1-bf6167fd7fb3\") " pod="kube-system/konnectivity-agent-b7qq8" Jul 20 09:38:43.083355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.003128 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-sysctl-conf\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.083355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.003169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-lib-modules\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.083355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.003220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-slash\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.083355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.003260 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-hostroot\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.083355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.003270 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 09:38:43.083355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.003290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bb703a13-b2ef-43d5-9cb8-219136053fd0-multus-daemon-config\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.083355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.003316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5xbs\" (UniqueName: \"kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs\") pod \"network-check-target-84zkv\" (UID: \"206c83ae-f404-40f7-900f-ebd6f6d5e044\") " pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:43.083355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.003318 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/285cd32a-2da4-4818-9d9b-5e1bf8152dba-cni-binary-copy\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.084299 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.003332 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bb703a13-b2ef-43d5-9cb8-219136053fd0-hostroot\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.084299 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.003494 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60837e18-5538-4452-b5f1-bf6167fd7fb3-konnectivity-ca\") pod \"konnectivity-agent-b7qq8\" (UID: \"60837e18-5538-4452-b5f1-bf6167fd7fb3\") " pod="kube-system/konnectivity-agent-b7qq8" Jul 20 09:38:43.084299 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.004354 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bb703a13-b2ef-43d5-9cb8-219136053fd0-multus-daemon-config\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.084299 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.006821 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60837e18-5538-4452-b5f1-bf6167fd7fb3-agent-certs\") pod \"konnectivity-agent-b7qq8\" (UID: \"60837e18-5538-4452-b5f1-bf6167fd7fb3\") " pod="kube-system/konnectivity-agent-b7qq8" Jul 20 09:38:43.084299 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.016532 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsm4v\" (UniqueName: \"kubernetes.io/projected/bb703a13-b2ef-43d5-9cb8-219136053fd0-kube-api-access-lsm4v\") pod \"multus-v6qzc\" (UID: \"bb703a13-b2ef-43d5-9cb8-219136053fd0\") " pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.084299 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.016964 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwq2q\" (UniqueName: \"kubernetes.io/projected/285cd32a-2da4-4818-9d9b-5e1bf8152dba-kube-api-access-lwq2q\") pod \"multus-additional-cni-plugins-qvlqv\" (UID: \"285cd32a-2da4-4818-9d9b-5e1bf8152dba\") " pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.084299 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.017774 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkmmz\" (UniqueName: \"kubernetes.io/projected/0233a3ec-3051-479b-a07e-c348b1d845c8-kube-api-access-gkmmz\") pod \"aws-ebs-csi-driver-node-vlw5k\" (UID: \"0233a3ec-3051-479b-a07e-c348b1d845c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:43.084299 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.021757 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p726n\" (UniqueName: \"kubernetes.io/projected/2068181e-6e30-401a-89fc-af0528dc5aea-kube-api-access-p726n\") pod \"network-metrics-daemon-4fbtw\" (UID: \"2068181e-6e30-401a-89fc-af0528dc5aea\") " pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:43.084299 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.028592 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal" event={"ID":"64613b0dcac4a25dbe698c524fa81100","Type":"ContainerStarted","Data":"cb433438eed8445deaff4a7c64811d13797c87cb1f3a15ff176a4e7582e38bd9"} Jul 20 09:38:43.084299 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.030289 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-133.ec2.internal" event={"ID":"537e8aec3c3624c3b67c0e0e826a6719","Type":"ContainerStarted","Data":"2013a0c3a17d3e75b34492f77110ebb68aa4f0b90f70ccf9bf7d813e5dd627b8"} Jul 20 09:38:43.159687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b88caf79-cea9-46b2-8e58-9789262ec4c3-iptables-alerter-script\") pod \"iptables-alerter-6skng\" (UID: \"b88caf79-cea9-46b2-8e58-9789262ec4c3\") " pod="openshift-network-operator/iptables-alerter-6skng" Jul 20 09:38:43.159687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/208beea5-1d93-485f-9171-6e37de3aa513-serviceca\") pod \"node-ca-nsxxs\" (UID: \"208beea5-1d93-485f-9171-6e37de3aa513\") " pod="openshift-image-registry/node-ca-nsxxs" Jul 20 09:38:43.159687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-kubelet\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.159687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104374 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-sysconfig\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.159687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-modprobe-d\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.159687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104426 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-tuned\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.159687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-run-systemd\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.159687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-etc-openvswitch\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.159687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104509 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/208beea5-1d93-485f-9171-6e37de3aa513-host\") pod \"node-ca-nsxxs\" (UID: \"208beea5-1d93-485f-9171-6e37de3aa513\") " pod="openshift-image-registry/node-ca-nsxxs" Jul 20 09:38:43.159687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104532 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-run-openvswitch\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.159687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104569 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-sysconfig\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.159687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104578 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-cni-bin\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.159687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104623 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed-tmp-dir\") pod \"node-resolver-ctds5\" (UID: \"cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed\") " pod="openshift-dns/node-resolver-ctds5" Jul 20 09:38:43.159687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104628 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-cni-bin\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.159687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-systemd-units\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.162486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-sys\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.162486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104708 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-log-socket\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.162486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.162486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lspll\" (UniqueName: \"kubernetes.io/projected/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-kube-api-access-lspll\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.162486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104782 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-sysctl-d\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.162486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104807 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-var-lib-kubelet\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.162486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4x4k\" (UniqueName: \"kubernetes.io/projected/208beea5-1d93-485f-9171-6e37de3aa513-kube-api-access-t4x4k\") pod \"node-ca-nsxxs\" (UID: \"208beea5-1d93-485f-9171-6e37de3aa513\") " pod="openshift-image-registry/node-ca-nsxxs" Jul 20 09:38:43.162486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29bls\" (UniqueName: \"kubernetes.io/projected/b88caf79-cea9-46b2-8e58-9789262ec4c3-kube-api-access-29bls\") pod \"iptables-alerter-6skng\" (UID: \"b88caf79-cea9-46b2-8e58-9789262ec4c3\") " pod="openshift-network-operator/iptables-alerter-6skng" Jul 20 09:38:43.162486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-sysctl-conf\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.162486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-lib-modules\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.162486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104957 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-slash\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.162486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104958 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed-tmp-dir\") pod \"node-resolver-ctds5\" (UID: \"cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed\") " pod="openshift-dns/node-resolver-ctds5" Jul 20 09:38:43.162486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.104985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5xbs\" (UniqueName: \"kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs\") pod \"network-check-target-84zkv\" (UID: \"206c83ae-f404-40f7-900f-ebd6f6d5e044\") " pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:43.162486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-kubernetes\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.163412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105073 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-kubernetes\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.163412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105203 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-modprobe-d\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.163412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105577 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b88caf79-cea9-46b2-8e58-9789262ec4c3-iptables-alerter-script\") pod \"iptables-alerter-6skng\" (UID: \"b88caf79-cea9-46b2-8e58-9789262ec4c3\") " pod="openshift-network-operator/iptables-alerter-6skng" Jul 20 09:38:43.163412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105604 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-kubelet\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.163412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105626 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-tmp\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.163412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b88caf79-cea9-46b2-8e58-9789262ec4c3-host-slash\") pod \"iptables-alerter-6skng\" (UID: \"b88caf79-cea9-46b2-8e58-9789262ec4c3\") " pod="openshift-network-operator/iptables-alerter-6skng" Jul 20 09:38:43.163412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105670 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-etc-openvswitch\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.163412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105679 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-node-log\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.163412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105710 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-node-log\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.163412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-cni-netd\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.163412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105767 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtnrw\" (UniqueName: \"kubernetes.io/projected/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-kube-api-access-qtnrw\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.163412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105794 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bgv9\" (UniqueName: \"kubernetes.io/projected/cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed-kube-api-access-4bgv9\") pod \"node-resolver-ctds5\" (UID: \"cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed\") " pod="openshift-dns/node-resolver-ctds5" Jul 20 09:38:43.163412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105833 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-run-netns\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.163412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-ovnkube-config\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.163412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-run-ovn\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105916 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105942 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b3179ca-a114-4b20-8411-0b3638da7500-kubelet-config\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:43.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105989 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b3179ca-a114-4b20-8411-0b3638da7500-kubelet-config\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:43.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-systemd\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106000 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b88caf79-cea9-46b2-8e58-9789262ec4c3-host-slash\") pod \"iptables-alerter-6skng\" (UID: \"b88caf79-cea9-46b2-8e58-9789262ec4c3\") " pod="openshift-network-operator/iptables-alerter-6skng" Jul 20 09:38:43.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-run\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106032 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-run-systemd\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106044 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-host\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-var-lib-openvswitch\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106074 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-cni-netd\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106097 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-env-overrides\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-ovn-node-metrics-cert\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b3179ca-a114-4b20-8411-0b3638da7500-dbus\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:43.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106153 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-sysctl-d\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106197 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/208beea5-1d93-485f-9171-6e37de3aa513-host\") pod \"node-ca-nsxxs\" (UID: \"208beea5-1d93-485f-9171-6e37de3aa513\") " pod="openshift-image-registry/node-ca-nsxxs" Jul 20 09:38:43.166600 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106207 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b3179ca-a114-4b20-8411-0b3638da7500-dbus\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:43.166600 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106241 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-systemd-units\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.166600 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed-hosts-file\") pod \"node-resolver-ctds5\" (UID: \"cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed\") " pod="openshift-dns/node-resolver-ctds5" Jul 20 09:38:43.166600 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106291 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-run-openvswitch\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.166600 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.105955 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/208beea5-1d93-485f-9171-6e37de3aa513-serviceca\") pod \"node-ca-nsxxs\" (UID: \"208beea5-1d93-485f-9171-6e37de3aa513\") " pod="openshift-image-registry/node-ca-nsxxs" Jul 20 09:38:43.166600 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106362 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-slash\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.166600 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106387 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-var-lib-kubelet\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.166600 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106478 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-sysctl-conf\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.166600 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106554 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-sys\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.166600 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-ovnkube-script-lib\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.166600 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106605 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-run-netns\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.166600 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106613 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.166600 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:43.166600 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106750 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-lib-modules\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.166600 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106760 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed-hosts-file\") pod \"node-resolver-ctds5\" (UID: \"cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed\") " pod="openshift-dns/node-resolver-ctds5" Jul 20 09:38:43.169567 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.106778 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:38:43.169567 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106815 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-run\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.169567 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.106896 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret podName:6b3179ca-a114-4b20-8411-0b3638da7500 nodeName:}" failed. No retries permitted until 2026-07-20 09:38:43.606878273 +0000 UTC m=+3.080979286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret") pod "global-pull-secret-syncer-jqgr4" (UID: "6b3179ca-a114-4b20-8411-0b3638da7500") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:38:43.169567 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.106987 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-var-lib-openvswitch\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.169567 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.107117 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-host\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.169567 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.107160 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-log-socket\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.169567 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.107199 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-run-ovn\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.169567 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.107248 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-ovnkube-config\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.169567 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.107264 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-systemd\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.169567 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.107306 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.169567 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.107385 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-env-overrides\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.169567 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.107953 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-ovnkube-script-lib\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.169567 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.109850 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-ovn-node-metrics-cert\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.169567 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.109991 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-tmp\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.170491 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.110035 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-etc-tuned\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.170491 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.114233 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:38:43.170491 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.114257 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:38:43.170491 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.114271 2577 projected.go:196] Error preparing data for projected volume kube-api-access-n5xbs for pod openshift-network-diagnostics/network-check-target-84zkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:38:43.170491 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.114331 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs podName:206c83ae-f404-40f7-900f-ebd6f6d5e044 nodeName:}" failed. No retries permitted until 2026-07-20 09:38:43.614314773 +0000 UTC m=+3.088415800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n5xbs" (UniqueName: "kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs") pod "network-check-target-84zkv" (UID: "206c83ae-f404-40f7-900f-ebd6f6d5e044") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:38:43.170491 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.116048 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29bls\" (UniqueName: \"kubernetes.io/projected/b88caf79-cea9-46b2-8e58-9789262ec4c3-kube-api-access-29bls\") pod \"iptables-alerter-6skng\" (UID: \"b88caf79-cea9-46b2-8e58-9789262ec4c3\") " pod="openshift-network-operator/iptables-alerter-6skng" Jul 20 09:38:43.170491 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.117154 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bgv9\" (UniqueName: \"kubernetes.io/projected/cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed-kube-api-access-4bgv9\") pod \"node-resolver-ctds5\" (UID: \"cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed\") " pod="openshift-dns/node-resolver-ctds5" Jul 20 09:38:43.170491 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.117311 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4x4k\" (UniqueName: \"kubernetes.io/projected/208beea5-1d93-485f-9171-6e37de3aa513-kube-api-access-t4x4k\") pod \"node-ca-nsxxs\" (UID: \"208beea5-1d93-485f-9171-6e37de3aa513\") " pod="openshift-image-registry/node-ca-nsxxs" Jul 20 09:38:43.170491 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.117745 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtnrw\" (UniqueName: \"kubernetes.io/projected/29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c-kube-api-access-qtnrw\") pod \"tuned-ghcmk\" (UID: \"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c\") " pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.170491 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.119674 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lspll\" (UniqueName: \"kubernetes.io/projected/c01153a9-d6d2-4e20-bc3a-fbe18daef4c2-kube-api-access-lspll\") pod \"ovnkube-node-2bvnv\" (UID: \"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.251262 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.207032 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qvlqv" Jul 20 09:38:43.251262 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.207051 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" Jul 20 09:38:43.251262 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.212360 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v6qzc" Jul 20 09:38:43.251262 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.220017 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b7qq8" Jul 20 09:38:43.251262 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.225496 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" Jul 20 09:38:43.251262 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.245017 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6skng" Jul 20 09:38:43.318850 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.257914 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nsxxs" Jul 20 09:38:43.318850 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:43.262770 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285cd32a_2da4_4818_9d9b_5e1bf8152dba.slice/crio-dda952005c7a7f3c3f9db17f0177a821e327af990e58a603bca388900d49195f WatchSource:0}: Error finding container dda952005c7a7f3c3f9db17f0177a821e327af990e58a603bca388900d49195f: Status 404 returned error can't find the container with id dda952005c7a7f3c3f9db17f0177a821e327af990e58a603bca388900d49195f Jul 20 09:38:43.318850 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.266675 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ctds5" Jul 20 09:38:43.318850 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:43.271247 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0233a3ec_3051_479b_a07e_c348b1d845c8.slice/crio-d4b8127752078f37bc62dfa2a96f0cf094cb8097b5ae32057060bde721ae78e6 WatchSource:0}: Error finding container d4b8127752078f37bc62dfa2a96f0cf094cb8097b5ae32057060bde721ae78e6: Status 404 returned error can't find the container with id d4b8127752078f37bc62dfa2a96f0cf094cb8097b5ae32057060bde721ae78e6 Jul 20 09:38:43.318850 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.275803 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:38:43.318850 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:43.277365 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb703a13_b2ef_43d5_9cb8_219136053fd0.slice/crio-c11ed694850c56739e64cb9a273ac1e919d3d7300b357e1b910f7336abe2f4c4 WatchSource:0}: Error finding container c11ed694850c56739e64cb9a273ac1e919d3d7300b357e1b910f7336abe2f4c4: Status 404 returned error can't find the container with id c11ed694850c56739e64cb9a273ac1e919d3d7300b357e1b910f7336abe2f4c4 Jul 20 09:38:43.318850 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:43.285832 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60837e18_5538_4452_b5f1_bf6167fd7fb3.slice/crio-cb970ddcc9f925a85f989786e10128cfeb52100fb93f6fbda0bdc53456b5a998 WatchSource:0}: Error finding container cb970ddcc9f925a85f989786e10128cfeb52100fb93f6fbda0bdc53456b5a998: Status 404 returned error can't find the container with id cb970ddcc9f925a85f989786e10128cfeb52100fb93f6fbda0bdc53456b5a998 Jul 20 09:38:43.318850 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:43.292213 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe9d359_ec2b_4b35_95d3_185fcdc3c5ed.slice/crio-79f738c247e6bc06d834c57ebcb8d4efc20546a2f0c9e7e514fc7e53bed55012 WatchSource:0}: Error finding container 79f738c247e6bc06d834c57ebcb8d4efc20546a2f0c9e7e514fc7e53bed55012: Status 404 returned error can't find the container with id 79f738c247e6bc06d834c57ebcb8d4efc20546a2f0c9e7e514fc7e53bed55012 Jul 20 09:38:43.318850 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:43.293260 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29bb9cc5_8aa4_401c_aaa1_fc24f34fea9c.slice/crio-6c6e0a6d6224418cc1c847f18845150f2ef4873f6b631ecfb650f84c5c438432 WatchSource:0}: Error finding container 6c6e0a6d6224418cc1c847f18845150f2ef4873f6b631ecfb650f84c5c438432: Status 404 returned error can't find the container with id 6c6e0a6d6224418cc1c847f18845150f2ef4873f6b631ecfb650f84c5c438432 Jul 20 09:38:43.318850 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:43.293841 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208beea5_1d93_485f_9171_6e37de3aa513.slice/crio-0cc9708bb254a2ebd95b68b4714907aead1a3dfef3fe6a31533458affa09ac74 WatchSource:0}: Error finding container 0cc9708bb254a2ebd95b68b4714907aead1a3dfef3fe6a31533458affa09ac74: Status 404 returned error can't find the container with id 0cc9708bb254a2ebd95b68b4714907aead1a3dfef3fe6a31533458affa09ac74 Jul 20 09:38:43.318850 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:38:43.301685 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01153a9_d6d2_4e20_bc3a_fbe18daef4c2.slice/crio-527f7dbfef5034b657c47c28390221f4f5ff429b543993a8d3f148a6e88f165a WatchSource:0}: Error finding container 527f7dbfef5034b657c47c28390221f4f5ff429b543993a8d3f148a6e88f165a: Status 404 returned error can't find the container with id 527f7dbfef5034b657c47c28390221f4f5ff429b543993a8d3f148a6e88f165a Jul 20 09:38:43.509657 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.509616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs\") pod \"network-metrics-daemon-4fbtw\" (UID: \"2068181e-6e30-401a-89fc-af0528dc5aea\") " pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:43.509929 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.509903 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:38:43.510037 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.510023 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs podName:2068181e-6e30-401a-89fc-af0528dc5aea nodeName:}" failed. No retries permitted until 2026-07-20 09:38:44.509999178 +0000 UTC m=+3.984100203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs") pod "network-metrics-daemon-4fbtw" (UID: "2068181e-6e30-401a-89fc-af0528dc5aea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:38:43.610099 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.610043 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:43.610275 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.610248 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:38:43.610356 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.610343 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret podName:6b3179ca-a114-4b20-8411-0b3638da7500 nodeName:}" failed. No retries permitted until 2026-07-20 09:38:44.610321087 +0000 UTC m=+4.084422116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret") pod "global-pull-secret-syncer-jqgr4" (UID: "6b3179ca-a114-4b20-8411-0b3638da7500") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:38:43.710547 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.710460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5xbs\" (UniqueName: \"kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs\") pod \"network-check-target-84zkv\" (UID: \"206c83ae-f404-40f7-900f-ebd6f6d5e044\") " pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:43.710713 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.710660 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:38:43.710713 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.710694 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:38:43.710713 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.710709 2577 projected.go:196] Error preparing data for projected volume kube-api-access-n5xbs for pod openshift-network-diagnostics/network-check-target-84zkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:38:43.710848 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:43.710781 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs podName:206c83ae-f404-40f7-900f-ebd6f6d5e044 nodeName:}" failed. No retries permitted until 2026-07-20 09:38:44.710764607 +0000 UTC m=+4.184865634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n5xbs" (UniqueName: "kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs") pod "network-check-target-84zkv" (UID: "206c83ae-f404-40f7-900f-ebd6f6d5e044") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:38:43.956252 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.956205 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 09:33:43 +0000 UTC" deadline="2028-03-20 07:17:56.823318031 +0000 UTC" Jul 20 09:38:43.956252 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:43.956244 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14613h39m12.867077655s" Jul 20 09:38:44.033969 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:44.033775 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b7qq8" event={"ID":"60837e18-5538-4452-b5f1-bf6167fd7fb3","Type":"ContainerStarted","Data":"cb970ddcc9f925a85f989786e10128cfeb52100fb93f6fbda0bdc53456b5a998"} Jul 20 09:38:44.035238 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:44.035205 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v6qzc" event={"ID":"bb703a13-b2ef-43d5-9cb8-219136053fd0","Type":"ContainerStarted","Data":"c11ed694850c56739e64cb9a273ac1e919d3d7300b357e1b910f7336abe2f4c4"} Jul 20 09:38:44.036501 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:44.036470 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" event={"ID":"0233a3ec-3051-479b-a07e-c348b1d845c8","Type":"ContainerStarted","Data":"d4b8127752078f37bc62dfa2a96f0cf094cb8097b5ae32057060bde721ae78e6"} Jul 20 09:38:44.037703 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:44.037677 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvlqv" event={"ID":"285cd32a-2da4-4818-9d9b-5e1bf8152dba","Type":"ContainerStarted","Data":"dda952005c7a7f3c3f9db17f0177a821e327af990e58a603bca388900d49195f"} Jul 20 09:38:44.038994 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:44.038972 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" event={"ID":"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c","Type":"ContainerStarted","Data":"6c6e0a6d6224418cc1c847f18845150f2ef4873f6b631ecfb650f84c5c438432"} Jul 20 09:38:44.040487 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:44.040412 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nsxxs" event={"ID":"208beea5-1d93-485f-9171-6e37de3aa513","Type":"ContainerStarted","Data":"0cc9708bb254a2ebd95b68b4714907aead1a3dfef3fe6a31533458affa09ac74"} Jul 20 09:38:44.041986 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:44.041908 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" event={"ID":"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2","Type":"ContainerStarted","Data":"527f7dbfef5034b657c47c28390221f4f5ff429b543993a8d3f148a6e88f165a"} Jul 20 09:38:44.043162 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:44.043127 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ctds5" event={"ID":"cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed","Type":"ContainerStarted","Data":"79f738c247e6bc06d834c57ebcb8d4efc20546a2f0c9e7e514fc7e53bed55012"} Jul 20 09:38:44.044374 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:44.044346 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6skng" event={"ID":"b88caf79-cea9-46b2-8e58-9789262ec4c3","Type":"ContainerStarted","Data":"b1b8f94fb9d9b19dcb0249a733460e2b380c1a22cad7144deedd48b90baab76a"} Jul 20 09:38:44.517382 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:44.517336 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs\") pod \"network-metrics-daemon-4fbtw\" (UID: \"2068181e-6e30-401a-89fc-af0528dc5aea\") " pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:44.517578 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:44.517524 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:38:44.517659 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:44.517593 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs podName:2068181e-6e30-401a-89fc-af0528dc5aea nodeName:}" failed. No retries permitted until 2026-07-20 09:38:46.517573227 +0000 UTC m=+5.991674241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs") pod "network-metrics-daemon-4fbtw" (UID: "2068181e-6e30-401a-89fc-af0528dc5aea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:38:44.617865 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:44.617821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:44.618057 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:44.617995 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:38:44.618144 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:44.618061 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret podName:6b3179ca-a114-4b20-8411-0b3638da7500 nodeName:}" failed. No retries permitted until 2026-07-20 09:38:46.618041687 +0000 UTC m=+6.092142719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret") pod "global-pull-secret-syncer-jqgr4" (UID: "6b3179ca-a114-4b20-8411-0b3638da7500") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:38:44.718934 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:44.718892 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5xbs\" (UniqueName: \"kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs\") pod \"network-check-target-84zkv\" (UID: \"206c83ae-f404-40f7-900f-ebd6f6d5e044\") " pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:44.719189 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:44.719151 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:38:44.719189 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:44.719177 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:38:44.719189 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:44.719191 2577 projected.go:196] Error preparing data for projected volume kube-api-access-n5xbs for pod openshift-network-diagnostics/network-check-target-84zkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:38:44.719351 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:44.719252 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs podName:206c83ae-f404-40f7-900f-ebd6f6d5e044 nodeName:}" failed. No retries permitted until 2026-07-20 09:38:46.719233877 +0000 UTC m=+6.193334903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n5xbs" (UniqueName: "kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs") pod "network-check-target-84zkv" (UID: "206c83ae-f404-40f7-900f-ebd6f6d5e044") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:38:44.957124 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:44.956983 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 09:33:43 +0000 UTC" deadline="2027-12-24 13:32:32.537062499 +0000 UTC" Jul 20 09:38:44.957124 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:44.957042 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12531h53m47.580025028s" Jul 20 09:38:45.023052 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:45.021829 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:45.023052 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:45.022506 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:38:45.023052 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:45.022348 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:45.023052 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:45.022601 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:38:45.023052 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:45.022306 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:45.023052 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:45.022695 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:38:45.068517 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:45.068366 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-133.ec2.internal" event={"ID":"537e8aec3c3624c3b67c0e0e826a6719","Type":"ContainerStarted","Data":"7b4f7d493c9eddb7a1e5185b42fd49e3335cdfe358c96ee541f81cf4e6bb59e8"} Jul 20 09:38:46.101449 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:46.101408 2577 generic.go:356] "Generic (PLEG): container finished" podID="64613b0dcac4a25dbe698c524fa81100" containerID="7fa4aa525e78dc16983973cc53f073f1e769411ab363bd7ad36fd929af082425" exitCode=0 Jul 20 09:38:46.102483 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:46.102453 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal" event={"ID":"64613b0dcac4a25dbe698c524fa81100","Type":"ContainerDied","Data":"7fa4aa525e78dc16983973cc53f073f1e769411ab363bd7ad36fd929af082425"} Jul 20 09:38:46.120693 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:46.120638 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-133.ec2.internal" podStartSLOduration=4.120615684 podStartE2EDuration="4.120615684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:38:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:38:45.089124851 +0000 UTC m=+4.563225885" watchObservedRunningTime="2026-07-20 09:38:46.120615684 +0000 UTC m=+5.594716719" Jul 20 09:38:46.536834 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:46.536160 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs\") pod \"network-metrics-daemon-4fbtw\" (UID: \"2068181e-6e30-401a-89fc-af0528dc5aea\") " pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:46.536834 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:46.536311 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:38:46.536834 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:46.536381 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs podName:2068181e-6e30-401a-89fc-af0528dc5aea nodeName:}" failed. No retries permitted until 2026-07-20 09:38:50.536359715 +0000 UTC m=+10.010460728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs") pod "network-metrics-daemon-4fbtw" (UID: "2068181e-6e30-401a-89fc-af0528dc5aea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:38:46.637818 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:46.637247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:46.637818 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:46.637393 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:38:46.637818 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:46.637458 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret podName:6b3179ca-a114-4b20-8411-0b3638da7500 nodeName:}" failed. No retries permitted until 2026-07-20 09:38:50.637438339 +0000 UTC m=+10.111539353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret") pod "global-pull-secret-syncer-jqgr4" (UID: "6b3179ca-a114-4b20-8411-0b3638da7500") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:38:46.739187 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:46.738762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5xbs\" (UniqueName: \"kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs\") pod \"network-check-target-84zkv\" (UID: \"206c83ae-f404-40f7-900f-ebd6f6d5e044\") " pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:46.739187 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:46.738952 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:38:46.739187 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:46.738973 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:38:46.739187 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:46.738987 2577 projected.go:196] Error preparing data for projected volume kube-api-access-n5xbs for pod openshift-network-diagnostics/network-check-target-84zkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:38:46.739187 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:46.739051 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs podName:206c83ae-f404-40f7-900f-ebd6f6d5e044 nodeName:}" failed. No retries permitted until 2026-07-20 09:38:50.739031186 +0000 UTC m=+10.213132217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n5xbs" (UniqueName: "kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs") pod "network-check-target-84zkv" (UID: "206c83ae-f404-40f7-900f-ebd6f6d5e044") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:38:47.018917 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:47.018807 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:47.019081 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:47.018933 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:47.019081 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:47.019054 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:38:47.019558 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:47.019532 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:38:47.019650 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:47.019609 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:47.019707 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:47.019689 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:38:47.124716 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:47.124672 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal" event={"ID":"64613b0dcac4a25dbe698c524fa81100","Type":"ContainerStarted","Data":"d5f522dcbb69b3ee3a27ae4db03a8a73479fe1dd492f76621748e4669f91d413"} Jul 20 09:38:49.022392 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:49.022258 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:49.022392 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:49.022271 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:49.022392 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:49.022395 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:38:49.022986 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:49.022464 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:38:49.022986 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:49.022270 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:49.022986 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:49.022566 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:38:50.573894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:50.573245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs\") pod \"network-metrics-daemon-4fbtw\" (UID: \"2068181e-6e30-401a-89fc-af0528dc5aea\") " pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:50.573894 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:50.573414 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:38:50.573894 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:50.573504 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs podName:2068181e-6e30-401a-89fc-af0528dc5aea nodeName:}" failed. No retries permitted until 2026-07-20 09:38:58.57348128 +0000 UTC m=+18.047582297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs") pod "network-metrics-daemon-4fbtw" (UID: "2068181e-6e30-401a-89fc-af0528dc5aea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:38:50.674101 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:50.674066 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:50.674280 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:50.674198 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:38:50.674280 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:50.674250 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret podName:6b3179ca-a114-4b20-8411-0b3638da7500 nodeName:}" failed. No retries permitted until 2026-07-20 09:38:58.67423568 +0000 UTC m=+18.148336703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret") pod "global-pull-secret-syncer-jqgr4" (UID: "6b3179ca-a114-4b20-8411-0b3638da7500") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:38:50.775500 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:50.775450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5xbs\" (UniqueName: \"kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs\") pod \"network-check-target-84zkv\" (UID: \"206c83ae-f404-40f7-900f-ebd6f6d5e044\") " pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:50.775689 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:50.775622 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:38:50.775689 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:50.775642 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:38:50.775689 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:50.775655 2577 projected.go:196] Error preparing data for projected volume kube-api-access-n5xbs for pod openshift-network-diagnostics/network-check-target-84zkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:38:50.775907 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:50.775726 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs podName:206c83ae-f404-40f7-900f-ebd6f6d5e044 nodeName:}" failed. No retries permitted until 2026-07-20 09:38:58.775699709 +0000 UTC m=+18.249800721 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n5xbs" (UniqueName: "kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs") pod "network-check-target-84zkv" (UID: "206c83ae-f404-40f7-900f-ebd6f6d5e044") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:38:51.022434 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:51.022352 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:51.022583 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:51.022497 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:38:51.022583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:51.022551 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:51.022710 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:51.022604 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:38:51.022710 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:51.022631 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:51.022710 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:51.022667 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:38:53.018579 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:53.018143 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:53.018579 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:53.018274 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:38:53.018579 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:53.018143 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:53.018579 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:53.018392 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:38:53.018579 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:53.018464 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:53.018579 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:53.018546 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:38:55.018643 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:55.018604 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:55.019160 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:55.018724 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:55.019160 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:55.018731 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:38:55.019160 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:55.018749 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:55.019160 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:55.018821 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:38:55.019160 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:55.018957 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:38:57.018186 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:57.018145 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:57.018673 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:57.018144 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:57.018673 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:57.018287 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:38:57.018673 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:57.018414 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:38:57.018673 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:57.018144 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:57.018673 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:57.018552 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:38:58.636084 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:58.636052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs\") pod \"network-metrics-daemon-4fbtw\" (UID: \"2068181e-6e30-401a-89fc-af0528dc5aea\") " pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:58.636494 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:58.636179 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:38:58.636494 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:58.636243 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs podName:2068181e-6e30-401a-89fc-af0528dc5aea nodeName:}" failed. No retries permitted until 2026-07-20 09:39:14.636227642 +0000 UTC m=+34.110328673 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs") pod "network-metrics-daemon-4fbtw" (UID: "2068181e-6e30-401a-89fc-af0528dc5aea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:38:58.737118 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:58.737085 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:58.737304 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:58.737282 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:38:58.737391 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:58.737370 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret podName:6b3179ca-a114-4b20-8411-0b3638da7500 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:14.737344656 +0000 UTC m=+34.211445688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret") pod "global-pull-secret-syncer-jqgr4" (UID: "6b3179ca-a114-4b20-8411-0b3638da7500") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:38:58.838231 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:58.838194 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5xbs\" (UniqueName: \"kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs\") pod \"network-check-target-84zkv\" (UID: \"206c83ae-f404-40f7-900f-ebd6f6d5e044\") " pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:58.838387 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:58.838369 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:38:58.838443 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:58.838407 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:38:58.838443 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:58.838420 2577 projected.go:196] Error preparing data for projected volume kube-api-access-n5xbs for pod openshift-network-diagnostics/network-check-target-84zkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:38:58.838510 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:58.838471 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs podName:206c83ae-f404-40f7-900f-ebd6f6d5e044 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:14.838457681 +0000 UTC m=+34.312558690 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n5xbs" (UniqueName: "kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs") pod "network-check-target-84zkv" (UID: "206c83ae-f404-40f7-900f-ebd6f6d5e044") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:38:59.021393 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:59.021326 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:38:59.021393 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:59.021334 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:38:59.021588 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:59.021435 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:38:59.021588 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:38:59.021461 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:38:59.021588 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:59.021534 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:38:59.021706 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:38:59.021658 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:39:01.019833 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:01.019797 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:39:01.020360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:01.019959 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:39:01.020360 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:01.019981 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:39:01.020360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:01.020101 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:39:01.020360 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:01.020117 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:39:01.020360 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:01.020187 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:39:03.018880 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.018695 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:39:03.019225 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.018695 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:39:03.019225 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:03.018963 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:39:03.019225 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.018722 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:39:03.019225 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:03.019066 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:39:03.019225 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:03.019126 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:39:03.158555 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.158504 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b7qq8" event={"ID":"60837e18-5538-4452-b5f1-bf6167fd7fb3","Type":"ContainerStarted","Data":"e89c24057c96b2222e362fdf9a4ddb0bf6f323fcec9f0ed0822fb048f552b52a"} Jul 20 09:39:03.159986 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.159962 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v6qzc" event={"ID":"bb703a13-b2ef-43d5-9cb8-219136053fd0","Type":"ContainerStarted","Data":"2b2066c4b7220b30d48af584d7b13ce2ffb6454c0326997583dbac25473e2f6f"} Jul 20 09:39:03.161374 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.161349 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" event={"ID":"0233a3ec-3051-479b-a07e-c348b1d845c8","Type":"ContainerStarted","Data":"7347016c7b46065b767e6bf0cb6694dca391f8f139c7827ab5d026e07850fcfa"} Jul 20 09:39:03.162826 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.162805 2577 generic.go:356] "Generic (PLEG): container finished" podID="285cd32a-2da4-4818-9d9b-5e1bf8152dba" containerID="0ae75e491ffc0dfbb3343093232783758b9cb948a38ffa83e7e12e1152560698" exitCode=0 Jul 20 09:39:03.162922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.162871 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvlqv" event={"ID":"285cd32a-2da4-4818-9d9b-5e1bf8152dba","Type":"ContainerDied","Data":"0ae75e491ffc0dfbb3343093232783758b9cb948a38ffa83e7e12e1152560698"} Jul 20 09:39:03.165076 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.165056 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" event={"ID":"29bb9cc5-8aa4-401c-aaa1-fc24f34fea9c","Type":"ContainerStarted","Data":"c411f21c937a17a6a5872b96ee61d7506098cc68f89716200b8ffd1b48576ecb"} Jul 20 09:39:03.166648 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.166624 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nsxxs" event={"ID":"208beea5-1d93-485f-9171-6e37de3aa513","Type":"ContainerStarted","Data":"53e7d54c5018e99e16295708b71813a51e8d19c64db0776f8cee78acc50c5eb1"} Jul 20 09:39:03.168158 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.168133 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ctds5" event={"ID":"cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed","Type":"ContainerStarted","Data":"2d3f677cb4b6030d466447c1422dde9a2a963f3001b272be398cf0c3dc0ea016"} Jul 20 09:39:03.185868 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.185763 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-133.ec2.internal" podStartSLOduration=21.185748691 podStartE2EDuration="21.185748691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:38:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:38:47.147311469 +0000 UTC m=+6.621412504" watchObservedRunningTime="2026-07-20 09:39:03.185748691 +0000 UTC m=+22.659849725" Jul 20 09:39:03.185991 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.185973 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b7qq8" podStartSLOduration=2.770710024 podStartE2EDuration="22.1859677s" totalImagesPullingTime="19.415257676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:03.185663235 +0000 UTC m=+22.659764266" watchObservedRunningTime="2026-07-20 09:39:03.1859677 +0000 UTC m=+22.660068731" Jul 20 09:39:03.208009 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.207961 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ghcmk" podStartSLOduration=2.7651105510000002 podStartE2EDuration="22.207945019s" totalImagesPullingTime="19.442834468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:03.207397212 +0000 UTC m=+22.681498241" watchObservedRunningTime="2026-07-20 09:39:03.207945019 +0000 UTC m=+22.682046049" Jul 20 09:39:03.226951 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.226902 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nsxxs" podStartSLOduration=2.821144567 podStartE2EDuration="22.226887144s" totalImagesPullingTime="19.405742577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:03.226767646 +0000 UTC m=+22.700868677" watchObservedRunningTime="2026-07-20 09:39:03.226887144 +0000 UTC m=+22.700988172" Jul 20 09:39:03.278747 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.278703 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v6qzc" podStartSLOduration=2.635329454 podStartE2EDuration="22.278688373s" totalImagesPullingTime="19.643358919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:03.278473562 +0000 UTC m=+22.752574590" watchObservedRunningTime="2026-07-20 09:39:03.278688373 +0000 UTC m=+22.752789403" Jul 20 09:39:03.296278 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.296232 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ctds5" podStartSLOduration=2.890838793 podStartE2EDuration="22.296218937s" totalImagesPullingTime="19.405380144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:03.295821215 +0000 UTC m=+22.769922244" watchObservedRunningTime="2026-07-20 09:39:03.296218937 +0000 UTC m=+22.770319965" Jul 20 09:39:03.296579 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.296556 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b7qq8" Jul 20 09:39:03.297131 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:03.297116 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b7qq8" Jul 20 09:39:04.173428 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:04.173284 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" event={"ID":"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2","Type":"ContainerStarted","Data":"c3895eaa0b36bea6143d8d7948032e6ac85ef1eb653ca2486b14fc3f676c1c67"} Jul 20 09:39:04.582617 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:04.582447 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 09:39:04.989483 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:04.989359 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T09:39:04.582603777Z","UUID":"5cf650ca-f366-4452-9e3c-71e5e07e0baa","Handler":null,"Name":"","Endpoint":""} Jul 20 09:39:04.990683 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:04.990664 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 09:39:04.990798 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:04.990696 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 09:39:05.018248 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:05.018149 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:39:05.018248 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:05.018151 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:39:05.018455 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:05.018316 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:39:05.018455 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:05.018423 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:39:05.018550 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:05.018512 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:39:05.018649 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:05.018621 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:39:05.177502 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:05.177463 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6skng" event={"ID":"b88caf79-cea9-46b2-8e58-9789262ec4c3","Type":"ContainerStarted","Data":"54af06d6dc23acd6cfebdcfbdaa7c7c995cbacf842489b34546e6baf17b59abd"} Jul 20 09:39:05.179562 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:05.179528 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" event={"ID":"0233a3ec-3051-479b-a07e-c348b1d845c8","Type":"ContainerStarted","Data":"3cafbf1bbd68a288bce86da0e641aa2389962e33a33e35fba0c86a424110972c"} Jul 20 09:39:05.184356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:05.184332 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" event={"ID":"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2","Type":"ContainerStarted","Data":"a0ac955c0539dce9e88114a85d74ed943bb3159776fb5803ae82db9d0c1fa87c"} Jul 20 09:39:05.184498 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:05.184369 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 20 09:39:05.184498 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:05.184396 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" event={"ID":"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2","Type":"ContainerStarted","Data":"ec6808f3d04877513cc5ca8dbdb16bcb4c9a3f70ad69c28c8b29cc1d7ff7b9cb"} Jul 20 09:39:05.184498 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:05.184442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" event={"ID":"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2","Type":"ContainerStarted","Data":"8b17b07c4c6d48da85667b9b7d2e97698ed767790989616937ef7d04349565d7"} Jul 20 09:39:05.184498 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:05.184491 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" event={"ID":"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2","Type":"ContainerStarted","Data":"0db0ac76a142f66c496146274988feea0731d3079031f4455f156ce68e0f74ed"} Jul 20 09:39:05.184665 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:05.184537 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" event={"ID":"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2","Type":"ContainerStarted","Data":"c23151780107952adcd77e469755d109c49aa9380e26790096ee531d424fd44d"} Jul 20 09:39:05.193684 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:05.193637 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6skng" podStartSLOduration=4.749113382 podStartE2EDuration="24.193621776s" totalImagesPullingTime="19.444508394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:05.193012043 +0000 UTC m=+24.667113075" watchObservedRunningTime="2026-07-20 09:39:05.193621776 +0000 UTC m=+24.667722808" Jul 20 09:39:07.018866 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:07.018604 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:39:07.019337 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:07.018607 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:39:07.019337 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:07.018974 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:39:07.019337 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:07.018607 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:39:07.019337 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:07.019053 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:39:07.019337 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:07.019131 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:39:08.195321 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:08.195283 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" event={"ID":"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2","Type":"ContainerStarted","Data":"a66439d8be76974e1bf67ee8addf6a871f1a2bea660161061486b2f2cc9d01fa"} Jul 20 09:39:08.197352 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:08.197329 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" event={"ID":"0233a3ec-3051-479b-a07e-c348b1d845c8","Type":"ContainerStarted","Data":"bd0b22dc8f2a9db688b28a0fe2785c54cd211a0de77049dfaf2f24e2e162cfef"} Jul 20 09:39:08.199053 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:08.199029 2577 generic.go:356] "Generic (PLEG): container finished" podID="285cd32a-2da4-4818-9d9b-5e1bf8152dba" containerID="9f55ad9721c00fab2e6409ae080494dd03fe768cede5a146feb7f3412e559757" exitCode=0 Jul 20 09:39:08.199157 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:08.199067 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvlqv" event={"ID":"285cd32a-2da4-4818-9d9b-5e1bf8152dba","Type":"ContainerDied","Data":"9f55ad9721c00fab2e6409ae080494dd03fe768cede5a146feb7f3412e559757"} Jul 20 09:39:08.214673 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:08.214630 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlw5k" podStartSLOduration=3.138954132 podStartE2EDuration="27.214618416s" totalImagesPullingTime="24.075664284s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:38:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:08.214037698 +0000 UTC m=+27.688138729" watchObservedRunningTime="2026-07-20 09:39:08.214618416 +0000 UTC m=+27.688719444" Jul 20 09:39:09.018776 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:09.018732 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:39:09.018943 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:09.018732 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:39:09.018943 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:09.018879 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:39:09.019081 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:09.018742 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:39:09.019081 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:09.018974 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:39:09.019081 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:09.019049 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:39:10.207740 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:10.207427 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" event={"ID":"c01153a9-d6d2-4e20-bc3a-fbe18daef4c2","Type":"ContainerStarted","Data":"74890cd744ffecff1dc2122ded86f2224ae5e6f58221a2ff2989885e636b4fbe"} Jul 20 09:39:10.208384 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:10.207746 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:39:10.208384 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:10.207802 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:39:10.209716 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:10.209662 2577 generic.go:356] "Generic (PLEG): container finished" podID="285cd32a-2da4-4818-9d9b-5e1bf8152dba" containerID="be6c08a0b310472ba80214ace9488e1126b08209f8606ab589d1e5b7cc246c61" exitCode=0 Jul 20 09:39:10.209822 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:10.209751 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvlqv" event={"ID":"285cd32a-2da4-4818-9d9b-5e1bf8152dba","Type":"ContainerDied","Data":"be6c08a0b310472ba80214ace9488e1126b08209f8606ab589d1e5b7cc246c61"} Jul 20 09:39:10.223795 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:10.223775 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:39:10.241500 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:10.241457 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" podStartSLOduration=8.525655372 podStartE2EDuration="29.241446329s" totalImagesPullingTime="20.715790957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:10.241341538 +0000 UTC m=+29.715442569" watchObservedRunningTime="2026-07-20 09:39:10.241446329 +0000 UTC m=+29.715547359" Jul 20 09:39:11.018614 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:11.018587 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:39:11.018830 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:11.018703 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:39:11.018830 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:11.018721 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:39:11.018830 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:11.018763 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:39:11.018830 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:11.018800 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:39:11.018992 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:11.018893 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:39:11.213273 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:11.213134 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:39:11.236998 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:11.236964 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:39:12.218399 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:12.218367 2577 generic.go:356] "Generic (PLEG): container finished" podID="285cd32a-2da4-4818-9d9b-5e1bf8152dba" containerID="3daf163fdd2a5879758f34a409486a671e33d96226faaae598487981fb520d3e" exitCode=0 Jul 20 09:39:12.218917 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:12.218452 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvlqv" event={"ID":"285cd32a-2da4-4818-9d9b-5e1bf8152dba","Type":"ContainerDied","Data":"3daf163fdd2a5879758f34a409486a671e33d96226faaae598487981fb520d3e"} Jul 20 09:39:12.541355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:12.541285 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4fbtw"] Jul 20 09:39:12.541479 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:12.541413 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:39:12.541532 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:12.541504 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:39:12.544242 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:12.544214 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-84zkv"] Jul 20 09:39:12.544345 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:12.544331 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:39:12.544445 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:12.544423 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:39:12.556570 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:12.556546 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jqgr4"] Jul 20 09:39:12.556693 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:12.556649 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:39:12.556773 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:12.556750 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:39:13.039111 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:13.038782 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b7qq8" Jul 20 09:39:13.039277 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:13.039162 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 20 09:39:13.039568 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:13.039538 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b7qq8" Jul 20 09:39:14.018195 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:14.018155 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:39:14.018695 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:14.018201 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:39:14.018695 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:14.018158 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:39:14.018695 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:14.018276 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:39:14.018695 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:14.018370 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:39:14.018695 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:14.018435 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:39:14.657683 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:14.657642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs\") pod \"network-metrics-daemon-4fbtw\" (UID: \"2068181e-6e30-401a-89fc-af0528dc5aea\") " pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:39:14.657860 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:14.657817 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:39:14.657925 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:14.657914 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs podName:2068181e-6e30-401a-89fc-af0528dc5aea nodeName:}" failed. No retries permitted until 2026-07-20 09:39:46.657893619 +0000 UTC m=+66.131994642 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs") pod "network-metrics-daemon-4fbtw" (UID: "2068181e-6e30-401a-89fc-af0528dc5aea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:39:14.758958 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:14.758927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:39:14.759142 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:14.759062 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:39:14.759142 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:14.759125 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret podName:6b3179ca-a114-4b20-8411-0b3638da7500 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:46.759108454 +0000 UTC m=+66.233209462 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret") pod "global-pull-secret-syncer-jqgr4" (UID: "6b3179ca-a114-4b20-8411-0b3638da7500") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:39:14.860149 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:14.860102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5xbs\" (UniqueName: \"kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs\") pod \"network-check-target-84zkv\" (UID: \"206c83ae-f404-40f7-900f-ebd6f6d5e044\") " pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:39:14.860347 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:14.860333 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:39:14.860412 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:14.860358 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:39:14.860412 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:14.860369 2577 projected.go:196] Error preparing data for projected volume kube-api-access-n5xbs for pod openshift-network-diagnostics/network-check-target-84zkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:39:14.860521 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:14.860424 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs podName:206c83ae-f404-40f7-900f-ebd6f6d5e044 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:46.860407994 +0000 UTC m=+66.334509002 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n5xbs" (UniqueName: "kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs") pod "network-check-target-84zkv" (UID: "206c83ae-f404-40f7-900f-ebd6f6d5e044") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:39:16.018783 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.018746 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:39:16.019309 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.018791 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:39:16.019309 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.018790 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:39:16.019309 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:16.018886 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqgr4" podUID="6b3179ca-a114-4b20-8411-0b3638da7500" Jul 20 09:39:16.019309 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:16.019041 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fbtw" podUID="2068181e-6e30-401a-89fc-af0528dc5aea" Jul 20 09:39:16.019309 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:16.019126 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84zkv" podUID="206c83ae-f404-40f7-900f-ebd6f6d5e044" Jul 20 09:39:16.871886 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.871860 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-133.ec2.internal" event="NodeReady" Jul 20 09:39:16.872062 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.872001 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 09:39:16.909186 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.909151 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs"] Jul 20 09:39:16.924156 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.924130 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59db674c8d-5vqfz"] Jul 20 09:39:16.924351 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.924252 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" Jul 20 09:39:16.926916 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.926821 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 20 09:39:16.926916 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.926828 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 20 09:39:16.927123 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.927105 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:39:16.927331 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.927317 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 20 09:39:16.930239 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.930218 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xnvpv\"" Jul 20 09:39:16.938279 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.938261 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2"] Jul 20 09:39:16.938399 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.938383 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:16.941122 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.940928 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 20 09:39:16.941122 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.941067 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 20 09:39:16.941875 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.941417 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 20 09:39:16.941875 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.941598 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ppbr5\"" Jul 20 09:39:16.948218 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.948186 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 20 09:39:16.960440 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.960420 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm"] Jul 20 09:39:16.960535 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.960520 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:16.966091 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.965997 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 09:39:16.966091 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.966023 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 20 09:39:16.966293 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.966275 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 09:39:16.966349 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.966309 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9rrwk\"" Jul 20 09:39:16.966404 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.966372 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 20 09:39:16.980624 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.980591 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs"] Jul 20 09:39:16.980734 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.980632 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-d9hzk"] Jul 20 09:39:16.980734 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.980695 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" Jul 20 09:39:16.983715 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.983695 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 20 09:39:16.983829 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.983696 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 20 09:39:16.984394 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.984375 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:39:16.984476 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.984375 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 20 09:39:16.985111 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.985095 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fkkj9\"" Jul 20 09:39:16.994660 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.994626 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59db674c8d-5vqfz"] Jul 20 09:39:16.994777 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.994666 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2"] Jul 20 09:39:16.994777 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.994691 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-d9hzk"] Jul 20 09:39:16.994777 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.994711 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkz9d"] Jul 20 09:39:16.994955 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.994816 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:17.000104 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.999985 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 20 09:39:17.000104 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.000034 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:39:17.000104 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.000082 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 20 09:39:17.000308 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:16.999991 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 20 09:39:17.000386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.000370 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rn2wz\"" Jul 20 09:39:17.006506 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.006476 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 20 09:39:17.017156 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.017138 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh"] Jul 20 09:39:17.017286 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.017270 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkz9d" Jul 20 09:39:17.019779 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.019762 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 20 09:39:17.020153 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.020129 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9tbq2\"" Jul 20 09:39:17.020153 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.020136 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:39:17.041525 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.041508 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" Jul 20 09:39:17.044438 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.044418 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dlgms\"" Jul 20 09:39:17.044540 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.044462 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:39:17.044540 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.044470 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 20 09:39:17.044540 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.044500 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 20 09:39:17.044660 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.044641 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6587d"] Jul 20 09:39:17.065897 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.065875 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-gckq6"] Jul 20 09:39:17.065977 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.065916 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6587d" Jul 20 09:39:17.068705 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.068688 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6tr7c\"" Jul 20 09:39:17.068705 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.068700 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 09:39:17.068857 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.068737 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 09:39:17.075395 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075377 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-bound-sa-token\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.075486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075401 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnrf6\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-kube-api-access-mnrf6\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.075486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a2efae7-379c-4a23-a6eb-18488f533fca-image-registry-private-configuration\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.075486 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7669f8c-e50b-4df2-82ac-69ed7998a965-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-xj4vm\" (UID: \"c7669f8c-e50b-4df2-82ac-69ed7998a965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" Jul 20 09:39:17.075663 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21db448b-2c50-4d06-90ee-e18e8b089e99-serving-cert\") pod \"service-ca-operator-5bcbc94c78-pm8hs\" (UID: \"21db448b-2c50-4d06-90ee-e18e8b089e99\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" Jul 20 09:39:17.075663 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075529 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4454b868-0082-422b-98d7-9973c0fc725a-trusted-ca\") pod \"console-operator-565b7b569d-d9hzk\" (UID: \"4454b868-0082-422b-98d7-9973c0fc725a\") " pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:17.075663 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075581 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.075663 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7ctq2\" (UID: \"23f8474e-2d4a-4a50-b981-d506c0607319\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:17.075663 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075648 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-certificates\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.075919 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/23f8474e-2d4a-4a50-b981-d506c0607319-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-7ctq2\" (UID: \"23f8474e-2d4a-4a50-b981-d506c0607319\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:17.075919 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075731 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a2efae7-379c-4a23-a6eb-18488f533fca-trusted-ca\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.075919 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075758 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lk5w\" (UniqueName: \"kubernetes.io/projected/4454b868-0082-422b-98d7-9973c0fc725a-kube-api-access-2lk5w\") pod \"console-operator-565b7b569d-d9hzk\" (UID: \"4454b868-0082-422b-98d7-9973c0fc725a\") " pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:17.075919 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7669f8c-e50b-4df2-82ac-69ed7998a965-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-xj4vm\" (UID: \"c7669f8c-e50b-4df2-82ac-69ed7998a965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" Jul 20 09:39:17.075919 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghcqg\" (UniqueName: \"kubernetes.io/projected/23f8474e-2d4a-4a50-b981-d506c0607319-kube-api-access-ghcqg\") pod \"cluster-monitoring-operator-76cf8966f8-7ctq2\" (UID: \"23f8474e-2d4a-4a50-b981-d506c0607319\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:17.075919 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075899 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a2efae7-379c-4a23-a6eb-18488f533fca-ca-trust-extracted\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.075919 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075918 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/21db448b-2c50-4d06-90ee-e18e8b089e99-config\") pod \"service-ca-operator-5bcbc94c78-pm8hs\" (UID: \"21db448b-2c50-4d06-90ee-e18e8b089e99\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" Jul 20 09:39:17.076138 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkgtl\" (UniqueName: \"kubernetes.io/projected/c7669f8c-e50b-4df2-82ac-69ed7998a965-kube-api-access-tkgtl\") pod \"kube-storage-version-migrator-operator-7658d9b749-xj4vm\" (UID: \"c7669f8c-e50b-4df2-82ac-69ed7998a965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" Jul 20 09:39:17.076138 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075962 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4454b868-0082-422b-98d7-9973c0fc725a-config\") pod \"console-operator-565b7b569d-d9hzk\" (UID: \"4454b868-0082-422b-98d7-9973c0fc725a\") " pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:17.076138 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.075990 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg489\" (UniqueName: \"kubernetes.io/projected/21db448b-2c50-4d06-90ee-e18e8b089e99-kube-api-access-rg489\") pod \"service-ca-operator-5bcbc94c78-pm8hs\" (UID: \"21db448b-2c50-4d06-90ee-e18e8b089e99\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" Jul 20 09:39:17.076138 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.076008 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4454b868-0082-422b-98d7-9973c0fc725a-serving-cert\") pod \"console-operator-565b7b569d-d9hzk\" (UID: \"4454b868-0082-422b-98d7-9973c0fc725a\") " pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:17.076138 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.076025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a2efae7-379c-4a23-a6eb-18488f533fca-installation-pull-secrets\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.090325 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.090252 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7548f77d8d-9v8zw"] Jul 20 09:39:17.090325 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.090318 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.093475 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.093451 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 09:39:17.093573 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.093475 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 20 09:39:17.093573 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.093499 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xxgbn\"" Jul 20 09:39:17.093987 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.093971 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 20 09:39:17.094065 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.093972 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 09:39:17.102605 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.102584 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 20 09:39:17.110552 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.110535 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-xpb85"] Jul 20 09:39:17.110637 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.110623 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.125351 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.125300 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zb7xs\"" Jul 20 09:39:17.125351 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.125315 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 20 09:39:17.125499 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.125380 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 20 09:39:17.125499 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.125416 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 20 09:39:17.125593 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.125536 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 20 09:39:17.125679 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.125663 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 20 09:39:17.125738 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.125679 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 20 09:39:17.135075 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.135033 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-72mbq"] Jul 20 09:39:17.135154 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.135112 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-xpb85" Jul 20 09:39:17.139870 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.139836 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xnnq6\"" Jul 20 09:39:17.139961 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.139911 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 09:39:17.142113 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.142098 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 09:39:17.154992 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.154966 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b"] Jul 20 09:39:17.155105 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.155089 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-72mbq" Jul 20 09:39:17.158250 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.158227 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 09:39:17.158727 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.158713 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 09:39:17.159651 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.159619 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 09:39:17.159907 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.159891 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v7wvr\"" Jul 20 09:39:17.176708 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.176688 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84ptg\" (UniqueName: \"kubernetes.io/projected/e5f6b94d-3f8d-4e70-8517-dca13aed6509-kube-api-access-84ptg\") pod \"cluster-samples-operator-79b7c55f87-b6qdh\" (UID: \"e5f6b94d-3f8d-4e70-8517-dca13aed6509\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" Jul 20 09:39:17.176825 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.176718 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21db448b-2c50-4d06-90ee-e18e8b089e99-serving-cert\") pod \"service-ca-operator-5bcbc94c78-pm8hs\" (UID: \"21db448b-2c50-4d06-90ee-e18e8b089e99\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" Jul 20 09:39:17.176825 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.176738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7ctq2\" (UID: \"23f8474e-2d4a-4a50-b981-d506c0607319\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:17.176825 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.176755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94e41dbb-04af-4580-a433-b828787892e7-tmp\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.176825 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.176774 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c8w4\" (UniqueName: \"kubernetes.io/projected/3c55b1c9-2e18-45dc-8886-f0b24f629991-kube-api-access-2c8w4\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:17.176825 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.176791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a2efae7-379c-4a23-a6eb-18488f533fca-trusted-ca\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.177085 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.176825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94e41dbb-04af-4580-a433-b828787892e7-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.177085 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.176874 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 09:39:17.177085 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.176898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/94e41dbb-04af-4580-a433-b828787892e7-snapshots\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.177085 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.176922 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94e41dbb-04af-4580-a433-b828787892e7-serving-cert\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.177085 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.176947 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls podName:23f8474e-2d4a-4a50-b981-d506c0607319 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:17.676931764 +0000 UTC m=+37.151032773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7ctq2" (UID: "23f8474e-2d4a-4a50-b981-d506c0607319") : secret "cluster-monitoring-operator-tls" not found Jul 20 09:39:17.177085 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.176983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a2efae7-379c-4a23-a6eb-18488f533fca-ca-trust-extracted\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.177085 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkgtl\" (UniqueName: \"kubernetes.io/projected/c7669f8c-e50b-4df2-82ac-69ed7998a965-kube-api-access-tkgtl\") pod \"kube-storage-version-migrator-operator-7658d9b749-xj4vm\" (UID: \"c7669f8c-e50b-4df2-82ac-69ed7998a965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" Jul 20 09:39:17.177436 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177115 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/21db448b-2c50-4d06-90ee-e18e8b089e99-config\") pod \"service-ca-operator-5bcbc94c78-pm8hs\" (UID: \"21db448b-2c50-4d06-90ee-e18e8b089e99\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" Jul 20 09:39:17.177436 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkw27\" (UniqueName: \"kubernetes.io/projected/61c86824-41e2-4d04-87c5-b07bfeb653d2-kube-api-access-rkw27\") pod \"volume-data-source-validator-78cf4c6f6-kkz9d\" (UID: \"61c86824-41e2-4d04-87c5-b07bfeb653d2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkz9d" Jul 20 09:39:17.177436 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177198 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg489\" (UniqueName: \"kubernetes.io/projected/21db448b-2c50-4d06-90ee-e18e8b089e99-kube-api-access-rg489\") pod \"service-ca-operator-5bcbc94c78-pm8hs\" (UID: \"21db448b-2c50-4d06-90ee-e18e8b089e99\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" Jul 20 09:39:17.177436 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177242 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-bound-sa-token\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.177436 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnrf6\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-kube-api-access-mnrf6\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.177436 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177338 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a2efae7-379c-4a23-a6eb-18488f533fca-ca-trust-extracted\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.177436 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4454b868-0082-422b-98d7-9973c0fc725a-trusted-ca\") pod \"console-operator-565b7b569d-d9hzk\" (UID: \"4454b868-0082-422b-98d7-9973c0fc725a\") " pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:17.177436 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.177436 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177419 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-certificates\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.177893 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177445 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/23f8474e-2d4a-4a50-b981-d506c0607319-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-7ctq2\" (UID: \"23f8474e-2d4a-4a50-b981-d506c0607319\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:17.177893 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lk5w\" (UniqueName: \"kubernetes.io/projected/4454b868-0082-422b-98d7-9973c0fc725a-kube-api-access-2lk5w\") pod \"console-operator-565b7b569d-d9hzk\" (UID: \"4454b868-0082-422b-98d7-9973c0fc725a\") " pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:17.177893 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177512 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7669f8c-e50b-4df2-82ac-69ed7998a965-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-xj4vm\" (UID: \"c7669f8c-e50b-4df2-82ac-69ed7998a965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" Jul 20 09:39:17.177893 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghcqg\" (UniqueName: \"kubernetes.io/projected/23f8474e-2d4a-4a50-b981-d506c0607319-kube-api-access-ghcqg\") pod \"cluster-monitoring-operator-76cf8966f8-7ctq2\" (UID: \"23f8474e-2d4a-4a50-b981-d506c0607319\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:17.177893 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4454b868-0082-422b-98d7-9973c0fc725a-config\") pod \"console-operator-565b7b569d-d9hzk\" (UID: \"4454b868-0082-422b-98d7-9973c0fc725a\") " pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:17.177893 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.177634 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 09:39:17.177893 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.177651 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59db674c8d-5vqfz: secret "image-registry-tls" not found Jul 20 09:39:17.177893 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.177737 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls podName:5a2efae7-379c-4a23-a6eb-18488f533fca nodeName:}" failed. No retries permitted until 2026-07-20 09:39:17.677689676 +0000 UTC m=+37.151790714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls") pod "image-registry-59db674c8d-5vqfz" (UID: "5a2efae7-379c-4a23-a6eb-18488f533fca") : secret "image-registry-tls" not found Jul 20 09:39:17.177893 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177769 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c55b1c9-2e18-45dc-8886-f0b24f629991-config-volume\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:17.177893 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:17.177893 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177811 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a2efae7-379c-4a23-a6eb-18488f533fca-trusted-ca\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.177893 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4454b868-0082-422b-98d7-9973c0fc725a-serving-cert\") pod \"console-operator-565b7b569d-d9hzk\" (UID: \"4454b868-0082-422b-98d7-9973c0fc725a\") " pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:17.177893 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177874 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/21db448b-2c50-4d06-90ee-e18e8b089e99-config\") pod \"service-ca-operator-5bcbc94c78-pm8hs\" (UID: \"21db448b-2c50-4d06-90ee-e18e8b089e99\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" Jul 20 09:39:17.177893 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a2efae7-379c-4a23-a6eb-18488f533fca-installation-pull-secrets\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.178474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c55b1c9-2e18-45dc-8886-f0b24f629991-tmp-dir\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:17.178474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a2efae7-379c-4a23-a6eb-18488f533fca-image-registry-private-configuration\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.178474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.177977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7669f8c-e50b-4df2-82ac-69ed7998a965-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-xj4vm\" (UID: \"c7669f8c-e50b-4df2-82ac-69ed7998a965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" Jul 20 09:39:17.178474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.178001 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b6qdh\" (UID: \"e5f6b94d-3f8d-4e70-8517-dca13aed6509\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" Jul 20 09:39:17.178474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.178026 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-certificates\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.178474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.178031 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94e41dbb-04af-4580-a433-b828787892e7-service-ca-bundle\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.178474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.178083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjth6\" (UniqueName: \"kubernetes.io/projected/94e41dbb-04af-4580-a433-b828787892e7-kube-api-access-bjth6\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.178474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.178144 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4454b868-0082-422b-98d7-9973c0fc725a-config\") pod \"console-operator-565b7b569d-d9hzk\" (UID: \"4454b868-0082-422b-98d7-9973c0fc725a\") " pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:17.178474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.178272 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4454b868-0082-422b-98d7-9973c0fc725a-trusted-ca\") pod \"console-operator-565b7b569d-d9hzk\" (UID: \"4454b868-0082-422b-98d7-9973c0fc725a\") " pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:17.178819 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.178634 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7669f8c-e50b-4df2-82ac-69ed7998a965-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-xj4vm\" (UID: \"c7669f8c-e50b-4df2-82ac-69ed7998a965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" Jul 20 09:39:17.178961 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.178941 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/23f8474e-2d4a-4a50-b981-d506c0607319-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-7ctq2\" (UID: \"23f8474e-2d4a-4a50-b981-d506c0607319\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:17.180009 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.179352 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm"] Jul 20 09:39:17.180009 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.179384 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkz9d"] Jul 20 09:39:17.180009 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.179403 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh"] Jul 20 09:39:17.180009 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.179425 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6587d"] Jul 20 09:39:17.180009 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.179446 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-gckq6"] Jul 20 09:39:17.180009 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.179446 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" Jul 20 09:39:17.180009 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.179462 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b"] Jul 20 09:39:17.180009 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.179480 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-72mbq"] Jul 20 09:39:17.180009 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.179497 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7548f77d8d-9v8zw"] Jul 20 09:39:17.180009 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.179519 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-xpb85"] Jul 20 09:39:17.181835 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.181810 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7669f8c-e50b-4df2-82ac-69ed7998a965-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-xj4vm\" (UID: \"c7669f8c-e50b-4df2-82ac-69ed7998a965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" Jul 20 09:39:17.181941 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.181836 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21db448b-2c50-4d06-90ee-e18e8b089e99-serving-cert\") pod \"service-ca-operator-5bcbc94c78-pm8hs\" (UID: \"21db448b-2c50-4d06-90ee-e18e8b089e99\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" Jul 20 09:39:17.181941 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.181890 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a2efae7-379c-4a23-a6eb-18488f533fca-image-registry-private-configuration\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.181941 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.181836 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a2efae7-379c-4a23-a6eb-18488f533fca-installation-pull-secrets\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.182091 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.182076 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4454b868-0082-422b-98d7-9973c0fc725a-serving-cert\") pod \"console-operator-565b7b569d-d9hzk\" (UID: \"4454b868-0082-422b-98d7-9973c0fc725a\") " pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:17.182783 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.182768 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7qc5b\"" Jul 20 09:39:17.183114 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.183098 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 20 09:39:17.183321 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.183306 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 20 09:39:17.218287 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.218261 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg489\" (UniqueName: \"kubernetes.io/projected/21db448b-2c50-4d06-90ee-e18e8b089e99-kube-api-access-rg489\") pod \"service-ca-operator-5bcbc94c78-pm8hs\" (UID: \"21db448b-2c50-4d06-90ee-e18e8b089e99\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" Jul 20 09:39:17.218544 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.218528 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghcqg\" (UniqueName: \"kubernetes.io/projected/23f8474e-2d4a-4a50-b981-d506c0607319-kube-api-access-ghcqg\") pod \"cluster-monitoring-operator-76cf8966f8-7ctq2\" (UID: \"23f8474e-2d4a-4a50-b981-d506c0607319\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:17.218706 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.218687 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnrf6\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-kube-api-access-mnrf6\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.218745 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.218730 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lk5w\" (UniqueName: \"kubernetes.io/projected/4454b868-0082-422b-98d7-9973c0fc725a-kube-api-access-2lk5w\") pod \"console-operator-565b7b569d-d9hzk\" (UID: \"4454b868-0082-422b-98d7-9973c0fc725a\") " pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:17.219162 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.219139 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkgtl\" (UniqueName: \"kubernetes.io/projected/c7669f8c-e50b-4df2-82ac-69ed7998a965-kube-api-access-tkgtl\") pod \"kube-storage-version-migrator-operator-7658d9b749-xj4vm\" (UID: \"c7669f8c-e50b-4df2-82ac-69ed7998a965\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" Jul 20 09:39:17.221874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.221840 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-bound-sa-token\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.233950 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.233933 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" Jul 20 09:39:17.256406 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.256372 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:17.278983 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.278947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-default-certificate\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.279106 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c55b1c9-2e18-45dc-8886-f0b24f629991-config-volume\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:17.279106 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279043 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:17.279106 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279076 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c55b1c9-2e18-45dc-8886-f0b24f629991-tmp-dir\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:17.279106 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279100 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpg82\" (UniqueName: \"kubernetes.io/projected/a3bb3b46-397c-4531-b7eb-9c8980f07224-kube-api-access-xpg82\") pod \"ingress-canary-72mbq\" (UID: \"a3bb3b46-397c-4531-b7eb-9c8980f07224\") " pod="openshift-ingress-canary/ingress-canary-72mbq" Jul 20 09:39:17.279297 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279125 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.279297 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279158 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b6qdh\" (UID: \"e5f6b94d-3f8d-4e70-8517-dca13aed6509\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" Jul 20 09:39:17.279297 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.279169 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:39:17.279297 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.279234 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls podName:3c55b1c9-2e18-45dc-8886-f0b24f629991 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:17.779213253 +0000 UTC m=+37.253314274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls") pod "dns-default-6587d" (UID: "3c55b1c9-2e18-45dc-8886-f0b24f629991") : secret "dns-default-metrics-tls" not found Jul 20 09:39:17.279491 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279175 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94e41dbb-04af-4580-a433-b828787892e7-service-ca-bundle\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.279491 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279448 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjth6\" (UniqueName: \"kubernetes.io/projected/94e41dbb-04af-4580-a433-b828787892e7-kube-api-access-bjth6\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.279491 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279480 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84ptg\" (UniqueName: \"kubernetes.io/projected/e5f6b94d-3f8d-4e70-8517-dca13aed6509-kube-api-access-84ptg\") pod \"cluster-samples-operator-79b7c55f87-b6qdh\" (UID: \"e5f6b94d-3f8d-4e70-8517-dca13aed6509\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" Jul 20 09:39:17.279646 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279509 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3bb3b46-397c-4531-b7eb-9c8980f07224-cert\") pod \"ingress-canary-72mbq\" (UID: \"a3bb3b46-397c-4531-b7eb-9c8980f07224\") " pod="openshift-ingress-canary/ingress-canary-72mbq" Jul 20 09:39:17.279646 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279539 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvfp8\" (UniqueName: \"kubernetes.io/projected/9b7a8e55-f31e-414c-b345-de04a7bbcd58-kube-api-access-hvfp8\") pod \"network-check-source-7bc5b6bf85-xpb85\" (UID: \"9b7a8e55-f31e-414c-b345-de04a7bbcd58\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-xpb85" Jul 20 09:39:17.279646 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279553 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94e41dbb-04af-4580-a433-b828787892e7-service-ca-bundle\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.279646 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279582 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94e41dbb-04af-4580-a433-b828787892e7-tmp\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.279646 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7dx4\" (UniqueName: \"kubernetes.io/projected/b6832d68-310b-4ceb-aed2-ed26b866970b-kube-api-access-k7dx4\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.279897 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-stats-auth\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.279897 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4tp8b\" (UID: \"647a9d32-b9cd-44d3-b8ae-727d42d6b2a7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" Jul 20 09:39:17.279897 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279706 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c8w4\" (UniqueName: \"kubernetes.io/projected/3c55b1c9-2e18-45dc-8886-f0b24f629991-kube-api-access-2c8w4\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:17.279897 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279742 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c55b1c9-2e18-45dc-8886-f0b24f629991-tmp-dir\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:17.279897 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279742 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94e41dbb-04af-4580-a433-b828787892e7-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.279897 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/94e41dbb-04af-4580-a433-b828787892e7-snapshots\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.279897 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279808 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94e41dbb-04af-4580-a433-b828787892e7-serving-cert\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.279897 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-4tp8b\" (UID: \"647a9d32-b9cd-44d3-b8ae-727d42d6b2a7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" Jul 20 09:39:17.279897 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkw27\" (UniqueName: \"kubernetes.io/projected/61c86824-41e2-4d04-87c5-b07bfeb653d2-kube-api-access-rkw27\") pod \"volume-data-source-validator-78cf4c6f6-kkz9d\" (UID: \"61c86824-41e2-4d04-87c5-b07bfeb653d2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkz9d" Jul 20 09:39:17.280303 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.279921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.280303 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.280027 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 09:39:17.280303 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.280068 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls podName:e5f6b94d-3f8d-4e70-8517-dca13aed6509 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:17.78005487 +0000 UTC m=+37.254155892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-b6qdh" (UID: "e5f6b94d-3f8d-4e70-8517-dca13aed6509") : secret "samples-operator-tls" not found Jul 20 09:39:17.280446 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.280339 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94e41dbb-04af-4580-a433-b828787892e7-tmp\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.281035 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.280606 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94e41dbb-04af-4580-a433-b828787892e7-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.281035 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.280735 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/94e41dbb-04af-4580-a433-b828787892e7-snapshots\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.281352 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.281313 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c55b1c9-2e18-45dc-8886-f0b24f629991-config-volume\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:17.282891 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.282872 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94e41dbb-04af-4580-a433-b828787892e7-serving-cert\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.289888 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.289760 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" Jul 20 09:39:17.290869 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.290826 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjth6\" (UniqueName: \"kubernetes.io/projected/94e41dbb-04af-4580-a433-b828787892e7-kube-api-access-bjth6\") pod \"insights-operator-555d9d7885-gckq6\" (UID: \"94e41dbb-04af-4580-a433-b828787892e7\") " pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.292733 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.292689 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkw27\" (UniqueName: \"kubernetes.io/projected/61c86824-41e2-4d04-87c5-b07bfeb653d2-kube-api-access-rkw27\") pod \"volume-data-source-validator-78cf4c6f6-kkz9d\" (UID: \"61c86824-41e2-4d04-87c5-b07bfeb653d2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkz9d" Jul 20 09:39:17.292816 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.292748 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c8w4\" (UniqueName: \"kubernetes.io/projected/3c55b1c9-2e18-45dc-8886-f0b24f629991-kube-api-access-2c8w4\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:17.293245 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.293195 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84ptg\" (UniqueName: \"kubernetes.io/projected/e5f6b94d-3f8d-4e70-8517-dca13aed6509-kube-api-access-84ptg\") pod \"cluster-samples-operator-79b7c55f87-b6qdh\" (UID: \"e5f6b94d-3f8d-4e70-8517-dca13aed6509\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" Jul 20 09:39:17.308591 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.308564 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:17.325336 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.325315 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkz9d" Jul 20 09:39:17.382328 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.381284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-default-certificate\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.382328 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.381573 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpg82\" (UniqueName: \"kubernetes.io/projected/a3bb3b46-397c-4531-b7eb-9c8980f07224-kube-api-access-xpg82\") pod \"ingress-canary-72mbq\" (UID: \"a3bb3b46-397c-4531-b7eb-9c8980f07224\") " pod="openshift-ingress-canary/ingress-canary-72mbq" Jul 20 09:39:17.382328 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.381601 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.382328 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.381652 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3bb3b46-397c-4531-b7eb-9c8980f07224-cert\") pod \"ingress-canary-72mbq\" (UID: \"a3bb3b46-397c-4531-b7eb-9c8980f07224\") " pod="openshift-ingress-canary/ingress-canary-72mbq" Jul 20 09:39:17.382328 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.381679 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvfp8\" (UniqueName: \"kubernetes.io/projected/9b7a8e55-f31e-414c-b345-de04a7bbcd58-kube-api-access-hvfp8\") pod \"network-check-source-7bc5b6bf85-xpb85\" (UID: \"9b7a8e55-f31e-414c-b345-de04a7bbcd58\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-xpb85" Jul 20 09:39:17.382328 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.381727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7dx4\" (UniqueName: \"kubernetes.io/projected/b6832d68-310b-4ceb-aed2-ed26b866970b-kube-api-access-k7dx4\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.382328 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.381757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-stats-auth\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.382328 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.381781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4tp8b\" (UID: \"647a9d32-b9cd-44d3-b8ae-727d42d6b2a7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" Jul 20 09:39:17.382328 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.381828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-4tp8b\" (UID: \"647a9d32-b9cd-44d3-b8ae-727d42d6b2a7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" Jul 20 09:39:17.382876 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.382506 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-4tp8b\" (UID: \"647a9d32-b9cd-44d3-b8ae-727d42d6b2a7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" Jul 20 09:39:17.382876 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.382511 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle podName:b6832d68-310b-4ceb-aed2-ed26b866970b nodeName:}" failed. No retries permitted until 2026-07-20 09:39:17.882490206 +0000 UTC m=+37.356591227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle") pod "router-default-7548f77d8d-9v8zw" (UID: "b6832d68-310b-4ceb-aed2-ed26b866970b") : configmap references non-existent config key: service-ca.crt Jul 20 09:39:17.382876 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.382608 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 09:39:17.383041 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.382914 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert podName:647a9d32-b9cd-44d3-b8ae-727d42d6b2a7 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:17.882897844 +0000 UTC m=+37.356998857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4tp8b" (UID: "647a9d32-b9cd-44d3-b8ae-727d42d6b2a7") : secret "networking-console-plugin-cert" not found Jul 20 09:39:17.383184 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.383162 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.383371 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.383288 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 09:39:17.383371 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.383340 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs podName:b6832d68-310b-4ceb-aed2-ed26b866970b nodeName:}" failed. No retries permitted until 2026-07-20 09:39:17.883325501 +0000 UTC m=+37.357426516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs") pod "router-default-7548f77d8d-9v8zw" (UID: "b6832d68-310b-4ceb-aed2-ed26b866970b") : secret "router-metrics-certs-default" not found Jul 20 09:39:17.389288 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.388640 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3bb3b46-397c-4531-b7eb-9c8980f07224-cert\") pod \"ingress-canary-72mbq\" (UID: \"a3bb3b46-397c-4531-b7eb-9c8980f07224\") " pod="openshift-ingress-canary/ingress-canary-72mbq" Jul 20 09:39:17.389288 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.388640 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-stats-auth\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.389288 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.388640 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-default-certificate\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.401076 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.400212 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-gckq6" Jul 20 09:39:17.401076 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.400550 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvfp8\" (UniqueName: \"kubernetes.io/projected/9b7a8e55-f31e-414c-b345-de04a7bbcd58-kube-api-access-hvfp8\") pod \"network-check-source-7bc5b6bf85-xpb85\" (UID: \"9b7a8e55-f31e-414c-b345-de04a7bbcd58\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-xpb85" Jul 20 09:39:17.401593 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.401543 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpg82\" (UniqueName: \"kubernetes.io/projected/a3bb3b46-397c-4531-b7eb-9c8980f07224-kube-api-access-xpg82\") pod \"ingress-canary-72mbq\" (UID: \"a3bb3b46-397c-4531-b7eb-9c8980f07224\") " pod="openshift-ingress-canary/ingress-canary-72mbq" Jul 20 09:39:17.404641 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.402912 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7dx4\" (UniqueName: \"kubernetes.io/projected/b6832d68-310b-4ceb-aed2-ed26b866970b-kube-api-access-k7dx4\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.421495 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.421384 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:17.443837 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.443553 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-xpb85" Jul 20 09:39:17.463546 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.463439 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-72mbq" Jul 20 09:39:17.481627 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.481545 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs"] Jul 20 09:39:17.514552 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.514520 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:17.517290 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.517262 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm"] Jul 20 09:39:17.535317 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.535225 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-d9hzk"] Jul 20 09:39:17.546315 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.546290 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkz9d"] Jul 20 09:39:17.572192 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.572169 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-gckq6"] Jul 20 09:39:17.685482 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.685455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7ctq2\" (UID: \"23f8474e-2d4a-4a50-b981-d506c0607319\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:17.685668 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.685557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:17.685668 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.685595 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 09:39:17.685668 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.685659 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls podName:23f8474e-2d4a-4a50-b981-d506c0607319 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:18.685641812 +0000 UTC m=+38.159742826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7ctq2" (UID: "23f8474e-2d4a-4a50-b981-d506c0607319") : secret "cluster-monitoring-operator-tls" not found Jul 20 09:39:17.685773 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.685694 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 09:39:17.685773 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.685716 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59db674c8d-5vqfz: secret "image-registry-tls" not found Jul 20 09:39:17.685837 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.685778 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls podName:5a2efae7-379c-4a23-a6eb-18488f533fca nodeName:}" failed. No retries permitted until 2026-07-20 09:39:18.68575832 +0000 UTC m=+38.159859348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls") pod "image-registry-59db674c8d-5vqfz" (UID: "5a2efae7-379c-4a23-a6eb-18488f533fca") : secret "image-registry-tls" not found Jul 20 09:39:17.713345 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.713260 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-72mbq"] Jul 20 09:39:17.719172 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.719144 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-xpb85"] Jul 20 09:39:17.722484 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:39:17.722452 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3bb3b46_397c_4531_b7eb_9c8980f07224.slice/crio-897a1b38dd31fc00ad4e1e8769808b1ea65e5ff922794f97773e10c71696f3c9 WatchSource:0}: Error finding container 897a1b38dd31fc00ad4e1e8769808b1ea65e5ff922794f97773e10c71696f3c9: Status 404 returned error can't find the container with id 897a1b38dd31fc00ad4e1e8769808b1ea65e5ff922794f97773e10c71696f3c9 Jul 20 09:39:17.722834 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:39:17.722813 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7a8e55_f31e_414c_b345_de04a7bbcd58.slice/crio-44c2bd11671d8d43d2877bbd36c4470b8cb5117fec40893119e740b855610b00 WatchSource:0}: Error finding container 44c2bd11671d8d43d2877bbd36c4470b8cb5117fec40893119e740b855610b00: Status 404 returned error can't find the container with id 44c2bd11671d8d43d2877bbd36c4470b8cb5117fec40893119e740b855610b00 Jul 20 09:39:17.786067 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.786030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:17.786194 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.786084 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b6qdh\" (UID: \"e5f6b94d-3f8d-4e70-8517-dca13aed6509\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" Jul 20 09:39:17.786248 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.786182 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:39:17.786248 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.786221 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 09:39:17.786248 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.786247 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls podName:3c55b1c9-2e18-45dc-8886-f0b24f629991 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:18.786231637 +0000 UTC m=+38.260332646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls") pod "dns-default-6587d" (UID: "3c55b1c9-2e18-45dc-8886-f0b24f629991") : secret "dns-default-metrics-tls" not found Jul 20 09:39:17.786347 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.786261 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls podName:e5f6b94d-3f8d-4e70-8517-dca13aed6509 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:18.786254803 +0000 UTC m=+38.260355811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-b6qdh" (UID: "e5f6b94d-3f8d-4e70-8517-dca13aed6509") : secret "samples-operator-tls" not found Jul 20 09:39:17.886726 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.886693 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4tp8b\" (UID: \"647a9d32-b9cd-44d3-b8ae-727d42d6b2a7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" Jul 20 09:39:17.886900 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.886835 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 09:39:17.886956 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.886838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.886956 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.886909 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert podName:647a9d32-b9cd-44d3-b8ae-727d42d6b2a7 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:18.88689222 +0000 UTC m=+38.360993229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4tp8b" (UID: "647a9d32-b9cd-44d3-b8ae-727d42d6b2a7") : secret "networking-console-plugin-cert" not found Jul 20 09:39:17.886956 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.886917 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 09:39:17.887056 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.886962 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs podName:b6832d68-310b-4ceb-aed2-ed26b866970b nodeName:}" failed. No retries permitted until 2026-07-20 09:39:18.886950016 +0000 UTC m=+38.361051024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs") pod "router-default-7548f77d8d-9v8zw" (UID: "b6832d68-310b-4ceb-aed2-ed26b866970b") : secret "router-metrics-certs-default" not found Jul 20 09:39:17.887056 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:17.886996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:17.887113 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:17.887071 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle podName:b6832d68-310b-4ceb-aed2-ed26b866970b nodeName:}" failed. No retries permitted until 2026-07-20 09:39:18.887064739 +0000 UTC m=+38.361165748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle") pod "router-default-7548f77d8d-9v8zw" (UID: "b6832d68-310b-4ceb-aed2-ed26b866970b") : configmap references non-existent config key: service-ca.crt Jul 20 09:39:18.018319 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.018239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:39:18.018319 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.018265 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:39:18.018319 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.018265 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:39:18.021323 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.021301 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 09:39:18.021924 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.021350 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 09:39:18.021924 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.021372 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pgl5c\"" Jul 20 09:39:18.021924 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.021473 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hssrx\"" Jul 20 09:39:18.210134 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.209881 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:18.235768 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.235703 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-72mbq" event={"ID":"a3bb3b46-397c-4531-b7eb-9c8980f07224","Type":"ContainerStarted","Data":"897a1b38dd31fc00ad4e1e8769808b1ea65e5ff922794f97773e10c71696f3c9"} Jul 20 09:39:18.238079 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.238050 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-xpb85" event={"ID":"9b7a8e55-f31e-414c-b345-de04a7bbcd58","Type":"ContainerStarted","Data":"44c2bd11671d8d43d2877bbd36c4470b8cb5117fec40893119e740b855610b00"} Jul 20 09:39:18.240079 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.240018 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" event={"ID":"21db448b-2c50-4d06-90ee-e18e8b089e99","Type":"ContainerStarted","Data":"010fd3e83322b1c1b38f187dc7bba8b8cc681daad39f66968b53e73b695a4d9f"} Jul 20 09:39:18.241941 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.241898 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-gckq6" event={"ID":"94e41dbb-04af-4580-a433-b828787892e7","Type":"ContainerStarted","Data":"83a6ccf4c74637c73b7fbcd1376438f59bd129216e8f4f35b7b72711f2fa7af8"} Jul 20 09:39:18.243900 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.243877 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkz9d" event={"ID":"61c86824-41e2-4d04-87c5-b07bfeb653d2","Type":"ContainerStarted","Data":"383f1f2a665f226f1ed5a770f764036b3c2b098107a9fb60a633d60a8730a320"} Jul 20 09:39:18.249988 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.248879 2577 generic.go:356] "Generic (PLEG): container finished" podID="285cd32a-2da4-4818-9d9b-5e1bf8152dba" containerID="13a5a2661adbb9e9ec587895e3ce870f81c197c1f982c891a6b9f5cafa7c18d9" exitCode=0 Jul 20 09:39:18.249988 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.248951 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvlqv" event={"ID":"285cd32a-2da4-4818-9d9b-5e1bf8152dba","Type":"ContainerDied","Data":"13a5a2661adbb9e9ec587895e3ce870f81c197c1f982c891a6b9f5cafa7c18d9"} Jul 20 09:39:18.253327 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.253197 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" event={"ID":"4454b868-0082-422b-98d7-9973c0fc725a","Type":"ContainerStarted","Data":"5f4249ce49427cb084227f3a642d89877234ec88308ba787b1a4bfc086529fe2"} Jul 20 09:39:18.259022 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.258957 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" event={"ID":"c7669f8c-e50b-4df2-82ac-69ed7998a965","Type":"ContainerStarted","Data":"208b331e3e49b1ea00e44592264c0e2747df28023d1d91b0e05fd60ef1216530"} Jul 20 09:39:18.291308 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.291278 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:18.359971 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.359923 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:18.695759 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.695262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7ctq2\" (UID: \"23f8474e-2d4a-4a50-b981-d506c0607319\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:18.695759 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.695371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:18.695759 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:18.695516 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 09:39:18.696469 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:18.696099 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59db674c8d-5vqfz: secret "image-registry-tls" not found Jul 20 09:39:18.696469 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:18.695707 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 09:39:18.696469 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:18.696249 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls podName:23f8474e-2d4a-4a50-b981-d506c0607319 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:20.696204506 +0000 UTC m=+40.170305516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7ctq2" (UID: "23f8474e-2d4a-4a50-b981-d506c0607319") : secret "cluster-monitoring-operator-tls" not found Jul 20 09:39:18.697181 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:18.697143 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls podName:5a2efae7-379c-4a23-a6eb-18488f533fca nodeName:}" failed. No retries permitted until 2026-07-20 09:39:20.697121499 +0000 UTC m=+40.171222535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls") pod "image-registry-59db674c8d-5vqfz" (UID: "5a2efae7-379c-4a23-a6eb-18488f533fca") : secret "image-registry-tls" not found Jul 20 09:39:18.797388 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.796439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:18.797388 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.796521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b6qdh\" (UID: \"e5f6b94d-3f8d-4e70-8517-dca13aed6509\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" Jul 20 09:39:18.797388 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:18.796735 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 09:39:18.797388 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:18.796800 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls podName:e5f6b94d-3f8d-4e70-8517-dca13aed6509 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:20.796781924 +0000 UTC m=+40.270882936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-b6qdh" (UID: "e5f6b94d-3f8d-4e70-8517-dca13aed6509") : secret "samples-operator-tls" not found Jul 20 09:39:18.797388 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:18.797276 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:39:18.797388 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:18.797333 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls podName:3c55b1c9-2e18-45dc-8886-f0b24f629991 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:20.797314423 +0000 UTC m=+40.271415434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls") pod "dns-default-6587d" (UID: "3c55b1c9-2e18-45dc-8886-f0b24f629991") : secret "dns-default-metrics-tls" not found Jul 20 09:39:18.898968 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.898042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:18.898968 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.898124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:18.898968 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:18.898204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4tp8b\" (UID: \"647a9d32-b9cd-44d3-b8ae-727d42d6b2a7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" Jul 20 09:39:18.898968 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:18.898356 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 09:39:18.898968 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:18.898420 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert podName:647a9d32-b9cd-44d3-b8ae-727d42d6b2a7 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:20.898402212 +0000 UTC m=+40.372503230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4tp8b" (UID: "647a9d32-b9cd-44d3-b8ae-727d42d6b2a7") : secret "networking-console-plugin-cert" not found Jul 20 09:39:18.898968 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:18.898802 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 09:39:18.898968 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:18.898864 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs podName:b6832d68-310b-4ceb-aed2-ed26b866970b nodeName:}" failed. No retries permitted until 2026-07-20 09:39:20.898832047 +0000 UTC m=+40.372933061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs") pod "router-default-7548f77d8d-9v8zw" (UID: "b6832d68-310b-4ceb-aed2-ed26b866970b") : secret "router-metrics-certs-default" not found Jul 20 09:39:18.898968 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:18.898933 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle podName:b6832d68-310b-4ceb-aed2-ed26b866970b nodeName:}" failed. No retries permitted until 2026-07-20 09:39:20.898923 +0000 UTC m=+40.373024012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle") pod "router-default-7548f77d8d-9v8zw" (UID: "b6832d68-310b-4ceb-aed2-ed26b866970b") : configmap references non-existent config key: service-ca.crt Jul 20 09:39:19.271639 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:19.270889 2577 generic.go:356] "Generic (PLEG): container finished" podID="285cd32a-2da4-4818-9d9b-5e1bf8152dba" containerID="7b0185db4e56fbe7533a76afa6ba06b75d411f2e67f5f5f0fe89fa70e72ac9be" exitCode=0 Jul 20 09:39:19.271639 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:19.270971 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvlqv" event={"ID":"285cd32a-2da4-4818-9d9b-5e1bf8152dba","Type":"ContainerDied","Data":"7b0185db4e56fbe7533a76afa6ba06b75d411f2e67f5f5f0fe89fa70e72ac9be"} Jul 20 09:39:20.275922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:20.275840 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkz9d" event={"ID":"61c86824-41e2-4d04-87c5-b07bfeb653d2","Type":"ContainerStarted","Data":"7bb67198496b8fcb13b0ab0efd2ace39d5b2b6a3186388e15d8b1b9c83842e39"} Jul 20 09:39:20.280638 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:20.280608 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvlqv" event={"ID":"285cd32a-2da4-4818-9d9b-5e1bf8152dba","Type":"ContainerStarted","Data":"898a5a9cae4a427330587a8c703409f546affff992519ce581eeb687f1257da2"} Jul 20 09:39:20.295751 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:20.295668 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kkz9d" podStartSLOduration=14.184321868 podStartE2EDuration="16.295643582s" totalImagesPullingTime="2.111321714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:20.293462122 +0000 UTC m=+39.767563164" watchObservedRunningTime="2026-07-20 09:39:20.295643582 +0000 UTC m=+39.769744613" Jul 20 09:39:20.331269 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:20.331101 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qvlqv" podStartSLOduration=8.135897814 podStartE2EDuration="39.331076134s" totalImagesPullingTime="31.19517832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:38:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:20.329725174 +0000 UTC m=+39.803826207" watchObservedRunningTime="2026-07-20 09:39:20.331076134 +0000 UTC m=+39.805177168" Jul 20 09:39:20.463104 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:20.463060 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:20.565694 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:20.565659 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:20.651813 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:20.651735 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:20.720157 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:20.720123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7ctq2\" (UID: \"23f8474e-2d4a-4a50-b981-d506c0607319\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:20.720319 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:20.720231 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:20.720319 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:20.720271 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 09:39:20.720414 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:20.720338 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 09:39:20.720414 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:20.720350 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59db674c8d-5vqfz: secret "image-registry-tls" not found Jul 20 09:39:20.720414 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:20.720341 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls podName:23f8474e-2d4a-4a50-b981-d506c0607319 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:24.720321141 +0000 UTC m=+44.194422167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7ctq2" (UID: "23f8474e-2d4a-4a50-b981-d506c0607319") : secret "cluster-monitoring-operator-tls" not found Jul 20 09:39:20.720414 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:20.720390 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls podName:5a2efae7-379c-4a23-a6eb-18488f533fca nodeName:}" failed. No retries permitted until 2026-07-20 09:39:24.720379119 +0000 UTC m=+44.194480127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls") pod "image-registry-59db674c8d-5vqfz" (UID: "5a2efae7-379c-4a23-a6eb-18488f533fca") : secret "image-registry-tls" not found Jul 20 09:39:20.821559 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:20.821474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:20.821559 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:20.821545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b6qdh\" (UID: \"e5f6b94d-3f8d-4e70-8517-dca13aed6509\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" Jul 20 09:39:20.821779 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:20.821666 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:39:20.821779 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:20.821698 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 09:39:20.821779 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:20.821744 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls podName:3c55b1c9-2e18-45dc-8886-f0b24f629991 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:24.821722381 +0000 UTC m=+44.295823413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls") pod "dns-default-6587d" (UID: "3c55b1c9-2e18-45dc-8886-f0b24f629991") : secret "dns-default-metrics-tls" not found Jul 20 09:39:20.821779 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:20.821765 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls podName:e5f6b94d-3f8d-4e70-8517-dca13aed6509 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:24.821755897 +0000 UTC m=+44.295856911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-b6qdh" (UID: "e5f6b94d-3f8d-4e70-8517-dca13aed6509") : secret "samples-operator-tls" not found Jul 20 09:39:20.922274 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:20.922238 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:20.922443 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:20.922333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4tp8b\" (UID: \"647a9d32-b9cd-44d3-b8ae-727d42d6b2a7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" Jul 20 09:39:20.922506 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:20.922440 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle podName:b6832d68-310b-4ceb-aed2-ed26b866970b nodeName:}" failed. No retries permitted until 2026-07-20 09:39:24.922417689 +0000 UTC m=+44.396518698 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle") pod "router-default-7548f77d8d-9v8zw" (UID: "b6832d68-310b-4ceb-aed2-ed26b866970b") : configmap references non-existent config key: service-ca.crt Jul 20 09:39:20.922506 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:20.922488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:20.922506 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:20.922500 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 09:39:20.922641 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:20.922543 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert podName:647a9d32-b9cd-44d3-b8ae-727d42d6b2a7 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:24.922531969 +0000 UTC m=+44.396632986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4tp8b" (UID: "647a9d32-b9cd-44d3-b8ae-727d42d6b2a7") : secret "networking-console-plugin-cert" not found Jul 20 09:39:20.922641 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:20.922597 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 09:39:20.922641 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:20.922631 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs podName:b6832d68-310b-4ceb-aed2-ed26b866970b nodeName:}" failed. No retries permitted until 2026-07-20 09:39:24.922620664 +0000 UTC m=+44.396721685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs") pod "router-default-7548f77d8d-9v8zw" (UID: "b6832d68-310b-4ceb-aed2-ed26b866970b") : secret "router-metrics-certs-default" not found Jul 20 09:39:24.467672 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:24.467625 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:24.569123 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:24.569087 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:24.761393 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:24.761370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:24.761497 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:24.761479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7ctq2\" (UID: \"23f8474e-2d4a-4a50-b981-d506c0607319\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:24.761617 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:24.761521 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 09:39:24.761617 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:24.761535 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59db674c8d-5vqfz: secret "image-registry-tls" not found Jul 20 09:39:24.761617 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:24.761596 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls podName:5a2efae7-379c-4a23-a6eb-18488f533fca nodeName:}" failed. No retries permitted until 2026-07-20 09:39:32.761579916 +0000 UTC m=+52.235680941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls") pod "image-registry-59db674c8d-5vqfz" (UID: "5a2efae7-379c-4a23-a6eb-18488f533fca") : secret "image-registry-tls" not found Jul 20 09:39:24.761730 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:24.761617 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 09:39:24.761730 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:24.761669 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls podName:23f8474e-2d4a-4a50-b981-d506c0607319 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:32.761656569 +0000 UTC m=+52.235757579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7ctq2" (UID: "23f8474e-2d4a-4a50-b981-d506c0607319") : secret "cluster-monitoring-operator-tls" not found Jul 20 09:39:24.862023 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:24.861986 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:24.862194 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:24.862045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b6qdh\" (UID: \"e5f6b94d-3f8d-4e70-8517-dca13aed6509\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" Jul 20 09:39:24.862194 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:24.862145 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:39:24.862194 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:24.862145 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 09:39:24.862308 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:24.862208 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls podName:3c55b1c9-2e18-45dc-8886-f0b24f629991 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:32.862189373 +0000 UTC m=+52.336290383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls") pod "dns-default-6587d" (UID: "3c55b1c9-2e18-45dc-8886-f0b24f629991") : secret "dns-default-metrics-tls" not found Jul 20 09:39:24.862308 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:24.862228 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls podName:e5f6b94d-3f8d-4e70-8517-dca13aed6509 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:32.862220139 +0000 UTC m=+52.336321147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-b6qdh" (UID: "e5f6b94d-3f8d-4e70-8517-dca13aed6509") : secret "samples-operator-tls" not found Jul 20 09:39:24.962656 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:24.962633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:24.962758 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:24.962695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4tp8b\" (UID: \"647a9d32-b9cd-44d3-b8ae-727d42d6b2a7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" Jul 20 09:39:24.962797 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:24.962763 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:24.962875 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:24.962839 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle podName:b6832d68-310b-4ceb-aed2-ed26b866970b nodeName:}" failed. No retries permitted until 2026-07-20 09:39:32.962817522 +0000 UTC m=+52.436918531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle") pod "router-default-7548f77d8d-9v8zw" (UID: "b6832d68-310b-4ceb-aed2-ed26b866970b") : configmap references non-existent config key: service-ca.crt Jul 20 09:39:24.962875 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:24.962840 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 09:39:24.962961 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:24.962883 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 09:39:24.962961 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:24.962908 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert podName:647a9d32-b9cd-44d3-b8ae-727d42d6b2a7 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:32.962897911 +0000 UTC m=+52.436998921 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4tp8b" (UID: "647a9d32-b9cd-44d3-b8ae-727d42d6b2a7") : secret "networking-console-plugin-cert" not found Jul 20 09:39:24.962961 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:24.962928 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs podName:b6832d68-310b-4ceb-aed2-ed26b866970b nodeName:}" failed. No retries permitted until 2026-07-20 09:39:32.962919537 +0000 UTC m=+52.437020550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs") pod "router-default-7548f77d8d-9v8zw" (UID: "b6832d68-310b-4ceb-aed2-ed26b866970b") : secret "router-metrics-certs-default" not found Jul 20 09:39:25.297906 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:25.297229 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/0.log" Jul 20 09:39:25.297906 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:25.297278 2577 generic.go:356] "Generic (PLEG): container finished" podID="4454b868-0082-422b-98d7-9973c0fc725a" containerID="d65f8c9e45d9f572dc94ad8c882e586fc42ca2d49149d4cb1bbf8582495f109f" exitCode=255 Jul 20 09:39:25.297906 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:25.297355 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" event={"ID":"4454b868-0082-422b-98d7-9973c0fc725a","Type":"ContainerDied","Data":"d65f8c9e45d9f572dc94ad8c882e586fc42ca2d49149d4cb1bbf8582495f109f"} Jul 20 09:39:25.297906 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:25.297643 2577 scope.go:117] "RemoveContainer" containerID="d65f8c9e45d9f572dc94ad8c882e586fc42ca2d49149d4cb1bbf8582495f109f" Jul 20 09:39:25.301802 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:25.301731 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" event={"ID":"c7669f8c-e50b-4df2-82ac-69ed7998a965","Type":"ContainerStarted","Data":"ee5f6920d40b7b1dffaea017af64943a3606d2b1bb2c886fa22186a14fe05cd8"} Jul 20 09:39:25.303349 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:25.303323 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-72mbq" event={"ID":"a3bb3b46-397c-4531-b7eb-9c8980f07224","Type":"ContainerStarted","Data":"09ffb30212fe3269f67e13ea8ac65f777506a7d57644db8a8a3bf0fbe81ca129"} Jul 20 09:39:25.305502 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:25.305477 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-xpb85" event={"ID":"9b7a8e55-f31e-414c-b345-de04a7bbcd58","Type":"ContainerStarted","Data":"35d9f684004bfb2c863dc0686f039a87b7b6f53d28069dd30f9e433d687384d3"} Jul 20 09:39:25.308264 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:25.307670 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" event={"ID":"21db448b-2c50-4d06-90ee-e18e8b089e99","Type":"ContainerStarted","Data":"097c7b246345248b86e66bcb01b5001650cacdbc63a7c3652441a1eabbbd4932"} Jul 20 09:39:25.320151 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:25.320122 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-gckq6" event={"ID":"94e41dbb-04af-4580-a433-b828787892e7","Type":"ContainerStarted","Data":"aeb2d690b28ab0864b61ed4e7d2e1ee5413bc6ebcf5f030fa5c505c66dca5899"} Jul 20 09:39:25.336631 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:25.336478 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-xpb85" podStartSLOduration=14.084498156 podStartE2EDuration="21.336461954s" totalImagesPullingTime="7.251963798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:25.334828849 +0000 UTC m=+44.808929881" watchObservedRunningTime="2026-07-20 09:39:25.336461954 +0000 UTC m=+44.810562986" Jul 20 09:39:25.357030 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:25.356882 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-72mbq" podStartSLOduration=2.114761704 podStartE2EDuration="9.356861661s" totalImagesPullingTime="7.242099957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:25.355175115 +0000 UTC m=+44.829276142" watchObservedRunningTime="2026-07-20 09:39:25.356861661 +0000 UTC m=+44.830962684" Jul 20 09:39:25.392882 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:25.392798 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" podStartSLOduration=14.01722417 podStartE2EDuration="21.392781181s" totalImagesPullingTime="7.375557011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:25.37236344 +0000 UTC m=+44.846464467" watchObservedRunningTime="2026-07-20 09:39:25.392781181 +0000 UTC m=+44.866882223" Jul 20 09:39:25.413697 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:25.413636 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-gckq6" podStartSLOduration=14.03346269 podStartE2EDuration="21.413616464s" totalImagesPullingTime="7.380153774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:25.413395817 +0000 UTC m=+44.887496848" watchObservedRunningTime="2026-07-20 09:39:25.413616464 +0000 UTC m=+44.887717497" Jul 20 09:39:25.413913 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:25.413876 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" podStartSLOduration=14.039430305 podStartE2EDuration="21.413866198s" totalImagesPullingTime="7.374435893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:25.393635582 +0000 UTC m=+44.867736613" watchObservedRunningTime="2026-07-20 09:39:25.413866198 +0000 UTC m=+44.887967223" Jul 20 09:39:26.325662 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.325621 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 09:39:26.326140 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.326122 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/0.log" Jul 20 09:39:26.326193 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.326163 2577 generic.go:356] "Generic (PLEG): container finished" podID="4454b868-0082-422b-98d7-9973c0fc725a" containerID="3ab67e2af0f4deae0fe23966a49a04716e5921bc0b233b5a66dc22452b34b704" exitCode=255 Jul 20 09:39:26.326276 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.326250 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" event={"ID":"4454b868-0082-422b-98d7-9973c0fc725a","Type":"ContainerDied","Data":"3ab67e2af0f4deae0fe23966a49a04716e5921bc0b233b5a66dc22452b34b704"} Jul 20 09:39:26.326342 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.326307 2577 scope.go:117] "RemoveContainer" containerID="d65f8c9e45d9f572dc94ad8c882e586fc42ca2d49149d4cb1bbf8582495f109f" Jul 20 09:39:26.326980 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.326960 2577 scope.go:117] "RemoveContainer" containerID="3ab67e2af0f4deae0fe23966a49a04716e5921bc0b233b5a66dc22452b34b704" Jul 20 09:39:26.327139 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:26.327116 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-d9hzk_openshift-console-operator(4454b868-0082-422b-98d7-9973c0fc725a)\"" pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" podUID="4454b868-0082-422b-98d7-9973c0fc725a" Jul 20 09:39:26.431214 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.431169 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vbbxd"] Jul 20 09:39:26.459485 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.459457 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vbbxd"] Jul 20 09:39:26.459650 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.459583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:26.462752 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.462134 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 09:39:26.462752 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.462662 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vz98l\"" Jul 20 09:39:26.462752 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.462697 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:26.463052 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.462886 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 09:39:26.470416 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.470392 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-s7s59"] Jul 20 09:39:26.476673 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.476635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:26.476815 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.476719 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:26.476889 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.476863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqzlm\" (UniqueName: \"kubernetes.io/projected/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-kube-api-access-cqzlm\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:26.476945 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.476929 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-crio-socket\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:26.476989 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.476974 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-data-volume\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:26.485734 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.485700 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-s7s59"] Jul 20 09:39:26.485959 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.485878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-s7s59" Jul 20 09:39:26.488677 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.488563 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 20 09:39:26.488677 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.488582 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 20 09:39:26.488677 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.488569 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5znxb\"" Jul 20 09:39:26.537682 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.537641 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:26.578145 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.578043 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:26.578145 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.578090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9d9r\" (UniqueName: \"kubernetes.io/projected/ec2fb240-0271-486e-8f2b-145963a692ce-kube-api-access-t9d9r\") pod \"migrator-7cc9c7ffd7-s7s59\" (UID: \"ec2fb240-0271-486e-8f2b-145963a692ce\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-s7s59" Jul 20 09:39:26.578145 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.578134 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:26.578409 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:26.578172 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:39:26.578409 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.578191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqzlm\" (UniqueName: \"kubernetes.io/projected/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-kube-api-access-cqzlm\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:26.578409 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:26.578241 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-kube-rbac-proxy-cm podName:9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad nodeName:}" failed. No retries permitted until 2026-07-20 09:39:27.078222902 +0000 UTC m=+46.552323912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vbbxd" (UID: "9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad") : configmap "kube-rbac-proxy" not found Jul 20 09:39:26.578409 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.578271 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-crio-socket\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:26.578409 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:26.578300 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:39:26.578409 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.578318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-data-volume\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:26.578409 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:26.578369 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls podName:9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad nodeName:}" failed. No retries permitted until 2026-07-20 09:39:27.078351757 +0000 UTC m=+46.552452785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vbbxd" (UID: "9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad") : secret "insights-runtime-extractor-tls" not found Jul 20 09:39:26.578645 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.578481 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-crio-socket\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:26.578680 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.578652 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-data-volume\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:26.588022 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.587984 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqzlm\" (UniqueName: \"kubernetes.io/projected/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-kube-api-access-cqzlm\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:26.624481 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.624437 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:26.679108 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.679061 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9d9r\" (UniqueName: \"kubernetes.io/projected/ec2fb240-0271-486e-8f2b-145963a692ce-kube-api-access-t9d9r\") pod \"migrator-7cc9c7ffd7-s7s59\" (UID: \"ec2fb240-0271-486e-8f2b-145963a692ce\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-s7s59" Jul 20 09:39:26.690470 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.690433 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9d9r\" (UniqueName: \"kubernetes.io/projected/ec2fb240-0271-486e-8f2b-145963a692ce-kube-api-access-t9d9r\") pod \"migrator-7cc9c7ffd7-s7s59\" (UID: \"ec2fb240-0271-486e-8f2b-145963a692ce\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-s7s59" Jul 20 09:39:26.801326 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.801286 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-s7s59" Jul 20 09:39:26.960673 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.960650 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-s7s59"] Jul 20 09:39:26.963082 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:39:26.963050 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec2fb240_0271_486e_8f2b_145963a692ce.slice/crio-8fcd526dd294fc457844e15117357af68d8417c75738338adb6b05fa86a86ca8 WatchSource:0}: Error finding container 8fcd526dd294fc457844e15117357af68d8417c75738338adb6b05fa86a86ca8: Status 404 returned error can't find the container with id 8fcd526dd294fc457844e15117357af68d8417c75738338adb6b05fa86a86ca8 Jul 20 09:39:26.998205 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:26.998168 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:27.061326 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:27.061289 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:27.082221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:27.082123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:27.082360 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:27.082285 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:39:27.082360 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:27.082337 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:39:27.082360 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:27.082354 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls podName:9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad nodeName:}" failed. No retries permitted until 2026-07-20 09:39:28.082335335 +0000 UTC m=+47.556436365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vbbxd" (UID: "9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad") : secret "insights-runtime-extractor-tls" not found Jul 20 09:39:27.082360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:27.082290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:27.082518 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:27.082404 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-kube-rbac-proxy-cm podName:9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad nodeName:}" failed. No retries permitted until 2026-07-20 09:39:28.082388186 +0000 UTC m=+47.556489197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vbbxd" (UID: "9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad") : configmap "kube-rbac-proxy" not found Jul 20 09:39:27.308970 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:27.308936 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:27.309126 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:27.308989 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:27.332103 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:27.332070 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 09:39:27.332617 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:27.332483 2577 scope.go:117] "RemoveContainer" containerID="3ab67e2af0f4deae0fe23966a49a04716e5921bc0b233b5a66dc22452b34b704" Jul 20 09:39:27.332703 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:27.332680 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-d9hzk_openshift-console-operator(4454b868-0082-422b-98d7-9973c0fc725a)\"" pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" podUID="4454b868-0082-422b-98d7-9973c0fc725a" Jul 20 09:39:27.333717 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:27.333691 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-s7s59" event={"ID":"ec2fb240-0271-486e-8f2b-145963a692ce","Type":"ContainerStarted","Data":"8fcd526dd294fc457844e15117357af68d8417c75738338adb6b05fa86a86ca8"} Jul 20 09:39:27.427081 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:27.427044 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:27.479185 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:27.479159 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ctds5_cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed/dns-node-resolver/0.log" Jul 20 09:39:27.491576 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:27.491544 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:27.595707 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:27.595623 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:27.693875 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:27.693821 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:27.795564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:27.795531 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:28.092028 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:28.091988 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:28.092218 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:28.092095 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:39:28.092218 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:28.092134 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:28.092218 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:28.092166 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-kube-rbac-proxy-cm podName:9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad nodeName:}" failed. No retries permitted until 2026-07-20 09:39:30.092146875 +0000 UTC m=+49.566247902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vbbxd" (UID: "9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad") : configmap "kube-rbac-proxy" not found Jul 20 09:39:28.092380 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:28.092225 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:39:28.092380 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:28.092282 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls podName:9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad nodeName:}" failed. No retries permitted until 2026-07-20 09:39:30.092263431 +0000 UTC m=+49.566364451 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vbbxd" (UID: "9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad") : secret "insights-runtime-extractor-tls" not found Jul 20 09:39:28.337558 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:28.337529 2577 scope.go:117] "RemoveContainer" containerID="3ab67e2af0f4deae0fe23966a49a04716e5921bc0b233b5a66dc22452b34b704" Jul 20 09:39:28.337925 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:28.337701 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-d9hzk_openshift-console-operator(4454b868-0082-422b-98d7-9973c0fc725a)\"" pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" podUID="4454b868-0082-422b-98d7-9973c0fc725a" Jul 20 09:39:28.878557 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:28.878537 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nsxxs_208beea5-1d93-485f-9171-6e37de3aa513/node-ca/0.log" Jul 20 09:39:28.978394 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:28.978304 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:29.034154 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:29.034118 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:29.281204 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:29.281120 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-72mbq_a3bb3b46-397c-4531-b7eb-9c8980f07224/serve-healthcheck-canary/0.log" Jul 20 09:39:29.333897 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:29.333864 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:29.345911 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:29.345877 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-s7s59" event={"ID":"ec2fb240-0271-486e-8f2b-145963a692ce","Type":"ContainerStarted","Data":"e21cff23c87217eb6b66b9b4289989e1ef8bbb9580950bf2eda464528790123b"} Jul 20 09:39:29.346280 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:29.345956 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-s7s59" event={"ID":"ec2fb240-0271-486e-8f2b-145963a692ce","Type":"ContainerStarted","Data":"2dcaae532def44ac3ce51f0df0d218674caedc588f94e65c7f07b9d3c4ba1183"} Jul 20 09:39:29.361545 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:29.361486 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-s7s59" podStartSLOduration=1.640347971 podStartE2EDuration="3.361470419s" totalImagesPullingTime="1.721122448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:29.360019062 +0000 UTC m=+48.834120097" watchObservedRunningTime="2026-07-20 09:39:29.361470419 +0000 UTC m=+48.835571450" Jul 20 09:39:29.399467 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:29.399431 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:29.493204 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:29.493155 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:29.999713 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:29.999678 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:30.111569 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:30.111533 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:30.111752 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:30.111583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:30.111752 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:30.111684 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:39:30.111831 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:30.111779 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls podName:9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad nodeName:}" failed. No retries permitted until 2026-07-20 09:39:34.111757236 +0000 UTC m=+53.585858260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vbbxd" (UID: "9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad") : secret "insights-runtime-extractor-tls" not found Jul 20 09:39:30.112235 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:30.112217 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:30.214079 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:30.214043 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" limit=1024 Jul 20 09:39:32.836648 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:32.836606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7ctq2\" (UID: \"23f8474e-2d4a-4a50-b981-d506c0607319\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:32.837109 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:32.836715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:32.837109 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:32.836761 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 09:39:32.837109 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:32.836880 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 09:39:32.837109 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:32.836900 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59db674c8d-5vqfz: secret "image-registry-tls" not found Jul 20 09:39:32.837109 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:32.836893 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls podName:23f8474e-2d4a-4a50-b981-d506c0607319 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:48.836874444 +0000 UTC m=+68.310975455 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7ctq2" (UID: "23f8474e-2d4a-4a50-b981-d506c0607319") : secret "cluster-monitoring-operator-tls" not found Jul 20 09:39:32.837109 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:32.836953 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls podName:5a2efae7-379c-4a23-a6eb-18488f533fca nodeName:}" failed. No retries permitted until 2026-07-20 09:39:48.836938537 +0000 UTC m=+68.311039549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls") pod "image-registry-59db674c8d-5vqfz" (UID: "5a2efae7-379c-4a23-a6eb-18488f533fca") : secret "image-registry-tls" not found Jul 20 09:39:32.938000 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:32.937964 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:32.938200 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:32.938024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b6qdh\" (UID: \"e5f6b94d-3f8d-4e70-8517-dca13aed6509\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" Jul 20 09:39:32.938200 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:32.938137 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:39:32.938323 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:32.938215 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls podName:3c55b1c9-2e18-45dc-8886-f0b24f629991 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:48.938195498 +0000 UTC m=+68.412296521 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls") pod "dns-default-6587d" (UID: "3c55b1c9-2e18-45dc-8886-f0b24f629991") : secret "dns-default-metrics-tls" not found Jul 20 09:39:32.938323 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:32.938149 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 09:39:32.938323 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:32.938281 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls podName:e5f6b94d-3f8d-4e70-8517-dca13aed6509 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:48.938269089 +0000 UTC m=+68.412370098 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-b6qdh" (UID: "e5f6b94d-3f8d-4e70-8517-dca13aed6509") : secret "samples-operator-tls" not found Jul 20 09:39:33.038827 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:33.038785 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:33.038993 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:33.038904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:33.038993 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:33.038913 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 09:39:33.038993 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:33.038972 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs podName:b6832d68-310b-4ceb-aed2-ed26b866970b nodeName:}" failed. No retries permitted until 2026-07-20 09:39:49.038956088 +0000 UTC m=+68.513057114 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs") pod "router-default-7548f77d8d-9v8zw" (UID: "b6832d68-310b-4ceb-aed2-ed26b866970b") : secret "router-metrics-certs-default" not found Jul 20 09:39:33.039172 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:33.038998 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4tp8b\" (UID: \"647a9d32-b9cd-44d3-b8ae-727d42d6b2a7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" Jul 20 09:39:33.039172 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:33.039031 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle podName:b6832d68-310b-4ceb-aed2-ed26b866970b nodeName:}" failed. No retries permitted until 2026-07-20 09:39:49.039016657 +0000 UTC m=+68.513117666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle") pod "router-default-7548f77d8d-9v8zw" (UID: "b6832d68-310b-4ceb-aed2-ed26b866970b") : configmap references non-existent config key: service-ca.crt Jul 20 09:39:33.039172 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:33.039066 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 09:39:33.039172 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:33.039096 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert podName:647a9d32-b9cd-44d3-b8ae-727d42d6b2a7 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:49.039086293 +0000 UTC m=+68.513187303 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4tp8b" (UID: "647a9d32-b9cd-44d3-b8ae-727d42d6b2a7") : secret "networking-console-plugin-cert" not found Jul 20 09:39:34.149767 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:34.149726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:34.150197 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:34.149897 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:39:34.150197 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:39:34.149966 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls podName:9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad nodeName:}" failed. No retries permitted until 2026-07-20 09:39:42.149948962 +0000 UTC m=+61.624049970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vbbxd" (UID: "9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad") : secret "insights-runtime-extractor-tls" not found Jul 20 09:39:41.020520 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:41.020492 2577 scope.go:117] "RemoveContainer" containerID="3ab67e2af0f4deae0fe23966a49a04716e5921bc0b233b5a66dc22452b34b704" Jul 20 09:39:41.384394 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:41.384363 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 09:39:41.384570 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:41.384436 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" event={"ID":"4454b868-0082-422b-98d7-9973c0fc725a","Type":"ContainerStarted","Data":"97de65b05175388d38af19942681b95394fc572281ab1fab9ae468ef24c1bd5d"} Jul 20 09:39:41.384739 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:41.384715 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:41.405338 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:41.405278 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" podStartSLOduration=30.030238594 podStartE2EDuration="37.405257408s" totalImagesPullingTime="7.375018814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:41.403626065 +0000 UTC m=+60.877727096" watchObservedRunningTime="2026-07-20 09:39:41.405257408 +0000 UTC m=+60.879358443" Jul 20 09:39:41.614232 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:41.614199 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-d9hzk" Jul 20 09:39:42.220122 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:42.220078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:42.222532 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:42.222496 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbbxd\" (UID: \"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad\") " pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:42.375646 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:42.375615 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vz98l\"" Jul 20 09:39:42.381506 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:42.381490 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vbbxd" Jul 20 09:39:42.510420 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:42.510395 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vbbxd"] Jul 20 09:39:42.512769 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:39:42.512739 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e75a4f6_c13c_4b17_944e_a2a4eb60d7ad.slice/crio-97d2cf9c92716c352b641dc7d33d7c0d2ad65332917ac9e2918b7900b871067c WatchSource:0}: Error finding container 97d2cf9c92716c352b641dc7d33d7c0d2ad65332917ac9e2918b7900b871067c: Status 404 returned error can't find the container with id 97d2cf9c92716c352b641dc7d33d7c0d2ad65332917ac9e2918b7900b871067c Jul 20 09:39:43.237460 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:43.237426 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bvnv" Jul 20 09:39:43.392778 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:43.392735 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbbxd" event={"ID":"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad","Type":"ContainerStarted","Data":"97d2cf9c92716c352b641dc7d33d7c0d2ad65332917ac9e2918b7900b871067c"} Jul 20 09:39:46.662595 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:46.662560 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs\") pod \"network-metrics-daemon-4fbtw\" (UID: \"2068181e-6e30-401a-89fc-af0528dc5aea\") " pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:39:46.666309 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:46.666283 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 09:39:46.675386 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:46.675353 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2068181e-6e30-401a-89fc-af0528dc5aea-metrics-certs\") pod \"network-metrics-daemon-4fbtw\" (UID: \"2068181e-6e30-401a-89fc-af0528dc5aea\") " pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:39:46.763142 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:46.763108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:39:46.765798 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:46.765774 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 09:39:46.776517 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:46.776492 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b3179ca-a114-4b20-8411-0b3638da7500-original-pull-secret\") pod \"global-pull-secret-syncer-jqgr4\" (UID: \"6b3179ca-a114-4b20-8411-0b3638da7500\") " pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:39:46.831246 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:46.831208 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hssrx\"" Jul 20 09:39:46.838660 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:46.838627 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fbtw" Jul 20 09:39:46.838840 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:46.838778 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqgr4" Jul 20 09:39:46.864734 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:46.864698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5xbs\" (UniqueName: \"kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs\") pod \"network-check-target-84zkv\" (UID: \"206c83ae-f404-40f7-900f-ebd6f6d5e044\") " pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:39:46.867417 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:46.867394 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5xbs\" (UniqueName: \"kubernetes.io/projected/206c83ae-f404-40f7-900f-ebd6f6d5e044-kube-api-access-n5xbs\") pod \"network-check-target-84zkv\" (UID: \"206c83ae-f404-40f7-900f-ebd6f6d5e044\") " pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:39:47.137229 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:47.137188 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pgl5c\"" Jul 20 09:39:47.144472 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:47.144436 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:39:47.563601 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:47.563573 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jqgr4"] Jul 20 09:39:47.566996 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:39:47.566957 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b3179ca_a114_4b20_8411_0b3638da7500.slice/crio-5b21494da32d18fad870a9f3f06ee632ef79f1cd85d274d207f72499664a245d WatchSource:0}: Error finding container 5b21494da32d18fad870a9f3f06ee632ef79f1cd85d274d207f72499664a245d: Status 404 returned error can't find the container with id 5b21494da32d18fad870a9f3f06ee632ef79f1cd85d274d207f72499664a245d Jul 20 09:39:47.580354 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:47.580330 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4fbtw"] Jul 20 09:39:47.583523 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:39:47.583491 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2068181e_6e30_401a_89fc_af0528dc5aea.slice/crio-dd178344d8533d6a6d047619c7c9645a97b548745994fd54c2ce8ffdc605f09a WatchSource:0}: Error finding container dd178344d8533d6a6d047619c7c9645a97b548745994fd54c2ce8ffdc605f09a: Status 404 returned error can't find the container with id dd178344d8533d6a6d047619c7c9645a97b548745994fd54c2ce8ffdc605f09a Jul 20 09:39:47.595053 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:47.595033 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-84zkv"] Jul 20 09:39:47.597355 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:39:47.597328 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod206c83ae_f404_40f7_900f_ebd6f6d5e044.slice/crio-377b64313da5f1d1d41829f99c15aa0cd7958d51814ae0c4f2c21096aebd9265 WatchSource:0}: Error finding container 377b64313da5f1d1d41829f99c15aa0cd7958d51814ae0c4f2c21096aebd9265: Status 404 returned error can't find the container with id 377b64313da5f1d1d41829f99c15aa0cd7958d51814ae0c4f2c21096aebd9265 Jul 20 09:39:48.411946 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:48.411905 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-84zkv" event={"ID":"206c83ae-f404-40f7-900f-ebd6f6d5e044","Type":"ContainerStarted","Data":"8ce983e4267f219c8d196886a8c38fb210ecd44d5d0102e91c49675b635331c1"} Jul 20 09:39:48.412403 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:48.411964 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-84zkv" event={"ID":"206c83ae-f404-40f7-900f-ebd6f6d5e044","Type":"ContainerStarted","Data":"377b64313da5f1d1d41829f99c15aa0cd7958d51814ae0c4f2c21096aebd9265"} Jul 20 09:39:48.412403 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:48.412008 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:39:48.413191 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:48.413169 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4fbtw" event={"ID":"2068181e-6e30-401a-89fc-af0528dc5aea","Type":"ContainerStarted","Data":"dd178344d8533d6a6d047619c7c9645a97b548745994fd54c2ce8ffdc605f09a"} Jul 20 09:39:48.414219 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:48.414196 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jqgr4" event={"ID":"6b3179ca-a114-4b20-8411-0b3638da7500","Type":"ContainerStarted","Data":"5b21494da32d18fad870a9f3f06ee632ef79f1cd85d274d207f72499664a245d"} Jul 20 09:39:48.415496 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:48.415476 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbbxd" event={"ID":"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad","Type":"ContainerStarted","Data":"77ec522be8b508bf7245bc18bfa2ba47a52471cef3ce4dc550b9824dc06b0435"} Jul 20 09:39:48.428996 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:48.428956 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-84zkv" podStartSLOduration=67.428942713 podStartE2EDuration="1m7.428942713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:38:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:48.428335473 +0000 UTC m=+67.902436508" watchObservedRunningTime="2026-07-20 09:39:48.428942713 +0000 UTC m=+67.903043744" Jul 20 09:39:48.883488 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:48.883448 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:48.883675 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:48.883586 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7ctq2\" (UID: \"23f8474e-2d4a-4a50-b981-d506c0607319\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:48.887189 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:48.887142 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23f8474e-2d4a-4a50-b981-d506c0607319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7ctq2\" (UID: \"23f8474e-2d4a-4a50-b981-d506c0607319\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:48.887189 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:48.887145 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls\") pod \"image-registry-59db674c8d-5vqfz\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:48.984567 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:48.984527 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:48.984926 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:48.984603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b6qdh\" (UID: \"e5f6b94d-3f8d-4e70-8517-dca13aed6509\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" Jul 20 09:39:48.987739 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:48.987708 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5f6b94d-3f8d-4e70-8517-dca13aed6509-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b6qdh\" (UID: \"e5f6b94d-3f8d-4e70-8517-dca13aed6509\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" Jul 20 09:39:48.988612 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:48.988588 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c55b1c9-2e18-45dc-8886-f0b24f629991-metrics-tls\") pod \"dns-default-6587d\" (UID: \"3c55b1c9-2e18-45dc-8886-f0b24f629991\") " pod="openshift-dns/dns-default-6587d" Jul 20 09:39:49.052661 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.052531 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ppbr5\"" Jul 20 09:39:49.060164 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.060138 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:49.071834 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.071792 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9rrwk\"" Jul 20 09:39:49.081491 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.079747 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" Jul 20 09:39:49.085775 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.085712 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:49.085904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.085786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:49.085904 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.085834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4tp8b\" (UID: \"647a9d32-b9cd-44d3-b8ae-727d42d6b2a7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" Jul 20 09:39:49.086589 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.086561 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6832d68-310b-4ceb-aed2-ed26b866970b-service-ca-bundle\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:49.089262 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.089057 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/647a9d32-b9cd-44d3-b8ae-727d42d6b2a7-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4tp8b\" (UID: \"647a9d32-b9cd-44d3-b8ae-727d42d6b2a7\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" Jul 20 09:39:49.090316 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.090294 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6832d68-310b-4ceb-aed2-ed26b866970b-metrics-certs\") pod \"router-default-7548f77d8d-9v8zw\" (UID: \"b6832d68-310b-4ceb-aed2-ed26b866970b\") " pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:49.153714 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.152692 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dlgms\"" Jul 20 09:39:49.160268 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.160214 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" Jul 20 09:39:49.176989 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.176961 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6tr7c\"" Jul 20 09:39:49.185444 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.185147 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6587d" Jul 20 09:39:49.221710 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.221477 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zb7xs\"" Jul 20 09:39:49.230138 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.229828 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:49.272311 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.272271 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59db674c8d-5vqfz"] Jul 20 09:39:49.276066 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.276029 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2"] Jul 20 09:39:49.278927 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:39:49.278888 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a2efae7_379c_4a23_a6eb_18488f533fca.slice/crio-f7321130d085457878c97097976a0323c53101f57ec74a778dedb2970ad255cd WatchSource:0}: Error finding container f7321130d085457878c97097976a0323c53101f57ec74a778dedb2970ad255cd: Status 404 returned error can't find the container with id f7321130d085457878c97097976a0323c53101f57ec74a778dedb2970ad255cd Jul 20 09:39:49.282631 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:39:49.282605 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f8474e_2d4a_4a50_b981_d506c0607319.slice/crio-77af42cefd01f01ee326f8b443dfbd85d29224ba07ffd410a6901a8e776974cb WatchSource:0}: Error finding container 77af42cefd01f01ee326f8b443dfbd85d29224ba07ffd410a6901a8e776974cb: Status 404 returned error can't find the container with id 77af42cefd01f01ee326f8b443dfbd85d29224ba07ffd410a6901a8e776974cb Jul 20 09:39:49.299705 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.299495 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7qc5b\"" Jul 20 09:39:49.307315 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.307109 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" Jul 20 09:39:49.413266 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.407906 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh"] Jul 20 09:39:49.430819 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.430710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" event={"ID":"23f8474e-2d4a-4a50-b981-d506c0607319","Type":"ContainerStarted","Data":"77af42cefd01f01ee326f8b443dfbd85d29224ba07ffd410a6901a8e776974cb"} Jul 20 09:39:49.434647 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.433835 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4fbtw" event={"ID":"2068181e-6e30-401a-89fc-af0528dc5aea","Type":"ContainerStarted","Data":"6d369a1fa14cfac91303845043982f7b6a177ffa3eccf8932b11231fed41bba1"} Jul 20 09:39:49.434647 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.433917 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4fbtw" event={"ID":"2068181e-6e30-401a-89fc-af0528dc5aea","Type":"ContainerStarted","Data":"e37fd8d4a8601c5bb149c19e5590275158d20dd554c9a39f76e2a53ed9fff0d8"} Jul 20 09:39:49.439044 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.438917 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" event={"ID":"5a2efae7-379c-4a23-a6eb-18488f533fca","Type":"ContainerStarted","Data":"f7321130d085457878c97097976a0323c53101f57ec74a778dedb2970ad255cd"} Jul 20 09:39:49.457874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.456352 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6587d"] Jul 20 09:39:49.460736 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.460061 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4fbtw" podStartSLOduration=67.207748838 podStartE2EDuration="1m8.460037369s" totalImagesPullingTime="1.252288531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:49.455942866 +0000 UTC m=+68.930043895" watchObservedRunningTime="2026-07-20 09:39:49.460037369 +0000 UTC m=+68.934138403" Jul 20 09:39:49.472241 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:39:49.472210 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c55b1c9_2e18_45dc_8886_f0b24f629991.slice/crio-7514931bbdb8f54ca85162995b60c52e6580c612c37d5b5e52fdff1647fe84fa WatchSource:0}: Error finding container 7514931bbdb8f54ca85162995b60c52e6580c612c37d5b5e52fdff1647fe84fa: Status 404 returned error can't find the container with id 7514931bbdb8f54ca85162995b60c52e6580c612c37d5b5e52fdff1647fe84fa Jul 20 09:39:49.505542 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.505414 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7548f77d8d-9v8zw"] Jul 20 09:39:49.509937 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:39:49.509710 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6832d68_310b_4ceb_aed2_ed26b866970b.slice/crio-e7e5445ae7cafe7481a5f5a8d30ba5ce1b68f94a515fef148b18a2cb492d2d94 WatchSource:0}: Error finding container e7e5445ae7cafe7481a5f5a8d30ba5ce1b68f94a515fef148b18a2cb492d2d94: Status 404 returned error can't find the container with id e7e5445ae7cafe7481a5f5a8d30ba5ce1b68f94a515fef148b18a2cb492d2d94 Jul 20 09:39:49.551549 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:49.551476 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b"] Jul 20 09:39:49.557145 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:39:49.557112 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647a9d32_b9cd_44d3_b8ae_727d42d6b2a7.slice/crio-f53d9b0ba92b79b10d8eb43ee68353bdf71684a14679dce944a0cf864103f75d WatchSource:0}: Error finding container f53d9b0ba92b79b10d8eb43ee68353bdf71684a14679dce944a0cf864103f75d: Status 404 returned error can't find the container with id f53d9b0ba92b79b10d8eb43ee68353bdf71684a14679dce944a0cf864103f75d Jul 20 09:39:50.453816 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:50.453765 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6587d" event={"ID":"3c55b1c9-2e18-45dc-8886-f0b24f629991","Type":"ContainerStarted","Data":"7514931bbdb8f54ca85162995b60c52e6580c612c37d5b5e52fdff1647fe84fa"} Jul 20 09:39:50.459107 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:50.458492 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7548f77d8d-9v8zw" event={"ID":"b6832d68-310b-4ceb-aed2-ed26b866970b","Type":"ContainerStarted","Data":"a4fe6fcdcf8be908bc03e59a0e3e31a4f2bc02ef50bddc86f82bab7f18a74ebf"} Jul 20 09:39:50.459107 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:50.458542 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7548f77d8d-9v8zw" event={"ID":"b6832d68-310b-4ceb-aed2-ed26b866970b","Type":"ContainerStarted","Data":"e7e5445ae7cafe7481a5f5a8d30ba5ce1b68f94a515fef148b18a2cb492d2d94"} Jul 20 09:39:50.462952 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:50.462439 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" event={"ID":"5a2efae7-379c-4a23-a6eb-18488f533fca","Type":"ContainerStarted","Data":"0a51cee8703f2a43f14253a51b603370e83273ee35e0d7c61715adea2edb010c"} Jul 20 09:39:50.462952 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:50.462625 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:39:50.466625 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:50.466557 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" event={"ID":"e5f6b94d-3f8d-4e70-8517-dca13aed6509","Type":"ContainerStarted","Data":"51601a1a18a5d5db4be7c72f2c73375729ed2e00885ecf4723bdb110cc001ae8"} Jul 20 09:39:50.472603 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:50.472530 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" event={"ID":"647a9d32-b9cd-44d3-b8ae-727d42d6b2a7","Type":"ContainerStarted","Data":"f53d9b0ba92b79b10d8eb43ee68353bdf71684a14679dce944a0cf864103f75d"} Jul 20 09:39:50.489998 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:50.489426 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7548f77d8d-9v8zw" podStartSLOduration=46.489405465 podStartE2EDuration="46.489405465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:50.486313096 +0000 UTC m=+69.960414142" watchObservedRunningTime="2026-07-20 09:39:50.489405465 +0000 UTC m=+69.963506497" Jul 20 09:39:50.509403 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:50.508363 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" podStartSLOduration=68.508349811 podStartE2EDuration="1m8.508349811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:38:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:50.507381469 +0000 UTC m=+69.981482504" watchObservedRunningTime="2026-07-20 09:39:50.508349811 +0000 UTC m=+69.982450845" Jul 20 09:39:51.231219 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:51.231183 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:51.234088 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:51.234062 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:51.478375 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:51.478302 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:51.479632 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:51.479607 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7548f77d8d-9v8zw" Jul 20 09:39:53.147508 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.147470 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-nwpjn"] Jul 20 09:39:53.151299 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.150820 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79c4cf668-6d9rs"] Jul 20 09:39:53.151885 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.151862 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-nwpjn" Jul 20 09:39:53.153680 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.153658 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.154701 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.154677 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 20 09:39:53.154701 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.154690 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-b6rcl\"" Jul 20 09:39:53.154887 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.154694 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 20 09:39:53.156948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.156927 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 20 09:39:53.157045 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.156999 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 20 09:39:53.157045 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.157016 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 20 09:39:53.157159 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.157045 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 20 09:39:53.157251 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.157216 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 20 09:39:53.157333 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.157295 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bwk56\"" Jul 20 09:39:53.167814 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.167787 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-nwpjn"] Jul 20 09:39:53.192776 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.192744 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79c4cf668-6d9rs"] Jul 20 09:39:53.222621 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.222587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f274aa4-3810-47e3-b80b-08369b318d50-console-serving-cert\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.222799 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.222658 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-service-ca\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.222799 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.222693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr5qv\" (UniqueName: \"kubernetes.io/projected/2e089a0e-7a4d-4dc9-8d02-15e85cec5b62-kube-api-access-nr5qv\") pod \"downloads-5bc67dcd46-nwpjn\" (UID: \"2e089a0e-7a4d-4dc9-8d02-15e85cec5b62\") " pod="openshift-console/downloads-5bc67dcd46-nwpjn" Jul 20 09:39:53.222799 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.222735 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f274aa4-3810-47e3-b80b-08369b318d50-console-oauth-config\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.222799 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.222777 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-console-config\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.223057 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.222809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-oauth-serving-cert\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.223057 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.222898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhm95\" (UniqueName: \"kubernetes.io/projected/7f274aa4-3810-47e3-b80b-08369b318d50-kube-api-access-nhm95\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.324280 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.324248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-service-ca\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.324474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.324292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr5qv\" (UniqueName: \"kubernetes.io/projected/2e089a0e-7a4d-4dc9-8d02-15e85cec5b62-kube-api-access-nr5qv\") pod \"downloads-5bc67dcd46-nwpjn\" (UID: \"2e089a0e-7a4d-4dc9-8d02-15e85cec5b62\") " pod="openshift-console/downloads-5bc67dcd46-nwpjn" Jul 20 09:39:53.324474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.324335 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f274aa4-3810-47e3-b80b-08369b318d50-console-oauth-config\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.324474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.324365 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-console-config\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.324474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.324391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-oauth-serving-cert\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.324474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.324419 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhm95\" (UniqueName: \"kubernetes.io/projected/7f274aa4-3810-47e3-b80b-08369b318d50-kube-api-access-nhm95\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.324474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.324474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f274aa4-3810-47e3-b80b-08369b318d50-console-serving-cert\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.325162 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.325105 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-service-ca\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.325304 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.325171 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-console-config\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.325448 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.325419 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-oauth-serving-cert\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.327294 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.327269 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f274aa4-3810-47e3-b80b-08369b318d50-console-serving-cert\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.327405 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.327359 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f274aa4-3810-47e3-b80b-08369b318d50-console-oauth-config\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.338804 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.338774 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhm95\" (UniqueName: \"kubernetes.io/projected/7f274aa4-3810-47e3-b80b-08369b318d50-kube-api-access-nhm95\") pod \"console-79c4cf668-6d9rs\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:53.339087 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.339070 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr5qv\" (UniqueName: \"kubernetes.io/projected/2e089a0e-7a4d-4dc9-8d02-15e85cec5b62-kube-api-access-nr5qv\") pod \"downloads-5bc67dcd46-nwpjn\" (UID: \"2e089a0e-7a4d-4dc9-8d02-15e85cec5b62\") " pod="openshift-console/downloads-5bc67dcd46-nwpjn" Jul 20 09:39:53.466163 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.466078 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-nwpjn" Jul 20 09:39:53.472816 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:53.472795 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:39:57.320553 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:57.320522 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79c4cf668-6d9rs"] Jul 20 09:39:57.336149 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:57.336116 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-nwpjn"] Jul 20 09:39:57.354524 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:39:57.354488 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f274aa4_3810_47e3_b80b_08369b318d50.slice/crio-0adbfb38e1b93d224369e2c5f7b9991c30354b3e0e3717ab000a1b1f4c7afb86 WatchSource:0}: Error finding container 0adbfb38e1b93d224369e2c5f7b9991c30354b3e0e3717ab000a1b1f4c7afb86: Status 404 returned error can't find the container with id 0adbfb38e1b93d224369e2c5f7b9991c30354b3e0e3717ab000a1b1f4c7afb86 Jul 20 09:39:57.354764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:39:57.354741 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e089a0e_7a4d_4dc9_8d02_15e85cec5b62.slice/crio-56f9e4b8c7a307a16e54d734fa866e38ee652457ddb3aee4861b17e2f51f0c99 WatchSource:0}: Error finding container 56f9e4b8c7a307a16e54d734fa866e38ee652457ddb3aee4861b17e2f51f0c99: Status 404 returned error can't find the container with id 56f9e4b8c7a307a16e54d734fa866e38ee652457ddb3aee4861b17e2f51f0c99 Jul 20 09:39:57.501026 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:57.500990 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" event={"ID":"e5f6b94d-3f8d-4e70-8517-dca13aed6509","Type":"ContainerStarted","Data":"3db0210e1dd71bc3c63709a65161d49a5a4c03519a73006b3b2e754de673e05e"} Jul 20 09:39:57.502377 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:57.502344 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-nwpjn" event={"ID":"2e089a0e-7a4d-4dc9-8d02-15e85cec5b62","Type":"ContainerStarted","Data":"56f9e4b8c7a307a16e54d734fa866e38ee652457ddb3aee4861b17e2f51f0c99"} Jul 20 09:39:57.504202 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:57.504177 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" event={"ID":"647a9d32-b9cd-44d3-b8ae-727d42d6b2a7","Type":"ContainerStarted","Data":"553a8d5dd3a3673ddfab50745bfbf7963e8714648b082375cc5220ff48ca4f35"} Jul 20 09:39:57.505672 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:57.505644 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" event={"ID":"23f8474e-2d4a-4a50-b981-d506c0607319","Type":"ContainerStarted","Data":"ecb3b4840dcf430ec238d1f90e9ccc28f6f97ed3f267db2fd2ff037b5f4957c0"} Jul 20 09:39:57.507409 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:57.507378 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c4cf668-6d9rs" event={"ID":"7f274aa4-3810-47e3-b80b-08369b318d50","Type":"ContainerStarted","Data":"0adbfb38e1b93d224369e2c5f7b9991c30354b3e0e3717ab000a1b1f4c7afb86"} Jul 20 09:39:57.550012 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:57.548688 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7ctq2" podStartSLOduration=45.643435315 podStartE2EDuration="53.548663943s" totalImagesPullingTime="7.905228628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:57.546479431 +0000 UTC m=+77.020580463" watchObservedRunningTime="2026-07-20 09:39:57.548663943 +0000 UTC m=+77.022764974" Jul 20 09:39:57.920885 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:57.920757 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4tp8b" podStartSLOduration=35.289096616 podStartE2EDuration="42.9207341s" totalImagesPullingTime="7.631637484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:57.614075614 +0000 UTC m=+77.088176645" watchObservedRunningTime="2026-07-20 09:39:57.9207341 +0000 UTC m=+77.394835109" Jul 20 09:39:57.921311 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:57.921288 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7sj99"] Jul 20 09:39:57.943936 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:57.943879 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7sj99"] Jul 20 09:39:57.944105 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:57.943962 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7sj99" Jul 20 09:39:57.947980 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:57.947557 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bmb7h\"" Jul 20 09:39:57.947980 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:57.947796 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 20 09:39:58.064816 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:58.064738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/af578b8b-b8b2-49fe-8703-e7ecd6b81d7a-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-7sj99\" (UID: \"af578b8b-b8b2-49fe-8703-e7ecd6b81d7a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7sj99" Jul 20 09:39:58.165659 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:58.165594 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/af578b8b-b8b2-49fe-8703-e7ecd6b81d7a-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-7sj99\" (UID: \"af578b8b-b8b2-49fe-8703-e7ecd6b81d7a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7sj99" Jul 20 09:39:58.169266 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:58.169188 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/af578b8b-b8b2-49fe-8703-e7ecd6b81d7a-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-7sj99\" (UID: \"af578b8b-b8b2-49fe-8703-e7ecd6b81d7a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7sj99" Jul 20 09:39:58.258835 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:58.258533 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7sj99" Jul 20 09:39:58.479604 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:58.479569 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7sj99"] Jul 20 09:39:58.488471 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:39:58.488415 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf578b8b_b8b2_49fe_8703_e7ecd6b81d7a.slice/crio-164798c87bb278d8e19551a1dc59adcc13f2b54fd423cd9fa2ddd58433a8ab26 WatchSource:0}: Error finding container 164798c87bb278d8e19551a1dc59adcc13f2b54fd423cd9fa2ddd58433a8ab26: Status 404 returned error can't find the container with id 164798c87bb278d8e19551a1dc59adcc13f2b54fd423cd9fa2ddd58433a8ab26 Jul 20 09:39:58.516445 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:58.516330 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbbxd" event={"ID":"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad","Type":"ContainerStarted","Data":"bdd74f0247f9cba534a78f7d9c392db3dab6444aea18ca8fb422c88a8510eff1"} Jul 20 09:39:58.518615 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:58.518568 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" event={"ID":"e5f6b94d-3f8d-4e70-8517-dca13aed6509","Type":"ContainerStarted","Data":"2e90dc00b69d0defd87b041d1ee421f522f4471e29d036fb050e2af272fa835d"} Jul 20 09:39:58.521077 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:58.520999 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7sj99" event={"ID":"af578b8b-b8b2-49fe-8703-e7ecd6b81d7a","Type":"ContainerStarted","Data":"164798c87bb278d8e19551a1dc59adcc13f2b54fd423cd9fa2ddd58433a8ab26"} Jul 20 09:39:58.524800 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:58.524252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6587d" event={"ID":"3c55b1c9-2e18-45dc-8886-f0b24f629991","Type":"ContainerStarted","Data":"aa16fdcd0987db423ccf4b64f14d883e860f3c72de9fbf3373190aed366d5321"} Jul 20 09:39:58.524800 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:58.524298 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6587d" event={"ID":"3c55b1c9-2e18-45dc-8886-f0b24f629991","Type":"ContainerStarted","Data":"3984528d558eed5f371a26ea3ba1b48ac73478cab4a6a94789dd425b2cf6dee6"} Jul 20 09:39:58.524800 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:58.524510 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6587d" Jul 20 09:39:58.527932 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:58.527542 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jqgr4" event={"ID":"6b3179ca-a114-4b20-8411-0b3638da7500","Type":"ContainerStarted","Data":"9452ca8dce6b0ee38943230728efee6acd82115ee0dd2f896a2132a105724069"} Jul 20 09:39:58.539628 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:58.539565 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b6qdh" podStartSLOduration=46.849807826 podStartE2EDuration="54.539548751s" totalImagesPullingTime="7.689740925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:58.538436047 +0000 UTC m=+78.012537080" watchObservedRunningTime="2026-07-20 09:39:58.539548751 +0000 UTC m=+78.013649785" Jul 20 09:39:58.556638 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:58.556584 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jqgr4" podStartSLOduration=67.93413621 podStartE2EDuration="1m17.556566908s" totalImagesPullingTime="9.622430698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:58.554992795 +0000 UTC m=+78.029093826" watchObservedRunningTime="2026-07-20 09:39:58.556566908 +0000 UTC m=+78.030667944" Jul 20 09:39:58.579528 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:39:58.579260 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6587d" podStartSLOduration=34.863457457 podStartE2EDuration="42.579241927s" totalImagesPullingTime="7.71578447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:58.578072415 +0000 UTC m=+78.052173447" watchObservedRunningTime="2026-07-20 09:39:58.579241927 +0000 UTC m=+78.053342960" Jul 20 09:40:03.554157 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:03.553973 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbbxd" event={"ID":"9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad","Type":"ContainerStarted","Data":"e8625deaed49f086524bdfc680f9eb4d7f466f1770f80c86c63e123af9340598"} Jul 20 09:40:03.555928 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:03.555882 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7sj99" event={"ID":"af578b8b-b8b2-49fe-8703-e7ecd6b81d7a","Type":"ContainerStarted","Data":"1c283c80119ec0220d0b5e1d1f4c76b481d18cf1ee514ddbfdbbf7d979ae493d"} Jul 20 09:40:03.556109 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:03.556087 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7sj99" Jul 20 09:40:03.558159 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:03.558131 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c4cf668-6d9rs" event={"ID":"7f274aa4-3810-47e3-b80b-08369b318d50","Type":"ContainerStarted","Data":"757a02f6faee9c84c9ae2a3141f691c1d233529b32d411b39d2edcd04e985201"} Jul 20 09:40:03.561481 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:03.561459 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7sj99" Jul 20 09:40:03.574642 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:03.574596 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vbbxd" podStartSLOduration=17.08735423 podStartE2EDuration="37.574582994s" totalImagesPullingTime="20.487228764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:39:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:03.573167067 +0000 UTC m=+83.047268106" watchObservedRunningTime="2026-07-20 09:40:03.574582994 +0000 UTC m=+83.048684024" Jul 20 09:40:03.595283 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:03.595234 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79c4cf668-6d9rs" podStartSLOduration=4.682587267 podStartE2EDuration="10.595219943s" totalImagesPullingTime="5.912632676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:03.594431799 +0000 UTC m=+83.068532830" watchObservedRunningTime="2026-07-20 09:40:03.595219943 +0000 UTC m=+83.069320974" Jul 20 09:40:03.612639 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:03.612586 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7sj99" podStartSLOduration=1.8336183780000002 podStartE2EDuration="6.612569749s" totalImagesPullingTime="4.778951371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:03.611504204 +0000 UTC m=+83.085605236" watchObservedRunningTime="2026-07-20 09:40:03.612569749 +0000 UTC m=+83.086670781" Jul 20 09:40:08.535189 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:08.535152 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6587d" Jul 20 09:40:09.066644 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:09.066598 2577 patch_prober.go:28] interesting pod/image-registry-59db674c8d-5vqfz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 20 09:40:09.066819 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:09.066676 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" podUID="5a2efae7-379c-4a23-a6eb-18488f533fca" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 09:40:11.483330 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:11.483298 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:40:11.831339 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:11.831295 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79c4cf668-6d9rs"] Jul 20 09:40:12.444487 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.444445 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wdjhp"] Jul 20 09:40:12.603184 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.603146 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.606541 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.605788 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 09:40:12.606541 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.606085 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 09:40:12.606541 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.606388 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 09:40:12.607101 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.607080 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9vmvl\"" Jul 20 09:40:12.607501 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.607314 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 09:40:12.687566 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.687533 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8de9617a-4cff-431e-be2f-2e0446f562e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.687762 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.687590 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8de9617a-4cff-431e-be2f-2e0446f562e8-node-exporter-tls\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.687762 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.687626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8de9617a-4cff-431e-be2f-2e0446f562e8-node-exporter-wtmp\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.687762 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.687652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8de9617a-4cff-431e-be2f-2e0446f562e8-sys\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.687762 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.687677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8de9617a-4cff-431e-be2f-2e0446f562e8-metrics-client-ca\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.687762 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.687739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8de9617a-4cff-431e-be2f-2e0446f562e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.688117 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.687790 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8de9617a-4cff-431e-be2f-2e0446f562e8-node-exporter-textfile\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.688117 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.687826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54tph\" (UniqueName: \"kubernetes.io/projected/8de9617a-4cff-431e-be2f-2e0446f562e8-kube-api-access-54tph\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.688117 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.687902 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8de9617a-4cff-431e-be2f-2e0446f562e8-root\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.789086 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.788990 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8de9617a-4cff-431e-be2f-2e0446f562e8-node-exporter-textfile\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.789086 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.789059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54tph\" (UniqueName: \"kubernetes.io/projected/8de9617a-4cff-431e-be2f-2e0446f562e8-kube-api-access-54tph\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.789337 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.789093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8de9617a-4cff-431e-be2f-2e0446f562e8-root\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.789337 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.789118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8de9617a-4cff-431e-be2f-2e0446f562e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.789337 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.789156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8de9617a-4cff-431e-be2f-2e0446f562e8-node-exporter-tls\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.789337 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.789177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8de9617a-4cff-431e-be2f-2e0446f562e8-node-exporter-wtmp\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.789337 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.789215 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8de9617a-4cff-431e-be2f-2e0446f562e8-root\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.789337 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.789317 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8de9617a-4cff-431e-be2f-2e0446f562e8-node-exporter-wtmp\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.789648 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.789396 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8de9617a-4cff-431e-be2f-2e0446f562e8-node-exporter-textfile\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.789648 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.789418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8de9617a-4cff-431e-be2f-2e0446f562e8-sys\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.789648 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.789454 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8de9617a-4cff-431e-be2f-2e0446f562e8-sys\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.789648 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.789455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8de9617a-4cff-431e-be2f-2e0446f562e8-metrics-client-ca\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.789648 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.789509 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8de9617a-4cff-431e-be2f-2e0446f562e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.790164 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.790096 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8de9617a-4cff-431e-be2f-2e0446f562e8-metrics-client-ca\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.790280 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.790202 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8de9617a-4cff-431e-be2f-2e0446f562e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.791748 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.791724 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8de9617a-4cff-431e-be2f-2e0446f562e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.791907 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.791888 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8de9617a-4cff-431e-be2f-2e0446f562e8-node-exporter-tls\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.797693 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.797668 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54tph\" (UniqueName: \"kubernetes.io/projected/8de9617a-4cff-431e-be2f-2e0446f562e8-kube-api-access-54tph\") pod \"node-exporter-wdjhp\" (UID: \"8de9617a-4cff-431e-be2f-2e0446f562e8\") " pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:12.916226 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:12.916179 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wdjhp" Jul 20 09:40:13.473534 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:13.473496 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:40:14.564117 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:40:14.564083 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8de9617a_4cff_431e_be2f_2e0446f562e8.slice/crio-418d79b893dc64ee171e2c3d9e96129e4243324210316b54ded45d24d9dc268b WatchSource:0}: Error finding container 418d79b893dc64ee171e2c3d9e96129e4243324210316b54ded45d24d9dc268b: Status 404 returned error can't find the container with id 418d79b893dc64ee171e2c3d9e96129e4243324210316b54ded45d24d9dc268b Jul 20 09:40:14.619248 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:14.619175 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdjhp" event={"ID":"8de9617a-4cff-431e-be2f-2e0446f562e8","Type":"ContainerStarted","Data":"418d79b893dc64ee171e2c3d9e96129e4243324210316b54ded45d24d9dc268b"} Jul 20 09:40:15.359407 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:15.359367 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59db674c8d-5vqfz"] Jul 20 09:40:15.625895 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:15.625779 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-nwpjn" event={"ID":"2e089a0e-7a4d-4dc9-8d02-15e85cec5b62","Type":"ContainerStarted","Data":"4bd6d79f4190514edf2ce6605822bb58125c4f2ff3c6838d7c31aad0d7cf9ebe"} Jul 20 09:40:15.626377 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:15.625972 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-nwpjn" Jul 20 09:40:15.637474 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:15.637437 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-nwpjn" Jul 20 09:40:15.648578 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:15.648523 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-nwpjn" podStartSLOduration=5.061336802 podStartE2EDuration="22.648499006s" totalImagesPullingTime="17.587162204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:15.647296791 +0000 UTC m=+95.121397823" watchObservedRunningTime="2026-07-20 09:40:15.648499006 +0000 UTC m=+95.122600038" Jul 20 09:40:16.632784 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:16.632686 2577 generic.go:356] "Generic (PLEG): container finished" podID="8de9617a-4cff-431e-be2f-2e0446f562e8" containerID="d9fad059961f26e671cfc69f45445c5e1223d4813063fd78e74e18a5d533f340" exitCode=0 Jul 20 09:40:16.633267 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:16.632776 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdjhp" event={"ID":"8de9617a-4cff-431e-be2f-2e0446f562e8","Type":"ContainerDied","Data":"d9fad059961f26e671cfc69f45445c5e1223d4813063fd78e74e18a5d533f340"} Jul 20 09:40:17.645041 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:17.644997 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdjhp" event={"ID":"8de9617a-4cff-431e-be2f-2e0446f562e8","Type":"ContainerStarted","Data":"4cd852bcb024dab77553e883602e44b88f1839b7e10759975f453a14f4b9d140"} Jul 20 09:40:17.645534 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:17.645099 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdjhp" event={"ID":"8de9617a-4cff-431e-be2f-2e0446f562e8","Type":"ContainerStarted","Data":"3b142b8ca51566cf3a5966d6c82ad5da620194080bb2ad7833ea35643f5a892a"} Jul 20 09:40:17.667394 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:17.667335 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wdjhp" podStartSLOduration=4.048404142 podStartE2EDuration="5.667316902s" totalImagesPullingTime="1.510193312s" totalInitContainerRuntime="108.719448ms" isStatefulPod=true podCreationTimestamp="2026-07-20 09:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:17.665895135 +0000 UTC m=+97.139996168" watchObservedRunningTime="2026-07-20 09:40:17.667316902 +0000 UTC m=+97.141417933" Jul 20 09:40:19.442669 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:19.442633 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-84zkv" Jul 20 09:40:31.701416 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:31.701375 2577 generic.go:356] "Generic (PLEG): container finished" podID="21db448b-2c50-4d06-90ee-e18e8b089e99" containerID="097c7b246345248b86e66bcb01b5001650cacdbc63a7c3652441a1eabbbd4932" exitCode=0 Jul 20 09:40:31.701894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:31.701426 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" event={"ID":"21db448b-2c50-4d06-90ee-e18e8b089e99","Type":"ContainerDied","Data":"097c7b246345248b86e66bcb01b5001650cacdbc63a7c3652441a1eabbbd4932"} Jul 20 09:40:31.701894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:31.701774 2577 scope.go:117] "RemoveContainer" containerID="097c7b246345248b86e66bcb01b5001650cacdbc63a7c3652441a1eabbbd4932" Jul 20 09:40:32.707301 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:32.707270 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pm8hs" event={"ID":"21db448b-2c50-4d06-90ee-e18e8b089e99","Type":"ContainerStarted","Data":"ef2f7e91cec25ae6baab393f30cd1de52d986d4d2725ae7dd3515aed426ab2e9"} Jul 20 09:40:36.855896 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:36.855838 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79c4cf668-6d9rs" podUID="7f274aa4-3810-47e3-b80b-08369b318d50" containerName="console" containerID="cri-o://757a02f6faee9c84c9ae2a3141f691c1d233529b32d411b39d2edcd04e985201" gracePeriod=15 Jul 20 09:40:37.131199 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.131141 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:40:37.202098 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.202062 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-console-config\") pod \"7f274aa4-3810-47e3-b80b-08369b318d50\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " Jul 20 09:40:37.202282 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.202123 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f274aa4-3810-47e3-b80b-08369b318d50-console-serving-cert\") pod \"7f274aa4-3810-47e3-b80b-08369b318d50\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " Jul 20 09:40:37.202282 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.202177 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhm95\" (UniqueName: \"kubernetes.io/projected/7f274aa4-3810-47e3-b80b-08369b318d50-kube-api-access-nhm95\") pod \"7f274aa4-3810-47e3-b80b-08369b318d50\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " Jul 20 09:40:37.202282 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.202202 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f274aa4-3810-47e3-b80b-08369b318d50-console-oauth-config\") pod \"7f274aa4-3810-47e3-b80b-08369b318d50\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " Jul 20 09:40:37.202282 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.202259 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-service-ca\") pod \"7f274aa4-3810-47e3-b80b-08369b318d50\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " Jul 20 09:40:37.202495 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.202296 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-oauth-serving-cert\") pod \"7f274aa4-3810-47e3-b80b-08369b318d50\" (UID: \"7f274aa4-3810-47e3-b80b-08369b318d50\") " Jul 20 09:40:37.202619 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.202592 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-console-config" (OuterVolumeSpecName: "console-config") pod "7f274aa4-3810-47e3-b80b-08369b318d50" (UID: "7f274aa4-3810-47e3-b80b-08369b318d50"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 09:40:37.202717 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.202694 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-service-ca" (OuterVolumeSpecName: "service-ca") pod "7f274aa4-3810-47e3-b80b-08369b318d50" (UID: "7f274aa4-3810-47e3-b80b-08369b318d50"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 09:40:37.202771 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.202719 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7f274aa4-3810-47e3-b80b-08369b318d50" (UID: "7f274aa4-3810-47e3-b80b-08369b318d50"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 09:40:37.204562 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.204523 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f274aa4-3810-47e3-b80b-08369b318d50-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7f274aa4-3810-47e3-b80b-08369b318d50" (UID: "7f274aa4-3810-47e3-b80b-08369b318d50"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 09:40:37.204663 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.204577 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f274aa4-3810-47e3-b80b-08369b318d50-kube-api-access-nhm95" (OuterVolumeSpecName: "kube-api-access-nhm95") pod "7f274aa4-3810-47e3-b80b-08369b318d50" (UID: "7f274aa4-3810-47e3-b80b-08369b318d50"). InnerVolumeSpecName "kube-api-access-nhm95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 09:40:37.204663 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.204582 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f274aa4-3810-47e3-b80b-08369b318d50-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7f274aa4-3810-47e3-b80b-08369b318d50" (UID: "7f274aa4-3810-47e3-b80b-08369b318d50"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 09:40:37.303686 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.303655 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-console-config\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:40:37.303686 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.303681 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f274aa4-3810-47e3-b80b-08369b318d50-console-serving-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:40:37.303686 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.303692 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhm95\" (UniqueName: \"kubernetes.io/projected/7f274aa4-3810-47e3-b80b-08369b318d50-kube-api-access-nhm95\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:40:37.303905 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.303702 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f274aa4-3810-47e3-b80b-08369b318d50-console-oauth-config\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:40:37.303905 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.303712 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-service-ca\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:40:37.303905 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.303720 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f274aa4-3810-47e3-b80b-08369b318d50-oauth-serving-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:40:37.728268 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.728234 2577 generic.go:356] "Generic (PLEG): container finished" podID="7f274aa4-3810-47e3-b80b-08369b318d50" containerID="757a02f6faee9c84c9ae2a3141f691c1d233529b32d411b39d2edcd04e985201" exitCode=0 Jul 20 09:40:37.728515 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.728284 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c4cf668-6d9rs" Jul 20 09:40:37.728515 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.728297 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c4cf668-6d9rs" event={"ID":"7f274aa4-3810-47e3-b80b-08369b318d50","Type":"ContainerDied","Data":"757a02f6faee9c84c9ae2a3141f691c1d233529b32d411b39d2edcd04e985201"} Jul 20 09:40:37.728515 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.728337 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c4cf668-6d9rs" event={"ID":"7f274aa4-3810-47e3-b80b-08369b318d50","Type":"ContainerDied","Data":"0adbfb38e1b93d224369e2c5f7b9991c30354b3e0e3717ab000a1b1f4c7afb86"} Jul 20 09:40:37.728515 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.728357 2577 scope.go:117] "RemoveContainer" containerID="757a02f6faee9c84c9ae2a3141f691c1d233529b32d411b39d2edcd04e985201" Jul 20 09:40:37.737248 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.737229 2577 scope.go:117] "RemoveContainer" containerID="757a02f6faee9c84c9ae2a3141f691c1d233529b32d411b39d2edcd04e985201" Jul 20 09:40:37.737525 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:40:37.737504 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"757a02f6faee9c84c9ae2a3141f691c1d233529b32d411b39d2edcd04e985201\": container with ID starting with 757a02f6faee9c84c9ae2a3141f691c1d233529b32d411b39d2edcd04e985201 not found: ID does not exist" containerID="757a02f6faee9c84c9ae2a3141f691c1d233529b32d411b39d2edcd04e985201" Jul 20 09:40:37.737571 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.737535 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"757a02f6faee9c84c9ae2a3141f691c1d233529b32d411b39d2edcd04e985201"} err="failed to get container status \"757a02f6faee9c84c9ae2a3141f691c1d233529b32d411b39d2edcd04e985201\": rpc error: code = NotFound desc = could not find container \"757a02f6faee9c84c9ae2a3141f691c1d233529b32d411b39d2edcd04e985201\": container with ID starting with 757a02f6faee9c84c9ae2a3141f691c1d233529b32d411b39d2edcd04e985201 not found: ID does not exist" Jul 20 09:40:37.757961 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.757939 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79c4cf668-6d9rs"] Jul 20 09:40:37.764467 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:37.764447 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79c4cf668-6d9rs"] Jul 20 09:40:39.022841 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:39.022793 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f274aa4-3810-47e3-b80b-08369b318d50" path="/var/lib/kubelet/pods/7f274aa4-3810-47e3-b80b-08369b318d50/volumes" Jul 20 09:40:40.388288 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.388244 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" podUID="5a2efae7-379c-4a23-a6eb-18488f533fca" containerName="registry" containerID="cri-o://0a51cee8703f2a43f14253a51b603370e83273ee35e0d7c61715adea2edb010c" gracePeriod=30 Jul 20 09:40:40.683745 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.683719 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:40:40.731315 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.731288 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a2efae7-379c-4a23-a6eb-18488f533fca-ca-trust-extracted\") pod \"5a2efae7-379c-4a23-a6eb-18488f533fca\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " Jul 20 09:40:40.731315 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.731327 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a2efae7-379c-4a23-a6eb-18488f533fca-installation-pull-secrets\") pod \"5a2efae7-379c-4a23-a6eb-18488f533fca\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " Jul 20 09:40:40.731560 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.731359 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-bound-sa-token\") pod \"5a2efae7-379c-4a23-a6eb-18488f533fca\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " Jul 20 09:40:40.731560 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.731385 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a2efae7-379c-4a23-a6eb-18488f533fca-image-registry-private-configuration\") pod \"5a2efae7-379c-4a23-a6eb-18488f533fca\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " Jul 20 09:40:40.731560 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.731427 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnrf6\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-kube-api-access-mnrf6\") pod \"5a2efae7-379c-4a23-a6eb-18488f533fca\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " Jul 20 09:40:40.731560 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.731490 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-certificates\") pod \"5a2efae7-379c-4a23-a6eb-18488f533fca\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " Jul 20 09:40:40.731560 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.731518 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a2efae7-379c-4a23-a6eb-18488f533fca-trusted-ca\") pod \"5a2efae7-379c-4a23-a6eb-18488f533fca\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " Jul 20 09:40:40.731560 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.731548 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls\") pod \"5a2efae7-379c-4a23-a6eb-18488f533fca\" (UID: \"5a2efae7-379c-4a23-a6eb-18488f533fca\") " Jul 20 09:40:40.732180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.732145 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5a2efae7-379c-4a23-a6eb-18488f533fca" (UID: "5a2efae7-379c-4a23-a6eb-18488f533fca"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 09:40:40.732296 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.732240 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a2efae7-379c-4a23-a6eb-18488f533fca-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5a2efae7-379c-4a23-a6eb-18488f533fca" (UID: "5a2efae7-379c-4a23-a6eb-18488f533fca"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 09:40:40.734768 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.734577 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5a2efae7-379c-4a23-a6eb-18488f533fca" (UID: "5a2efae7-379c-4a23-a6eb-18488f533fca"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 09:40:40.734768 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.734585 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a2efae7-379c-4a23-a6eb-18488f533fca-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5a2efae7-379c-4a23-a6eb-18488f533fca" (UID: "5a2efae7-379c-4a23-a6eb-18488f533fca"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 09:40:40.734768 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.734653 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5a2efae7-379c-4a23-a6eb-18488f533fca" (UID: "5a2efae7-379c-4a23-a6eb-18488f533fca"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 09:40:40.735066 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.734832 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a2efae7-379c-4a23-a6eb-18488f533fca-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5a2efae7-379c-4a23-a6eb-18488f533fca" (UID: "5a2efae7-379c-4a23-a6eb-18488f533fca"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 09:40:40.735066 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.735006 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-kube-api-access-mnrf6" (OuterVolumeSpecName: "kube-api-access-mnrf6") pod "5a2efae7-379c-4a23-a6eb-18488f533fca" (UID: "5a2efae7-379c-4a23-a6eb-18488f533fca"). InnerVolumeSpecName "kube-api-access-mnrf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 09:40:40.740902 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.740874 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a2efae7-379c-4a23-a6eb-18488f533fca-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5a2efae7-379c-4a23-a6eb-18488f533fca" (UID: "5a2efae7-379c-4a23-a6eb-18488f533fca"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:40:40.743976 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.743948 2577 generic.go:356] "Generic (PLEG): container finished" podID="5a2efae7-379c-4a23-a6eb-18488f533fca" containerID="0a51cee8703f2a43f14253a51b603370e83273ee35e0d7c61715adea2edb010c" exitCode=0 Jul 20 09:40:40.744058 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.743984 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" Jul 20 09:40:40.744058 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.744024 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" event={"ID":"5a2efae7-379c-4a23-a6eb-18488f533fca","Type":"ContainerDied","Data":"0a51cee8703f2a43f14253a51b603370e83273ee35e0d7c61715adea2edb010c"} Jul 20 09:40:40.744129 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.744080 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59db674c8d-5vqfz" event={"ID":"5a2efae7-379c-4a23-a6eb-18488f533fca","Type":"ContainerDied","Data":"f7321130d085457878c97097976a0323c53101f57ec74a778dedb2970ad255cd"} Jul 20 09:40:40.744129 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.744102 2577 scope.go:117] "RemoveContainer" containerID="0a51cee8703f2a43f14253a51b603370e83273ee35e0d7c61715adea2edb010c" Jul 20 09:40:40.752237 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.752223 2577 scope.go:117] "RemoveContainer" containerID="0a51cee8703f2a43f14253a51b603370e83273ee35e0d7c61715adea2edb010c" Jul 20 09:40:40.752493 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:40:40.752472 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a51cee8703f2a43f14253a51b603370e83273ee35e0d7c61715adea2edb010c\": container with ID starting with 0a51cee8703f2a43f14253a51b603370e83273ee35e0d7c61715adea2edb010c not found: ID does not exist" containerID="0a51cee8703f2a43f14253a51b603370e83273ee35e0d7c61715adea2edb010c" Jul 20 09:40:40.752541 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.752501 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a51cee8703f2a43f14253a51b603370e83273ee35e0d7c61715adea2edb010c"} err="failed to get container status \"0a51cee8703f2a43f14253a51b603370e83273ee35e0d7c61715adea2edb010c\": rpc error: code = NotFound desc = could not find container \"0a51cee8703f2a43f14253a51b603370e83273ee35e0d7c61715adea2edb010c\": container with ID starting with 0a51cee8703f2a43f14253a51b603370e83273ee35e0d7c61715adea2edb010c not found: ID does not exist" Jul 20 09:40:40.770442 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.770419 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59db674c8d-5vqfz"] Jul 20 09:40:40.773764 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.773744 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59db674c8d-5vqfz"] Jul 20 09:40:40.833088 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.833066 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-certificates\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:40:40.833088 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.833087 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a2efae7-379c-4a23-a6eb-18488f533fca-trusted-ca\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:40:40.833202 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.833099 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-registry-tls\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:40:40.833202 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.833108 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a2efae7-379c-4a23-a6eb-18488f533fca-ca-trust-extracted\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:40:40.833202 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.833116 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a2efae7-379c-4a23-a6eb-18488f533fca-installation-pull-secrets\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:40:40.833202 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.833124 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-bound-sa-token\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:40:40.833202 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.833133 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a2efae7-379c-4a23-a6eb-18488f533fca-image-registry-private-configuration\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:40:40.833202 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:40.833141 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnrf6\" (UniqueName: \"kubernetes.io/projected/5a2efae7-379c-4a23-a6eb-18488f533fca-kube-api-access-mnrf6\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:40:41.024038 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:41.023972 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a2efae7-379c-4a23-a6eb-18488f533fca" path="/var/lib/kubelet/pods/5a2efae7-379c-4a23-a6eb-18488f533fca/volumes" Jul 20 09:40:56.801738 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:56.801701 2577 generic.go:356] "Generic (PLEG): container finished" podID="c7669f8c-e50b-4df2-82ac-69ed7998a965" containerID="ee5f6920d40b7b1dffaea017af64943a3606d2b1bb2c886fa22186a14fe05cd8" exitCode=0 Jul 20 09:40:56.802159 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:56.801776 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" event={"ID":"c7669f8c-e50b-4df2-82ac-69ed7998a965","Type":"ContainerDied","Data":"ee5f6920d40b7b1dffaea017af64943a3606d2b1bb2c886fa22186a14fe05cd8"} Jul 20 09:40:56.802159 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:56.802100 2577 scope.go:117] "RemoveContainer" containerID="ee5f6920d40b7b1dffaea017af64943a3606d2b1bb2c886fa22186a14fe05cd8" Jul 20 09:40:57.808026 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:40:57.807984 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xj4vm" event={"ID":"c7669f8c-e50b-4df2-82ac-69ed7998a965","Type":"ContainerStarted","Data":"9c4a686a42e3c5646f7a8c9e49a4190475cfc739be298c16aac3f544db9183d2"} Jul 20 09:41:01.823599 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:01.823566 2577 generic.go:356] "Generic (PLEG): container finished" podID="94e41dbb-04af-4580-a433-b828787892e7" containerID="aeb2d690b28ab0864b61ed4e7d2e1ee5413bc6ebcf5f030fa5c505c66dca5899" exitCode=0 Jul 20 09:41:01.824091 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:01.823645 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-gckq6" event={"ID":"94e41dbb-04af-4580-a433-b828787892e7","Type":"ContainerDied","Data":"aeb2d690b28ab0864b61ed4e7d2e1ee5413bc6ebcf5f030fa5c505c66dca5899"} Jul 20 09:41:01.824091 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:01.823991 2577 scope.go:117] "RemoveContainer" containerID="aeb2d690b28ab0864b61ed4e7d2e1ee5413bc6ebcf5f030fa5c505c66dca5899" Jul 20 09:41:02.829395 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:02.829357 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-gckq6" event={"ID":"94e41dbb-04af-4580-a433-b828787892e7","Type":"ContainerStarted","Data":"5a2e151caf28e9ff41fcad0d8b315af922cecba5759a10c81d1d0b036ce768f7"} Jul 20 09:41:41.074341 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.074254 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6677566cc4-k5bdj"] Jul 20 09:41:41.074796 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.074526 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f274aa4-3810-47e3-b80b-08369b318d50" containerName="console" Jul 20 09:41:41.074796 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.074537 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f274aa4-3810-47e3-b80b-08369b318d50" containerName="console" Jul 20 09:41:41.074796 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.074560 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a2efae7-379c-4a23-a6eb-18488f533fca" containerName="registry" Jul 20 09:41:41.074796 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.074567 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a2efae7-379c-4a23-a6eb-18488f533fca" containerName="registry" Jul 20 09:41:41.074796 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.074617 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f274aa4-3810-47e3-b80b-08369b318d50" containerName="console" Jul 20 09:41:41.074796 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.074625 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a2efae7-379c-4a23-a6eb-18488f533fca" containerName="registry" Jul 20 09:41:41.077255 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.077069 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.083077 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.083050 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 20 09:41:41.083190 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.083054 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bwk56\"" Jul 20 09:41:41.084098 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.084073 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 20 09:41:41.084209 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.084139 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 20 09:41:41.084442 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.084424 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 20 09:41:41.084555 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.084466 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 20 09:41:41.090745 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.090721 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 20 09:41:41.102252 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.102223 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6677566cc4-k5bdj"] Jul 20 09:41:41.201752 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.201717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-oauth-config\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.201752 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.201753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-trusted-ca-bundle\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.201993 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.201780 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-serving-cert\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.201993 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.201905 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-oauth-serving-cert\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.201993 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.201947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-config\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.201993 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.201970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4nsc\" (UniqueName: \"kubernetes.io/projected/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-kube-api-access-d4nsc\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.201993 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.201992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-service-ca\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.302816 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.302777 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-oauth-config\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.302816 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.302818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-trusted-ca-bundle\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.303078 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.302871 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-serving-cert\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.303078 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.303041 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-oauth-serving-cert\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.303185 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.303092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-config\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.303185 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.303114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4nsc\" (UniqueName: \"kubernetes.io/projected/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-kube-api-access-d4nsc\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.303185 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.303140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-service-ca\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.303704 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.303672 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-oauth-serving-cert\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.303859 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.303784 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-service-ca\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.303931 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.303878 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-config\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.303931 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.303923 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-trusted-ca-bundle\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.305317 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.305286 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-serving-cert\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.305491 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.305471 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-oauth-config\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.312714 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.312694 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4nsc\" (UniqueName: \"kubernetes.io/projected/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-kube-api-access-d4nsc\") pod \"console-6677566cc4-k5bdj\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.391134 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.391049 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:41.521580 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.521492 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6677566cc4-k5bdj"] Jul 20 09:41:41.525166 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:41:41.525138 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab865a3_3a4f_45e7_869c_ceade2e5de1e.slice/crio-e1315e9d1169f5ef3c378b4978843d7de1b3ea9fe625480743c78d152a7a8d67 WatchSource:0}: Error finding container e1315e9d1169f5ef3c378b4978843d7de1b3ea9fe625480743c78d152a7a8d67: Status 404 returned error can't find the container with id e1315e9d1169f5ef3c378b4978843d7de1b3ea9fe625480743c78d152a7a8d67 Jul 20 09:41:41.977867 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.977818 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6677566cc4-k5bdj" event={"ID":"0ab865a3-3a4f-45e7-869c-ceade2e5de1e","Type":"ContainerStarted","Data":"fa5fe3e79b967f8d4e0924ec76d74cc202a9fbf339254924b091a16399c4c1df"} Jul 20 09:41:41.978036 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.977877 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6677566cc4-k5bdj" event={"ID":"0ab865a3-3a4f-45e7-869c-ceade2e5de1e","Type":"ContainerStarted","Data":"e1315e9d1169f5ef3c378b4978843d7de1b3ea9fe625480743c78d152a7a8d67"} Jul 20 09:41:41.998349 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:41.998304 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6677566cc4-k5bdj" podStartSLOduration=0.998289313 podStartE2EDuration="998.289313ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:41:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:41:41.997144819 +0000 UTC m=+181.471245850" watchObservedRunningTime="2026-07-20 09:41:41.998289313 +0000 UTC m=+181.472390346" Jul 20 09:41:51.392123 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:51.392087 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:51.392522 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:51.392168 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:51.396774 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:51.396748 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:52.020446 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.020415 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:41:52.193968 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.193933 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66fcdbd84d-58px5"] Jul 20 09:41:52.196506 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.196484 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.211494 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.211464 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66fcdbd84d-58px5"] Jul 20 09:41:52.287142 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.287052 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-serving-cert\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.287142 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.287125 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-config\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.287142 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.287143 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj2xq\" (UniqueName: \"kubernetes.io/projected/b408e0e5-df5a-459b-9e22-d752215ee8b9-kube-api-access-qj2xq\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.287408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.287208 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-trusted-ca-bundle\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.287408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.287247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-oauth-serving-cert\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.287408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.287284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-service-ca\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.287408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.287315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-oauth-config\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.387705 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.387666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-serving-cert\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.387888 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.387719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-config\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.387888 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.387867 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj2xq\" (UniqueName: \"kubernetes.io/projected/b408e0e5-df5a-459b-9e22-d752215ee8b9-kube-api-access-qj2xq\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.388007 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.387935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-trusted-ca-bundle\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.388007 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.387975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-oauth-serving-cert\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.388102 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.388017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-service-ca\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.388102 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.388052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-oauth-config\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.388460 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.388426 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-config\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.388713 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.388687 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-oauth-serving-cert\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.388781 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.388708 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-service-ca\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.388781 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.388704 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-trusted-ca-bundle\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.390215 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.390188 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-serving-cert\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.390615 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.390593 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-oauth-config\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.399260 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.399232 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj2xq\" (UniqueName: \"kubernetes.io/projected/b408e0e5-df5a-459b-9e22-d752215ee8b9-kube-api-access-qj2xq\") pod \"console-66fcdbd84d-58px5\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.507248 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.507212 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:41:52.635781 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:52.635753 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66fcdbd84d-58px5"] Jul 20 09:41:52.638050 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:41:52.638025 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb408e0e5_df5a_459b_9e22_d752215ee8b9.slice/crio-1a223dc7603d2a102790d3bbe9f791f16530273b623890803a79976127338581 WatchSource:0}: Error finding container 1a223dc7603d2a102790d3bbe9f791f16530273b623890803a79976127338581: Status 404 returned error can't find the container with id 1a223dc7603d2a102790d3bbe9f791f16530273b623890803a79976127338581 Jul 20 09:41:53.023782 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:53.023749 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fcdbd84d-58px5" event={"ID":"b408e0e5-df5a-459b-9e22-d752215ee8b9","Type":"ContainerStarted","Data":"54411dfb53ac2bafadfde3f8d92c7167259107a14bdabfe18d86c3f138da0a76"} Jul 20 09:41:53.023977 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:53.023798 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fcdbd84d-58px5" event={"ID":"b408e0e5-df5a-459b-9e22-d752215ee8b9","Type":"ContainerStarted","Data":"1a223dc7603d2a102790d3bbe9f791f16530273b623890803a79976127338581"} Jul 20 09:41:53.045020 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:41:53.044971 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66fcdbd84d-58px5" podStartSLOduration=1.044955199 podStartE2EDuration="1.044955199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:41:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:41:53.043689567 +0000 UTC m=+192.517790596" watchObservedRunningTime="2026-07-20 09:41:53.044955199 +0000 UTC m=+192.519056303" Jul 20 09:42:02.508216 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:02.508169 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:42:02.508620 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:02.508274 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:42:02.513103 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:02.513082 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:42:03.062106 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:03.062072 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:42:03.113766 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:03.113730 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6677566cc4-k5bdj"] Jul 20 09:42:28.139701 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.139654 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6677566cc4-k5bdj" podUID="0ab865a3-3a4f-45e7-869c-ceade2e5de1e" containerName="console" containerID="cri-o://fa5fe3e79b967f8d4e0924ec76d74cc202a9fbf339254924b091a16399c4c1df" gracePeriod=15 Jul 20 09:42:28.380905 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.380878 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:42:28.468087 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.467993 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-oauth-serving-cert\") pod \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " Jul 20 09:42:28.468087 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.468045 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4nsc\" (UniqueName: \"kubernetes.io/projected/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-kube-api-access-d4nsc\") pod \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " Jul 20 09:42:28.468326 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.468104 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-trusted-ca-bundle\") pod \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " Jul 20 09:42:28.468326 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.468124 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-serving-cert\") pod \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " Jul 20 09:42:28.468326 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.468149 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-config\") pod \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " Jul 20 09:42:28.468326 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.468216 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-oauth-config\") pod \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " Jul 20 09:42:28.468326 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.468249 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-service-ca\") pod \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\" (UID: \"0ab865a3-3a4f-45e7-869c-ceade2e5de1e\") " Jul 20 09:42:28.468560 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.468451 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0ab865a3-3a4f-45e7-869c-ceade2e5de1e" (UID: "0ab865a3-3a4f-45e7-869c-ceade2e5de1e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 09:42:28.468560 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.468508 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-config" (OuterVolumeSpecName: "console-config") pod "0ab865a3-3a4f-45e7-869c-ceade2e5de1e" (UID: "0ab865a3-3a4f-45e7-869c-ceade2e5de1e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 09:42:28.468560 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.468538 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0ab865a3-3a4f-45e7-869c-ceade2e5de1e" (UID: "0ab865a3-3a4f-45e7-869c-ceade2e5de1e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 09:42:28.468779 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.468752 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-service-ca" (OuterVolumeSpecName: "service-ca") pod "0ab865a3-3a4f-45e7-869c-ceade2e5de1e" (UID: "0ab865a3-3a4f-45e7-869c-ceade2e5de1e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 09:42:28.470305 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.470266 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0ab865a3-3a4f-45e7-869c-ceade2e5de1e" (UID: "0ab865a3-3a4f-45e7-869c-ceade2e5de1e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 09:42:28.470425 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.470338 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0ab865a3-3a4f-45e7-869c-ceade2e5de1e" (UID: "0ab865a3-3a4f-45e7-869c-ceade2e5de1e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 09:42:28.470425 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.470363 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-kube-api-access-d4nsc" (OuterVolumeSpecName: "kube-api-access-d4nsc") pod "0ab865a3-3a4f-45e7-869c-ceade2e5de1e" (UID: "0ab865a3-3a4f-45e7-869c-ceade2e5de1e"). InnerVolumeSpecName "kube-api-access-d4nsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 09:42:28.569718 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.569684 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-trusted-ca-bundle\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:42:28.569718 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.569716 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-serving-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:42:28.569718 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.569727 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-config\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:42:28.569977 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.569736 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-console-oauth-config\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:42:28.569977 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.569745 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-service-ca\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:42:28.569977 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.569755 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-oauth-serving-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:42:28.569977 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:28.569763 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4nsc\" (UniqueName: \"kubernetes.io/projected/0ab865a3-3a4f-45e7-869c-ceade2e5de1e-kube-api-access-d4nsc\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:42:29.158193 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:29.158157 2577 generic.go:356] "Generic (PLEG): container finished" podID="0ab865a3-3a4f-45e7-869c-ceade2e5de1e" containerID="fa5fe3e79b967f8d4e0924ec76d74cc202a9fbf339254924b091a16399c4c1df" exitCode=0 Jul 20 09:42:29.158618 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:29.158203 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6677566cc4-k5bdj" Jul 20 09:42:29.158618 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:29.158245 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6677566cc4-k5bdj" event={"ID":"0ab865a3-3a4f-45e7-869c-ceade2e5de1e","Type":"ContainerDied","Data":"fa5fe3e79b967f8d4e0924ec76d74cc202a9fbf339254924b091a16399c4c1df"} Jul 20 09:42:29.158618 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:29.158292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6677566cc4-k5bdj" event={"ID":"0ab865a3-3a4f-45e7-869c-ceade2e5de1e","Type":"ContainerDied","Data":"e1315e9d1169f5ef3c378b4978843d7de1b3ea9fe625480743c78d152a7a8d67"} Jul 20 09:42:29.158618 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:29.158312 2577 scope.go:117] "RemoveContainer" containerID="fa5fe3e79b967f8d4e0924ec76d74cc202a9fbf339254924b091a16399c4c1df" Jul 20 09:42:29.166796 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:29.166777 2577 scope.go:117] "RemoveContainer" containerID="fa5fe3e79b967f8d4e0924ec76d74cc202a9fbf339254924b091a16399c4c1df" Jul 20 09:42:29.167060 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:42:29.167042 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa5fe3e79b967f8d4e0924ec76d74cc202a9fbf339254924b091a16399c4c1df\": container with ID starting with fa5fe3e79b967f8d4e0924ec76d74cc202a9fbf339254924b091a16399c4c1df not found: ID does not exist" containerID="fa5fe3e79b967f8d4e0924ec76d74cc202a9fbf339254924b091a16399c4c1df" Jul 20 09:42:29.167126 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:29.167071 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa5fe3e79b967f8d4e0924ec76d74cc202a9fbf339254924b091a16399c4c1df"} err="failed to get container status \"fa5fe3e79b967f8d4e0924ec76d74cc202a9fbf339254924b091a16399c4c1df\": rpc error: code = NotFound desc = could not find container \"fa5fe3e79b967f8d4e0924ec76d74cc202a9fbf339254924b091a16399c4c1df\": container with ID starting with fa5fe3e79b967f8d4e0924ec76d74cc202a9fbf339254924b091a16399c4c1df not found: ID does not exist" Jul 20 09:42:29.176168 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:29.176142 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6677566cc4-k5bdj"] Jul 20 09:42:29.178198 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:29.178175 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6677566cc4-k5bdj"] Jul 20 09:42:31.022818 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:42:31.022785 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ab865a3-3a4f-45e7-869c-ceade2e5de1e" path="/var/lib/kubelet/pods/0ab865a3-3a4f-45e7-869c-ceade2e5de1e/volumes" Jul 20 09:43:04.054586 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.054491 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp"] Jul 20 09:43:04.055034 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.054780 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab865a3-3a4f-45e7-869c-ceade2e5de1e" containerName="console" Jul 20 09:43:04.055034 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.054791 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab865a3-3a4f-45e7-869c-ceade2e5de1e" containerName="console" Jul 20 09:43:04.055034 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.054861 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ab865a3-3a4f-45e7-869c-ceade2e5de1e" containerName="console" Jul 20 09:43:04.057005 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.056989 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" Jul 20 09:43:04.059729 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.059705 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 09:43:04.060675 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.060657 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 09:43:04.060755 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.060658 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p9vc8\"" Jul 20 09:43:04.067769 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.067748 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp"] Jul 20 09:43:04.147336 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.147298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp\" (UID: \"5f949e79-9bf6-4197-bdfc-a5384d5f06fa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" Jul 20 09:43:04.147336 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.147345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjtcc\" (UniqueName: \"kubernetes.io/projected/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-kube-api-access-tjtcc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp\" (UID: \"5f949e79-9bf6-4197-bdfc-a5384d5f06fa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" Jul 20 09:43:04.147588 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.147414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp\" (UID: \"5f949e79-9bf6-4197-bdfc-a5384d5f06fa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" Jul 20 09:43:04.248003 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.247968 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp\" (UID: \"5f949e79-9bf6-4197-bdfc-a5384d5f06fa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" Jul 20 09:43:04.248194 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.248026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp\" (UID: \"5f949e79-9bf6-4197-bdfc-a5384d5f06fa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" Jul 20 09:43:04.248194 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.248064 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjtcc\" (UniqueName: \"kubernetes.io/projected/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-kube-api-access-tjtcc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp\" (UID: \"5f949e79-9bf6-4197-bdfc-a5384d5f06fa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" Jul 20 09:43:04.248325 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.248302 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp\" (UID: \"5f949e79-9bf6-4197-bdfc-a5384d5f06fa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" Jul 20 09:43:04.248377 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.248325 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp\" (UID: \"5f949e79-9bf6-4197-bdfc-a5384d5f06fa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" Jul 20 09:43:04.257060 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.257040 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjtcc\" (UniqueName: \"kubernetes.io/projected/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-kube-api-access-tjtcc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp\" (UID: \"5f949e79-9bf6-4197-bdfc-a5384d5f06fa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" Jul 20 09:43:04.365529 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.365505 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" Jul 20 09:43:04.492262 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:04.492239 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp"] Jul 20 09:43:04.494730 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:43:04.494702 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f949e79_9bf6_4197_bdfc_a5384d5f06fa.slice/crio-24cdd8b8782b637fb3e2c671652e1b67de286da6ff1a34bf8a57126aa8b10281 WatchSource:0}: Error finding container 24cdd8b8782b637fb3e2c671652e1b67de286da6ff1a34bf8a57126aa8b10281: Status 404 returned error can't find the container with id 24cdd8b8782b637fb3e2c671652e1b67de286da6ff1a34bf8a57126aa8b10281 Jul 20 09:43:05.290097 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:05.290058 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" event={"ID":"5f949e79-9bf6-4197-bdfc-a5384d5f06fa","Type":"ContainerStarted","Data":"24cdd8b8782b637fb3e2c671652e1b67de286da6ff1a34bf8a57126aa8b10281"} Jul 20 09:43:11.319092 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:11.319055 2577 generic.go:356] "Generic (PLEG): container finished" podID="5f949e79-9bf6-4197-bdfc-a5384d5f06fa" containerID="7373925e83ea716210980221226fe2c6e9a6ab79eb495e56fea43c61f07e3d3b" exitCode=0 Jul 20 09:43:11.319473 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:11.319112 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" event={"ID":"5f949e79-9bf6-4197-bdfc-a5384d5f06fa","Type":"ContainerDied","Data":"7373925e83ea716210980221226fe2c6e9a6ab79eb495e56fea43c61f07e3d3b"} Jul 20 09:43:13.328952 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:13.328912 2577 generic.go:356] "Generic (PLEG): container finished" podID="5f949e79-9bf6-4197-bdfc-a5384d5f06fa" containerID="6a8e8722f51e3a027f7c82b1818d603d3f1d1c315df5325323fd9676889ef046" exitCode=0 Jul 20 09:43:13.329354 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:13.328992 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" event={"ID":"5f949e79-9bf6-4197-bdfc-a5384d5f06fa","Type":"ContainerDied","Data":"6a8e8722f51e3a027f7c82b1818d603d3f1d1c315df5325323fd9676889ef046"} Jul 20 09:43:20.364594 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:20.364560 2577 generic.go:356] "Generic (PLEG): container finished" podID="5f949e79-9bf6-4197-bdfc-a5384d5f06fa" containerID="2ba453d87f7b0dc78a8a7f3edc19511b38b1dc777ad8bd748031f77ba38dcb05" exitCode=0 Jul 20 09:43:20.365079 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:20.364649 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" event={"ID":"5f949e79-9bf6-4197-bdfc-a5384d5f06fa","Type":"ContainerDied","Data":"2ba453d87f7b0dc78a8a7f3edc19511b38b1dc777ad8bd748031f77ba38dcb05"} Jul 20 09:43:21.495541 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:21.495512 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" Jul 20 09:43:21.596202 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:21.596168 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjtcc\" (UniqueName: \"kubernetes.io/projected/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-kube-api-access-tjtcc\") pod \"5f949e79-9bf6-4197-bdfc-a5384d5f06fa\" (UID: \"5f949e79-9bf6-4197-bdfc-a5384d5f06fa\") " Jul 20 09:43:21.596202 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:21.596206 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-bundle\") pod \"5f949e79-9bf6-4197-bdfc-a5384d5f06fa\" (UID: \"5f949e79-9bf6-4197-bdfc-a5384d5f06fa\") " Jul 20 09:43:21.596410 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:21.596269 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-util\") pod \"5f949e79-9bf6-4197-bdfc-a5384d5f06fa\" (UID: \"5f949e79-9bf6-4197-bdfc-a5384d5f06fa\") " Jul 20 09:43:21.596939 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:21.596908 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-bundle" (OuterVolumeSpecName: "bundle") pod "5f949e79-9bf6-4197-bdfc-a5384d5f06fa" (UID: "5f949e79-9bf6-4197-bdfc-a5384d5f06fa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:43:21.598348 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:21.598328 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-kube-api-access-tjtcc" (OuterVolumeSpecName: "kube-api-access-tjtcc") pod "5f949e79-9bf6-4197-bdfc-a5384d5f06fa" (UID: "5f949e79-9bf6-4197-bdfc-a5384d5f06fa"). InnerVolumeSpecName "kube-api-access-tjtcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 09:43:21.600546 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:21.600516 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-util" (OuterVolumeSpecName: "util") pod "5f949e79-9bf6-4197-bdfc-a5384d5f06fa" (UID: "5f949e79-9bf6-4197-bdfc-a5384d5f06fa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:43:21.696777 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:21.696698 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-util\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:43:21.696777 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:21.696726 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjtcc\" (UniqueName: \"kubernetes.io/projected/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-kube-api-access-tjtcc\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:43:21.696777 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:21.696737 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f949e79-9bf6-4197-bdfc-a5384d5f06fa-bundle\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:43:22.374935 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:22.374837 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" Jul 20 09:43:22.374935 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:22.374863 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7vwp" event={"ID":"5f949e79-9bf6-4197-bdfc-a5384d5f06fa","Type":"ContainerDied","Data":"24cdd8b8782b637fb3e2c671652e1b67de286da6ff1a34bf8a57126aa8b10281"} Jul 20 09:43:22.374935 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:22.374907 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24cdd8b8782b637fb3e2c671652e1b67de286da6ff1a34bf8a57126aa8b10281" Jul 20 09:43:27.178419 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.178381 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l65qv"] Jul 20 09:43:27.179013 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.178786 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f949e79-9bf6-4197-bdfc-a5384d5f06fa" containerName="extract" Jul 20 09:43:27.179013 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.178804 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f949e79-9bf6-4197-bdfc-a5384d5f06fa" containerName="extract" Jul 20 09:43:27.179013 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.178820 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f949e79-9bf6-4197-bdfc-a5384d5f06fa" containerName="pull" Jul 20 09:43:27.179013 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.178828 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f949e79-9bf6-4197-bdfc-a5384d5f06fa" containerName="pull" Jul 20 09:43:27.179013 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.178841 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f949e79-9bf6-4197-bdfc-a5384d5f06fa" containerName="util" Jul 20 09:43:27.179013 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.178867 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f949e79-9bf6-4197-bdfc-a5384d5f06fa" containerName="util" Jul 20 09:43:27.179013 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.178957 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f949e79-9bf6-4197-bdfc-a5384d5f06fa" containerName="extract" Jul 20 09:43:27.231023 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.230987 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l65qv"] Jul 20 09:43:27.231191 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.231091 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l65qv" Jul 20 09:43:27.234032 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.234008 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:43:27.234032 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.234009 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ncwcj\"" Jul 20 09:43:27.234228 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.234057 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 20 09:43:27.338347 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.338308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f311a04-8793-4e92-9143-6e71fc279c63-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-l65qv\" (UID: \"8f311a04-8793-4e92-9143-6e71fc279c63\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l65qv" Jul 20 09:43:27.338527 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.338362 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w69nj\" (UniqueName: \"kubernetes.io/projected/8f311a04-8793-4e92-9143-6e71fc279c63-kube-api-access-w69nj\") pod \"cert-manager-operator-controller-manager-55c444bf86-l65qv\" (UID: \"8f311a04-8793-4e92-9143-6e71fc279c63\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l65qv" Jul 20 09:43:27.439054 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.438943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f311a04-8793-4e92-9143-6e71fc279c63-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-l65qv\" (UID: \"8f311a04-8793-4e92-9143-6e71fc279c63\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l65qv" Jul 20 09:43:27.439054 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.439007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w69nj\" (UniqueName: \"kubernetes.io/projected/8f311a04-8793-4e92-9143-6e71fc279c63-kube-api-access-w69nj\") pod \"cert-manager-operator-controller-manager-55c444bf86-l65qv\" (UID: \"8f311a04-8793-4e92-9143-6e71fc279c63\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l65qv" Jul 20 09:43:27.439355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.439331 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f311a04-8793-4e92-9143-6e71fc279c63-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-l65qv\" (UID: \"8f311a04-8793-4e92-9143-6e71fc279c63\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l65qv" Jul 20 09:43:27.451331 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.451308 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w69nj\" (UniqueName: \"kubernetes.io/projected/8f311a04-8793-4e92-9143-6e71fc279c63-kube-api-access-w69nj\") pod \"cert-manager-operator-controller-manager-55c444bf86-l65qv\" (UID: \"8f311a04-8793-4e92-9143-6e71fc279c63\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l65qv" Jul 20 09:43:27.540275 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.540231 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l65qv" Jul 20 09:43:27.697035 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:27.697006 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l65qv"] Jul 20 09:43:27.699187 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:43:27.699159 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f311a04_8793_4e92_9143_6e71fc279c63.slice/crio-4fa4877828d0fa3dad448f1df6a37c4af0a407901bcbcbeaed79e528183f08da WatchSource:0}: Error finding container 4fa4877828d0fa3dad448f1df6a37c4af0a407901bcbcbeaed79e528183f08da: Status 404 returned error can't find the container with id 4fa4877828d0fa3dad448f1df6a37c4af0a407901bcbcbeaed79e528183f08da Jul 20 09:43:28.399123 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:28.399079 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l65qv" event={"ID":"8f311a04-8793-4e92-9143-6e71fc279c63","Type":"ContainerStarted","Data":"4fa4877828d0fa3dad448f1df6a37c4af0a407901bcbcbeaed79e528183f08da"} Jul 20 09:43:30.411043 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:30.410999 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l65qv" event={"ID":"8f311a04-8793-4e92-9143-6e71fc279c63","Type":"ContainerStarted","Data":"d86aa055ed4860d8059f393849dd0748a09348c6dcefc684e870bfc279166151"} Jul 20 09:43:30.438702 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:30.438641 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l65qv" podStartSLOduration=1.480038869 podStartE2EDuration="3.438615741s" totalImagesPullingTime="1.958576872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:43:30.43606515 +0000 UTC m=+289.910166194" watchObservedRunningTime="2026-07-20 09:43:30.438615741 +0000 UTC m=+289.912716773" Jul 20 09:43:31.680218 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:31.680182 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb"] Jul 20 09:43:31.698929 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:31.698892 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb"] Jul 20 09:43:31.699106 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:31.698950 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" Jul 20 09:43:31.702104 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:31.701983 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 09:43:31.702104 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:31.702034 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 09:43:31.703416 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:31.702821 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p9vc8\"" Jul 20 09:43:31.772686 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:31.772647 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdv9x\" (UniqueName: \"kubernetes.io/projected/2263b494-e92e-42fc-8cde-088a879780c1-kube-api-access-mdv9x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb\" (UID: \"2263b494-e92e-42fc-8cde-088a879780c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" Jul 20 09:43:31.772882 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:31.772703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2263b494-e92e-42fc-8cde-088a879780c1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb\" (UID: \"2263b494-e92e-42fc-8cde-088a879780c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" Jul 20 09:43:31.772882 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:31.772742 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2263b494-e92e-42fc-8cde-088a879780c1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb\" (UID: \"2263b494-e92e-42fc-8cde-088a879780c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" Jul 20 09:43:31.873682 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:31.873638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdv9x\" (UniqueName: \"kubernetes.io/projected/2263b494-e92e-42fc-8cde-088a879780c1-kube-api-access-mdv9x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb\" (UID: \"2263b494-e92e-42fc-8cde-088a879780c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" Jul 20 09:43:31.873890 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:31.873710 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2263b494-e92e-42fc-8cde-088a879780c1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb\" (UID: \"2263b494-e92e-42fc-8cde-088a879780c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" Jul 20 09:43:31.873890 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:31.873732 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2263b494-e92e-42fc-8cde-088a879780c1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb\" (UID: \"2263b494-e92e-42fc-8cde-088a879780c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" Jul 20 09:43:31.874220 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:31.874196 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2263b494-e92e-42fc-8cde-088a879780c1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb\" (UID: \"2263b494-e92e-42fc-8cde-088a879780c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" Jul 20 09:43:31.874263 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:31.874211 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2263b494-e92e-42fc-8cde-088a879780c1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb\" (UID: \"2263b494-e92e-42fc-8cde-088a879780c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" Jul 20 09:43:31.882344 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:31.882315 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdv9x\" (UniqueName: \"kubernetes.io/projected/2263b494-e92e-42fc-8cde-088a879780c1-kube-api-access-mdv9x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb\" (UID: \"2263b494-e92e-42fc-8cde-088a879780c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" Jul 20 09:43:32.014057 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:32.013967 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" Jul 20 09:43:32.171183 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:32.171146 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb"] Jul 20 09:43:32.174138 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:43:32.174104 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2263b494_e92e_42fc_8cde_088a879780c1.slice/crio-f38ee2098359169f87fe3a92e26c1fc2b383f45135c30435821241e46db2d5e3 WatchSource:0}: Error finding container f38ee2098359169f87fe3a92e26c1fc2b383f45135c30435821241e46db2d5e3: Status 404 returned error can't find the container with id f38ee2098359169f87fe3a92e26c1fc2b383f45135c30435821241e46db2d5e3 Jul 20 09:43:32.420907 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:32.420872 2577 generic.go:356] "Generic (PLEG): container finished" podID="2263b494-e92e-42fc-8cde-088a879780c1" containerID="d17de10694438dba339fc27b0eb9286e88399eb8b8607867b2621073c861bac5" exitCode=0 Jul 20 09:43:32.421075 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:32.420945 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" event={"ID":"2263b494-e92e-42fc-8cde-088a879780c1","Type":"ContainerDied","Data":"d17de10694438dba339fc27b0eb9286e88399eb8b8607867b2621073c861bac5"} Jul 20 09:43:32.421075 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:32.420995 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" event={"ID":"2263b494-e92e-42fc-8cde-088a879780c1","Type":"ContainerStarted","Data":"f38ee2098359169f87fe3a92e26c1fc2b383f45135c30435821241e46db2d5e3"} Jul 20 09:43:35.437682 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:35.437644 2577 generic.go:356] "Generic (PLEG): container finished" podID="2263b494-e92e-42fc-8cde-088a879780c1" containerID="db292af5b2dc6ceff283280e208793813f172bca9d48e61ea24bd89a9cb3a3c5" exitCode=0 Jul 20 09:43:35.438148 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:35.437694 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" event={"ID":"2263b494-e92e-42fc-8cde-088a879780c1","Type":"ContainerDied","Data":"db292af5b2dc6ceff283280e208793813f172bca9d48e61ea24bd89a9cb3a3c5"} Jul 20 09:43:36.444588 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:36.444553 2577 generic.go:356] "Generic (PLEG): container finished" podID="2263b494-e92e-42fc-8cde-088a879780c1" containerID="a04f538c3f63c17842b70659eec26a405e11fd35fbc64baf9d1c5450ca9218fd" exitCode=0 Jul 20 09:43:36.445010 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:36.444633 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" event={"ID":"2263b494-e92e-42fc-8cde-088a879780c1","Type":"ContainerDied","Data":"a04f538c3f63c17842b70659eec26a405e11fd35fbc64baf9d1c5450ca9218fd"} Jul 20 09:43:37.575826 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:37.575798 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" Jul 20 09:43:37.622631 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:37.622606 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2263b494-e92e-42fc-8cde-088a879780c1-bundle\") pod \"2263b494-e92e-42fc-8cde-088a879780c1\" (UID: \"2263b494-e92e-42fc-8cde-088a879780c1\") " Jul 20 09:43:37.622773 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:37.622659 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2263b494-e92e-42fc-8cde-088a879780c1-util\") pod \"2263b494-e92e-42fc-8cde-088a879780c1\" (UID: \"2263b494-e92e-42fc-8cde-088a879780c1\") " Jul 20 09:43:37.622773 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:37.622699 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdv9x\" (UniqueName: \"kubernetes.io/projected/2263b494-e92e-42fc-8cde-088a879780c1-kube-api-access-mdv9x\") pod \"2263b494-e92e-42fc-8cde-088a879780c1\" (UID: \"2263b494-e92e-42fc-8cde-088a879780c1\") " Jul 20 09:43:37.623011 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:37.622984 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2263b494-e92e-42fc-8cde-088a879780c1-bundle" (OuterVolumeSpecName: "bundle") pod "2263b494-e92e-42fc-8cde-088a879780c1" (UID: "2263b494-e92e-42fc-8cde-088a879780c1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:43:37.624634 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:37.624610 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2263b494-e92e-42fc-8cde-088a879780c1-kube-api-access-mdv9x" (OuterVolumeSpecName: "kube-api-access-mdv9x") pod "2263b494-e92e-42fc-8cde-088a879780c1" (UID: "2263b494-e92e-42fc-8cde-088a879780c1"). InnerVolumeSpecName "kube-api-access-mdv9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 09:43:37.628376 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:37.628346 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2263b494-e92e-42fc-8cde-088a879780c1-util" (OuterVolumeSpecName: "util") pod "2263b494-e92e-42fc-8cde-088a879780c1" (UID: "2263b494-e92e-42fc-8cde-088a879780c1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:43:37.723692 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:37.723609 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2263b494-e92e-42fc-8cde-088a879780c1-util\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:43:37.723692 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:37.723638 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdv9x\" (UniqueName: \"kubernetes.io/projected/2263b494-e92e-42fc-8cde-088a879780c1-kube-api-access-mdv9x\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:43:37.723692 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:37.723649 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2263b494-e92e-42fc-8cde-088a879780c1-bundle\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:43:38.455309 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:38.455281 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" Jul 20 09:43:38.455482 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:38.455285 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7flvb" event={"ID":"2263b494-e92e-42fc-8cde-088a879780c1","Type":"ContainerDied","Data":"f38ee2098359169f87fe3a92e26c1fc2b383f45135c30435821241e46db2d5e3"} Jul 20 09:43:38.455482 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:38.455396 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f38ee2098359169f87fe3a92e26c1fc2b383f45135c30435821241e46db2d5e3" Jul 20 09:43:40.895274 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:40.895246 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 09:43:40.897485 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:40.897463 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 09:43:40.906048 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:40.906027 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 09:43:43.471318 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.471286 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dbgq6"] Jul 20 09:43:43.472764 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.471555 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2263b494-e92e-42fc-8cde-088a879780c1" containerName="util" Jul 20 09:43:43.472764 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.471567 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2263b494-e92e-42fc-8cde-088a879780c1" containerName="util" Jul 20 09:43:43.472764 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.471575 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2263b494-e92e-42fc-8cde-088a879780c1" containerName="pull" Jul 20 09:43:43.472764 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.471580 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2263b494-e92e-42fc-8cde-088a879780c1" containerName="pull" Jul 20 09:43:43.472764 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.471594 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2263b494-e92e-42fc-8cde-088a879780c1" containerName="extract" Jul 20 09:43:43.472764 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.471600 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2263b494-e92e-42fc-8cde-088a879780c1" containerName="extract" Jul 20 09:43:43.472764 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.471655 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2263b494-e92e-42fc-8cde-088a879780c1" containerName="extract" Jul 20 09:43:43.473266 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.473246 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dbgq6" Jul 20 09:43:43.475664 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.475626 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 20 09:43:43.475825 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.475705 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 20 09:43:43.475825 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.475715 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-pphp6\"" Jul 20 09:43:43.484375 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.484348 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dbgq6"] Jul 20 09:43:43.566948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.566918 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cefbdcc-f586-4999-913b-654d866570d5-bound-sa-token\") pod \"cert-manager-55b4d954d5-dbgq6\" (UID: \"7cefbdcc-f586-4999-913b-654d866570d5\") " pod="cert-manager/cert-manager-55b4d954d5-dbgq6" Jul 20 09:43:43.566948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.566957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9s8l\" (UniqueName: \"kubernetes.io/projected/7cefbdcc-f586-4999-913b-654d866570d5-kube-api-access-m9s8l\") pod \"cert-manager-55b4d954d5-dbgq6\" (UID: \"7cefbdcc-f586-4999-913b-654d866570d5\") " pod="cert-manager/cert-manager-55b4d954d5-dbgq6" Jul 20 09:43:43.667800 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.667760 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cefbdcc-f586-4999-913b-654d866570d5-bound-sa-token\") pod \"cert-manager-55b4d954d5-dbgq6\" (UID: \"7cefbdcc-f586-4999-913b-654d866570d5\") " pod="cert-manager/cert-manager-55b4d954d5-dbgq6" Jul 20 09:43:43.667800 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.667800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9s8l\" (UniqueName: \"kubernetes.io/projected/7cefbdcc-f586-4999-913b-654d866570d5-kube-api-access-m9s8l\") pod \"cert-manager-55b4d954d5-dbgq6\" (UID: \"7cefbdcc-f586-4999-913b-654d866570d5\") " pod="cert-manager/cert-manager-55b4d954d5-dbgq6" Jul 20 09:43:43.676727 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.676695 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cefbdcc-f586-4999-913b-654d866570d5-bound-sa-token\") pod \"cert-manager-55b4d954d5-dbgq6\" (UID: \"7cefbdcc-f586-4999-913b-654d866570d5\") " pod="cert-manager/cert-manager-55b4d954d5-dbgq6" Jul 20 09:43:43.676871 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.676809 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9s8l\" (UniqueName: \"kubernetes.io/projected/7cefbdcc-f586-4999-913b-654d866570d5-kube-api-access-m9s8l\") pod \"cert-manager-55b4d954d5-dbgq6\" (UID: \"7cefbdcc-f586-4999-913b-654d866570d5\") " pod="cert-manager/cert-manager-55b4d954d5-dbgq6" Jul 20 09:43:43.794332 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.794250 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dbgq6" Jul 20 09:43:43.926186 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.926125 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dbgq6"] Jul 20 09:43:43.929890 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:43:43.929863 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cefbdcc_f586_4999_913b_654d866570d5.slice/crio-20f39b75b89d57a1dd025fe1ff2385e356bb0aa116fa833570535b6b94b88ea1 WatchSource:0}: Error finding container 20f39b75b89d57a1dd025fe1ff2385e356bb0aa116fa833570535b6b94b88ea1: Status 404 returned error can't find the container with id 20f39b75b89d57a1dd025fe1ff2385e356bb0aa116fa833570535b6b94b88ea1 Jul 20 09:43:43.932390 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:43.932375 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 09:43:44.482593 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:44.482556 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dbgq6" event={"ID":"7cefbdcc-f586-4999-913b-654d866570d5","Type":"ContainerStarted","Data":"20f39b75b89d57a1dd025fe1ff2385e356bb0aa116fa833570535b6b94b88ea1"} Jul 20 09:43:44.514721 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:44.514688 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z5jnq"] Jul 20 09:43:44.516792 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:44.516772 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z5jnq" Jul 20 09:43:44.520496 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:44.520473 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 20 09:43:44.520758 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:44.520497 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:43:44.520758 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:44.520546 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tv2st\"" Jul 20 09:43:44.525949 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:44.525925 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z5jnq"] Jul 20 09:43:44.575521 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:44.575485 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fstdf\" (UniqueName: \"kubernetes.io/projected/2b2d75ae-a8ab-4770-9532-69d99f19d65e-kube-api-access-fstdf\") pod \"openshift-lws-operator-fd8ccff4c-z5jnq\" (UID: \"2b2d75ae-a8ab-4770-9532-69d99f19d65e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z5jnq" Jul 20 09:43:44.575710 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:44.575553 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b2d75ae-a8ab-4770-9532-69d99f19d65e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z5jnq\" (UID: \"2b2d75ae-a8ab-4770-9532-69d99f19d65e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z5jnq" Jul 20 09:43:44.676698 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:44.676655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b2d75ae-a8ab-4770-9532-69d99f19d65e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z5jnq\" (UID: \"2b2d75ae-a8ab-4770-9532-69d99f19d65e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z5jnq" Jul 20 09:43:44.676910 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:44.676750 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstdf\" (UniqueName: \"kubernetes.io/projected/2b2d75ae-a8ab-4770-9532-69d99f19d65e-kube-api-access-fstdf\") pod \"openshift-lws-operator-fd8ccff4c-z5jnq\" (UID: \"2b2d75ae-a8ab-4770-9532-69d99f19d65e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z5jnq" Jul 20 09:43:44.677085 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:44.677061 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b2d75ae-a8ab-4770-9532-69d99f19d65e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z5jnq\" (UID: \"2b2d75ae-a8ab-4770-9532-69d99f19d65e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z5jnq" Jul 20 09:43:44.685389 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:44.685355 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fstdf\" (UniqueName: \"kubernetes.io/projected/2b2d75ae-a8ab-4770-9532-69d99f19d65e-kube-api-access-fstdf\") pod \"openshift-lws-operator-fd8ccff4c-z5jnq\" (UID: \"2b2d75ae-a8ab-4770-9532-69d99f19d65e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z5jnq" Jul 20 09:43:44.829992 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:44.829951 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z5jnq" Jul 20 09:43:44.985522 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:44.985498 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z5jnq"] Jul 20 09:43:44.988137 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:43:44.988098 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b2d75ae_a8ab_4770_9532_69d99f19d65e.slice/crio-9ce6e88a9d3b9f998cebc0970ae23ead7771d257e4b707ba983df89d00b7243a WatchSource:0}: Error finding container 9ce6e88a9d3b9f998cebc0970ae23ead7771d257e4b707ba983df89d00b7243a: Status 404 returned error can't find the container with id 9ce6e88a9d3b9f998cebc0970ae23ead7771d257e4b707ba983df89d00b7243a Jul 20 09:43:45.488556 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:45.488509 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z5jnq" event={"ID":"2b2d75ae-a8ab-4770-9532-69d99f19d65e","Type":"ContainerStarted","Data":"9ce6e88a9d3b9f998cebc0970ae23ead7771d257e4b707ba983df89d00b7243a"} Jul 20 09:43:46.496336 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:46.496292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dbgq6" event={"ID":"7cefbdcc-f586-4999-913b-654d866570d5","Type":"ContainerStarted","Data":"138c79236b3ca734579c79456bb7aa4b39181cb5dde24b584649dc6415486199"} Jul 20 09:43:46.512061 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:46.511920 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-dbgq6" podStartSLOduration=1.192694941 podStartE2EDuration="3.5119003s" totalImagesPullingTime="2.319205359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:43:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:43:46.51120532 +0000 UTC m=+305.985306363" watchObservedRunningTime="2026-07-20 09:43:46.5119003 +0000 UTC m=+305.986001331" Jul 20 09:43:47.503452 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:47.503412 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z5jnq" event={"ID":"2b2d75ae-a8ab-4770-9532-69d99f19d65e","Type":"ContainerStarted","Data":"8618ab3c234e340081867ea9aa57d3c4e38d3e00133b2d8c6e83242e50ba66e8"} Jul 20 09:43:47.519346 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:47.519295 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z5jnq" podStartSLOduration=1.1905083379999999 podStartE2EDuration="3.519272681s" totalImagesPullingTime="2.328764343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:43:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:43:47.518431665 +0000 UTC m=+306.992532700" watchObservedRunningTime="2026-07-20 09:43:47.519272681 +0000 UTC m=+306.993373712" Jul 20 09:43:52.011322 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.011283 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9"] Jul 20 09:43:52.013725 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.013707 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" Jul 20 09:43:52.016249 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.016202 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p9vc8\"" Jul 20 09:43:52.016249 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.016213 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 09:43:52.017225 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.017203 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 09:43:52.024032 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.024010 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9"] Jul 20 09:43:52.138377 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.138338 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4p8b\" (UniqueName: \"kubernetes.io/projected/b70a4054-7865-463a-8c66-3cf2a0f1a458-kube-api-access-b4p8b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9\" (UID: \"b70a4054-7865-463a-8c66-3cf2a0f1a458\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" Jul 20 09:43:52.138555 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.138466 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b70a4054-7865-463a-8c66-3cf2a0f1a458-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9\" (UID: \"b70a4054-7865-463a-8c66-3cf2a0f1a458\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" Jul 20 09:43:52.138555 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.138531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b70a4054-7865-463a-8c66-3cf2a0f1a458-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9\" (UID: \"b70a4054-7865-463a-8c66-3cf2a0f1a458\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" Jul 20 09:43:52.239970 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.239931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4p8b\" (UniqueName: \"kubernetes.io/projected/b70a4054-7865-463a-8c66-3cf2a0f1a458-kube-api-access-b4p8b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9\" (UID: \"b70a4054-7865-463a-8c66-3cf2a0f1a458\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" Jul 20 09:43:52.240147 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.240006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b70a4054-7865-463a-8c66-3cf2a0f1a458-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9\" (UID: \"b70a4054-7865-463a-8c66-3cf2a0f1a458\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" Jul 20 09:43:52.240147 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.240048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b70a4054-7865-463a-8c66-3cf2a0f1a458-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9\" (UID: \"b70a4054-7865-463a-8c66-3cf2a0f1a458\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" Jul 20 09:43:52.240409 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.240387 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b70a4054-7865-463a-8c66-3cf2a0f1a458-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9\" (UID: \"b70a4054-7865-463a-8c66-3cf2a0f1a458\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" Jul 20 09:43:52.240448 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.240422 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b70a4054-7865-463a-8c66-3cf2a0f1a458-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9\" (UID: \"b70a4054-7865-463a-8c66-3cf2a0f1a458\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" Jul 20 09:43:52.248335 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.248315 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4p8b\" (UniqueName: \"kubernetes.io/projected/b70a4054-7865-463a-8c66-3cf2a0f1a458-kube-api-access-b4p8b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9\" (UID: \"b70a4054-7865-463a-8c66-3cf2a0f1a458\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" Jul 20 09:43:52.322635 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.322599 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" Jul 20 09:43:52.456838 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.456805 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9"] Jul 20 09:43:52.459901 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:43:52.459874 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70a4054_7865_463a_8c66_3cf2a0f1a458.slice/crio-62f898fec348769aaf67df679f5b274f57dbaefff8c15ba8d1d3eee109fc72d9 WatchSource:0}: Error finding container 62f898fec348769aaf67df679f5b274f57dbaefff8c15ba8d1d3eee109fc72d9: Status 404 returned error can't find the container with id 62f898fec348769aaf67df679f5b274f57dbaefff8c15ba8d1d3eee109fc72d9 Jul 20 09:43:52.528010 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.527977 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" event={"ID":"b70a4054-7865-463a-8c66-3cf2a0f1a458","Type":"ContainerStarted","Data":"5d978eec66e7cb654b2da7304347def9fde3c3662114501f23cae7c302adbaa3"} Jul 20 09:43:52.528231 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:52.528033 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" event={"ID":"b70a4054-7865-463a-8c66-3cf2a0f1a458","Type":"ContainerStarted","Data":"62f898fec348769aaf67df679f5b274f57dbaefff8c15ba8d1d3eee109fc72d9"} Jul 20 09:43:53.535247 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:53.535157 2577 generic.go:356] "Generic (PLEG): container finished" podID="b70a4054-7865-463a-8c66-3cf2a0f1a458" containerID="5d978eec66e7cb654b2da7304347def9fde3c3662114501f23cae7c302adbaa3" exitCode=0 Jul 20 09:43:53.535596 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:53.535236 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" event={"ID":"b70a4054-7865-463a-8c66-3cf2a0f1a458","Type":"ContainerDied","Data":"5d978eec66e7cb654b2da7304347def9fde3c3662114501f23cae7c302adbaa3"} Jul 20 09:43:54.541665 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:54.541574 2577 generic.go:356] "Generic (PLEG): container finished" podID="b70a4054-7865-463a-8c66-3cf2a0f1a458" containerID="48302669c80df413e81fc1eb3d05548d2cd99003c5d172de64413072aba589f7" exitCode=0 Jul 20 09:43:54.542185 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:54.541662 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" event={"ID":"b70a4054-7865-463a-8c66-3cf2a0f1a458","Type":"ContainerDied","Data":"48302669c80df413e81fc1eb3d05548d2cd99003c5d172de64413072aba589f7"} Jul 20 09:43:55.548493 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:55.548452 2577 generic.go:356] "Generic (PLEG): container finished" podID="b70a4054-7865-463a-8c66-3cf2a0f1a458" containerID="9dc9238750fed67c0f17802ed1118e9a8f62bb54bb7a5cf138c94a10a82d6811" exitCode=0 Jul 20 09:43:55.548890 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:55.548533 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" event={"ID":"b70a4054-7865-463a-8c66-3cf2a0f1a458","Type":"ContainerDied","Data":"9dc9238750fed67c0f17802ed1118e9a8f62bb54bb7a5cf138c94a10a82d6811"} Jul 20 09:43:56.679378 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:56.679353 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" Jul 20 09:43:56.781460 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:56.781424 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b70a4054-7865-463a-8c66-3cf2a0f1a458-util\") pod \"b70a4054-7865-463a-8c66-3cf2a0f1a458\" (UID: \"b70a4054-7865-463a-8c66-3cf2a0f1a458\") " Jul 20 09:43:56.781664 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:56.781481 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4p8b\" (UniqueName: \"kubernetes.io/projected/b70a4054-7865-463a-8c66-3cf2a0f1a458-kube-api-access-b4p8b\") pod \"b70a4054-7865-463a-8c66-3cf2a0f1a458\" (UID: \"b70a4054-7865-463a-8c66-3cf2a0f1a458\") " Jul 20 09:43:56.781664 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:56.781505 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b70a4054-7865-463a-8c66-3cf2a0f1a458-bundle\") pod \"b70a4054-7865-463a-8c66-3cf2a0f1a458\" (UID: \"b70a4054-7865-463a-8c66-3cf2a0f1a458\") " Jul 20 09:43:56.782371 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:56.782331 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b70a4054-7865-463a-8c66-3cf2a0f1a458-bundle" (OuterVolumeSpecName: "bundle") pod "b70a4054-7865-463a-8c66-3cf2a0f1a458" (UID: "b70a4054-7865-463a-8c66-3cf2a0f1a458"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:43:56.783646 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:56.783621 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b70a4054-7865-463a-8c66-3cf2a0f1a458-kube-api-access-b4p8b" (OuterVolumeSpecName: "kube-api-access-b4p8b") pod "b70a4054-7865-463a-8c66-3cf2a0f1a458" (UID: "b70a4054-7865-463a-8c66-3cf2a0f1a458"). InnerVolumeSpecName "kube-api-access-b4p8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 09:43:56.787397 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:56.787359 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b70a4054-7865-463a-8c66-3cf2a0f1a458-util" (OuterVolumeSpecName: "util") pod "b70a4054-7865-463a-8c66-3cf2a0f1a458" (UID: "b70a4054-7865-463a-8c66-3cf2a0f1a458"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:43:56.882054 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:56.882024 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b70a4054-7865-463a-8c66-3cf2a0f1a458-util\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:43:56.882054 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:56.882049 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4p8b\" (UniqueName: \"kubernetes.io/projected/b70a4054-7865-463a-8c66-3cf2a0f1a458-kube-api-access-b4p8b\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:43:56.882054 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:56.882060 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b70a4054-7865-463a-8c66-3cf2a0f1a458-bundle\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:43:57.559661 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:57.559626 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" Jul 20 09:43:57.559661 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:57.559650 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj26l9" event={"ID":"b70a4054-7865-463a-8c66-3cf2a0f1a458","Type":"ContainerDied","Data":"62f898fec348769aaf67df679f5b274f57dbaefff8c15ba8d1d3eee109fc72d9"} Jul 20 09:43:57.559900 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:43:57.559703 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62f898fec348769aaf67df679f5b274f57dbaefff8c15ba8d1d3eee109fc72d9" Jul 20 09:44:03.928483 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:03.928442 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj"] Jul 20 09:44:03.928901 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:03.928741 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b70a4054-7865-463a-8c66-3cf2a0f1a458" containerName="pull" Jul 20 09:44:03.928901 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:03.928753 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b70a4054-7865-463a-8c66-3cf2a0f1a458" containerName="pull" Jul 20 09:44:03.928901 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:03.928765 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b70a4054-7865-463a-8c66-3cf2a0f1a458" containerName="util" Jul 20 09:44:03.928901 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:03.928770 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b70a4054-7865-463a-8c66-3cf2a0f1a458" containerName="util" Jul 20 09:44:03.928901 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:03.928776 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b70a4054-7865-463a-8c66-3cf2a0f1a458" containerName="extract" Jul 20 09:44:03.928901 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:03.928782 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b70a4054-7865-463a-8c66-3cf2a0f1a458" containerName="extract" Jul 20 09:44:03.928901 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:03.928864 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b70a4054-7865-463a-8c66-3cf2a0f1a458" containerName="extract" Jul 20 09:44:03.932597 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:03.932574 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:03.937185 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:03.937160 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 20 09:44:03.937319 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:03.937189 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 20 09:44:03.937431 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:03.937343 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 09:44:03.937431 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:03.937344 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 09:44:03.937550 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:03.937486 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6kkln\"" Jul 20 09:44:03.960708 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:03.960678 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj"] Jul 20 09:44:04.043115 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.043085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1b34fe17-e9b2-452f-aa2f-bdcfe968a21e-manifests\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj\" (UID: \"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.043269 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.043122 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b34fe17-e9b2-452f-aa2f-bdcfe968a21e-tmp\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj\" (UID: \"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.043269 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.043150 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dmkv\" (UniqueName: \"kubernetes.io/projected/1b34fe17-e9b2-452f-aa2f-bdcfe968a21e-kube-api-access-8dmkv\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj\" (UID: \"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.043269 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.043224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b34fe17-e9b2-452f-aa2f-bdcfe968a21e-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj\" (UID: \"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.043389 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.043284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1b34fe17-e9b2-452f-aa2f-bdcfe968a21e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj\" (UID: \"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.144132 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.144095 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1b34fe17-e9b2-452f-aa2f-bdcfe968a21e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj\" (UID: \"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.144308 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.144156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1b34fe17-e9b2-452f-aa2f-bdcfe968a21e-manifests\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj\" (UID: \"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.144308 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.144279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b34fe17-e9b2-452f-aa2f-bdcfe968a21e-tmp\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj\" (UID: \"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.144397 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.144332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dmkv\" (UniqueName: \"kubernetes.io/projected/1b34fe17-e9b2-452f-aa2f-bdcfe968a21e-kube-api-access-8dmkv\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj\" (UID: \"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.144397 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.144370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b34fe17-e9b2-452f-aa2f-bdcfe968a21e-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj\" (UID: \"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.144574 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.144552 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1b34fe17-e9b2-452f-aa2f-bdcfe968a21e-manifests\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj\" (UID: \"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.146567 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.146545 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b34fe17-e9b2-452f-aa2f-bdcfe968a21e-tmp\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj\" (UID: \"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.146741 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.146722 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b34fe17-e9b2-452f-aa2f-bdcfe968a21e-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj\" (UID: \"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.146900 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.146879 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1b34fe17-e9b2-452f-aa2f-bdcfe968a21e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj\" (UID: \"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.156326 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.156300 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dmkv\" (UniqueName: \"kubernetes.io/projected/1b34fe17-e9b2-452f-aa2f-bdcfe968a21e-kube-api-access-8dmkv\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj\" (UID: \"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.243259 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.243172 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:04.383761 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.383732 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj"] Jul 20 09:44:04.385764 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:44:04.385730 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b34fe17_e9b2_452f_aa2f_bdcfe968a21e.slice/crio-9bfaa22d4596ead5b0ae3786a9dd9bb65e091332c7d36be096c79486677ae36b WatchSource:0}: Error finding container 9bfaa22d4596ead5b0ae3786a9dd9bb65e091332c7d36be096c79486677ae36b: Status 404 returned error can't find the container with id 9bfaa22d4596ead5b0ae3786a9dd9bb65e091332c7d36be096c79486677ae36b Jul 20 09:44:04.591914 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:04.591880 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" event={"ID":"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e","Type":"ContainerStarted","Data":"9bfaa22d4596ead5b0ae3786a9dd9bb65e091332c7d36be096c79486677ae36b"} Jul 20 09:44:07.611642 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:07.611600 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" event={"ID":"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e","Type":"ContainerStarted","Data":"a98a223ad41f06c90d63871d26d51d0f4cb60e16c39616c5c438a09def57b957"} Jul 20 09:44:09.623105 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:09.623067 2577 generic.go:356] "Generic (PLEG): container finished" podID="1b34fe17-e9b2-452f-aa2f-bdcfe968a21e" containerID="a98a223ad41f06c90d63871d26d51d0f4cb60e16c39616c5c438a09def57b957" exitCode=0 Jul 20 09:44:09.623590 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:09.623124 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" event={"ID":"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e","Type":"ContainerDied","Data":"a98a223ad41f06c90d63871d26d51d0f4cb60e16c39616c5c438a09def57b957"} Jul 20 09:44:10.630481 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:10.630447 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" event={"ID":"1b34fe17-e9b2-452f-aa2f-bdcfe968a21e","Type":"ContainerStarted","Data":"f3ed5d518f2551010b43e4f679fc94fe8aa3d06eccd1a5b30fe949e777186ded"} Jul 20 09:44:10.630922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:10.630674 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:10.653326 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:10.653276 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" podStartSLOduration=3.142536632 podStartE2EDuration="7.653262117s" totalImagesPullingTime="3.364525102s" totalInitContainerRuntime="1.146200383s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:44:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:44:10.651421141 +0000 UTC m=+330.125522172" watchObservedRunningTime="2026-07-20 09:44:10.653262117 +0000 UTC m=+330.127363147" Jul 20 09:44:21.637957 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:21.637924 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj" Jul 20 09:44:23.405446 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.405404 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd"] Jul 20 09:44:23.410450 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.410428 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:23.418231 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.418207 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 20 09:44:23.418343 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.418255 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 20 09:44:23.418949 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.418929 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x46x7\"" Jul 20 09:44:23.420142 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.420125 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 20 09:44:23.433879 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.433840 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd"] Jul 20 09:44:23.503286 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.503253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63beeb79-553a-473b-82ad-6a7f62b2b65a-cert\") pod \"lws-controller-manager-6d9fcc6574-7wmjd\" (UID: \"63beeb79-553a-473b-82ad-6a7f62b2b65a\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:23.503286 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.503288 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jctcp\" (UniqueName: \"kubernetes.io/projected/63beeb79-553a-473b-82ad-6a7f62b2b65a-kube-api-access-jctcp\") pod \"lws-controller-manager-6d9fcc6574-7wmjd\" (UID: \"63beeb79-553a-473b-82ad-6a7f62b2b65a\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:23.503494 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.503319 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63beeb79-553a-473b-82ad-6a7f62b2b65a-manager-config\") pod \"lws-controller-manager-6d9fcc6574-7wmjd\" (UID: \"63beeb79-553a-473b-82ad-6a7f62b2b65a\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:23.503494 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.503357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63beeb79-553a-473b-82ad-6a7f62b2b65a-metrics-cert\") pod \"lws-controller-manager-6d9fcc6574-7wmjd\" (UID: \"63beeb79-553a-473b-82ad-6a7f62b2b65a\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:23.604358 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.604322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63beeb79-553a-473b-82ad-6a7f62b2b65a-metrics-cert\") pod \"lws-controller-manager-6d9fcc6574-7wmjd\" (UID: \"63beeb79-553a-473b-82ad-6a7f62b2b65a\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:23.604556 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.604380 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63beeb79-553a-473b-82ad-6a7f62b2b65a-cert\") pod \"lws-controller-manager-6d9fcc6574-7wmjd\" (UID: \"63beeb79-553a-473b-82ad-6a7f62b2b65a\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:23.604556 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.604399 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jctcp\" (UniqueName: \"kubernetes.io/projected/63beeb79-553a-473b-82ad-6a7f62b2b65a-kube-api-access-jctcp\") pod \"lws-controller-manager-6d9fcc6574-7wmjd\" (UID: \"63beeb79-553a-473b-82ad-6a7f62b2b65a\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:23.604556 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.604420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63beeb79-553a-473b-82ad-6a7f62b2b65a-manager-config\") pod \"lws-controller-manager-6d9fcc6574-7wmjd\" (UID: \"63beeb79-553a-473b-82ad-6a7f62b2b65a\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:23.605099 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.605075 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63beeb79-553a-473b-82ad-6a7f62b2b65a-manager-config\") pod \"lws-controller-manager-6d9fcc6574-7wmjd\" (UID: \"63beeb79-553a-473b-82ad-6a7f62b2b65a\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:23.606897 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.606877 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63beeb79-553a-473b-82ad-6a7f62b2b65a-metrics-cert\") pod \"lws-controller-manager-6d9fcc6574-7wmjd\" (UID: \"63beeb79-553a-473b-82ad-6a7f62b2b65a\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:23.607002 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.606901 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63beeb79-553a-473b-82ad-6a7f62b2b65a-cert\") pod \"lws-controller-manager-6d9fcc6574-7wmjd\" (UID: \"63beeb79-553a-473b-82ad-6a7f62b2b65a\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:23.621910 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.621886 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jctcp\" (UniqueName: \"kubernetes.io/projected/63beeb79-553a-473b-82ad-6a7f62b2b65a-kube-api-access-jctcp\") pod \"lws-controller-manager-6d9fcc6574-7wmjd\" (UID: \"63beeb79-553a-473b-82ad-6a7f62b2b65a\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:23.720185 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.720073 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:23.864753 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:23.864723 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd"] Jul 20 09:44:23.867532 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:44:23.867504 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63beeb79_553a_473b_82ad_6a7f62b2b65a.slice/crio-44d0a2d1b95c1b7fe881b1b9eea8a6f2370b485b30eeed107350e8e78f1a46ef WatchSource:0}: Error finding container 44d0a2d1b95c1b7fe881b1b9eea8a6f2370b485b30eeed107350e8e78f1a46ef: Status 404 returned error can't find the container with id 44d0a2d1b95c1b7fe881b1b9eea8a6f2370b485b30eeed107350e8e78f1a46ef Jul 20 09:44:24.700924 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:24.700882 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" event={"ID":"63beeb79-553a-473b-82ad-6a7f62b2b65a","Type":"ContainerStarted","Data":"44d0a2d1b95c1b7fe881b1b9eea8a6f2370b485b30eeed107350e8e78f1a46ef"} Jul 20 09:44:25.707534 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:25.707500 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" event={"ID":"63beeb79-553a-473b-82ad-6a7f62b2b65a","Type":"ContainerStarted","Data":"61df42bd1a231282ff1aa6bdfb646834f177cdb03286081c23780d6c794f4480"} Jul 20 09:44:25.708003 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:25.707584 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:25.727413 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:25.727309 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" podStartSLOduration=1.121369876 podStartE2EDuration="2.727293225s" totalImagesPullingTime="1.605923349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:44:25.725560212 +0000 UTC m=+345.199661244" watchObservedRunningTime="2026-07-20 09:44:25.727293225 +0000 UTC m=+345.201394246" Jul 20 09:44:31.573140 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.573101 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t"] Jul 20 09:44:31.577666 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.577647 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.580547 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.580519 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rj45t\"" Jul 20 09:44:31.616687 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.616648 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 20 09:44:31.618814 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.618790 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t"] Jul 20 09:44:31.674666 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.674629 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a18c88b-396a-4e97-b010-1151901faa2b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.674832 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.674672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv4hw\" (UniqueName: \"kubernetes.io/projected/5a18c88b-396a-4e97-b010-1151901faa2b-kube-api-access-tv4hw\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.674832 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.674735 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a18c88b-396a-4e97-b010-1151901faa2b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.674832 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.674762 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a18c88b-396a-4e97-b010-1151901faa2b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.674832 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.674820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a18c88b-396a-4e97-b010-1151901faa2b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.675003 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.674881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a18c88b-396a-4e97-b010-1151901faa2b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.675003 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.674918 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a18c88b-396a-4e97-b010-1151901faa2b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.675003 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.674966 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a18c88b-396a-4e97-b010-1151901faa2b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.675003 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.674983 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a18c88b-396a-4e97-b010-1151901faa2b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.775577 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.775536 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a18c88b-396a-4e97-b010-1151901faa2b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.775577 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.775579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a18c88b-396a-4e97-b010-1151901faa2b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.775808 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.775599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a18c88b-396a-4e97-b010-1151901faa2b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.775808 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.775627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a18c88b-396a-4e97-b010-1151901faa2b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.775808 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.775678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a18c88b-396a-4e97-b010-1151901faa2b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.775808 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.775700 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a18c88b-396a-4e97-b010-1151901faa2b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.775808 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.775736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a18c88b-396a-4e97-b010-1151901faa2b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.775808 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.775767 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv4hw\" (UniqueName: \"kubernetes.io/projected/5a18c88b-396a-4e97-b010-1151901faa2b-kube-api-access-tv4hw\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.776137 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.775814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a18c88b-396a-4e97-b010-1151901faa2b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.776137 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.776112 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a18c88b-396a-4e97-b010-1151901faa2b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.776281 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.776260 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a18c88b-396a-4e97-b010-1151901faa2b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.776340 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.776289 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a18c88b-396a-4e97-b010-1151901faa2b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.776389 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.776370 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a18c88b-396a-4e97-b010-1151901faa2b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.776615 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.776590 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a18c88b-396a-4e97-b010-1151901faa2b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.778026 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.777998 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a18c88b-396a-4e97-b010-1151901faa2b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.778270 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.778251 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a18c88b-396a-4e97-b010-1151901faa2b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.802868 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.802811 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a18c88b-396a-4e97-b010-1151901faa2b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.811666 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.811641 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv4hw\" (UniqueName: \"kubernetes.io/projected/5a18c88b-396a-4e97-b010-1151901faa2b-kube-api-access-tv4hw\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpr6t\" (UID: \"5a18c88b-396a-4e97-b010-1151901faa2b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:31.887295 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:31.887218 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:32.036568 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.036541 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t"] Jul 20 09:44:32.038174 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:44:32.038149 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a18c88b_396a_4e97_b010_1151901faa2b.slice/crio-dfe5369c15152c24634732e453416c74486f8f5b89be2c56eb14bfa606ee66cc WatchSource:0}: Error finding container dfe5369c15152c24634732e453416c74486f8f5b89be2c56eb14bfa606ee66cc: Status 404 returned error can't find the container with id dfe5369c15152c24634732e453416c74486f8f5b89be2c56eb14bfa606ee66cc Jul 20 09:44:32.240525 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.240445 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4"] Jul 20 09:44:32.244936 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.244919 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.249489 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.249467 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 20 09:44:32.254213 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.254180 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-924jw\"" Jul 20 09:44:32.260528 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.260483 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 20 09:44:32.264733 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.264704 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 20 09:44:32.265544 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.265515 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4"] Jul 20 09:44:32.380859 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.380814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f08a686-fc59-4907-8208-7f3cabb5da3c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.381035 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.380877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1f08a686-fc59-4907-8208-7f3cabb5da3c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.381035 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.380901 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhq78\" (UniqueName: \"kubernetes.io/projected/1f08a686-fc59-4907-8208-7f3cabb5da3c-kube-api-access-dhq78\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.381035 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.380920 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f08a686-fc59-4907-8208-7f3cabb5da3c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.381035 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.380943 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1f08a686-fc59-4907-8208-7f3cabb5da3c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.381221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.381044 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1f08a686-fc59-4907-8208-7f3cabb5da3c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.381221 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.381122 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f08a686-fc59-4907-8208-7f3cabb5da3c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.482595 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.482558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f08a686-fc59-4907-8208-7f3cabb5da3c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.482595 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.482602 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1f08a686-fc59-4907-8208-7f3cabb5da3c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.482886 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.482627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhq78\" (UniqueName: \"kubernetes.io/projected/1f08a686-fc59-4907-8208-7f3cabb5da3c-kube-api-access-dhq78\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.482886 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.482653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f08a686-fc59-4907-8208-7f3cabb5da3c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.482886 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.482684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1f08a686-fc59-4907-8208-7f3cabb5da3c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.482886 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.482773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1f08a686-fc59-4907-8208-7f3cabb5da3c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.482886 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.482795 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f08a686-fc59-4907-8208-7f3cabb5da3c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.483661 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.483625 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1f08a686-fc59-4907-8208-7f3cabb5da3c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.485058 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.485036 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f08a686-fc59-4907-8208-7f3cabb5da3c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.485230 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.485211 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f08a686-fc59-4907-8208-7f3cabb5da3c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.485394 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.485374 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1f08a686-fc59-4907-8208-7f3cabb5da3c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.485448 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.485404 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1f08a686-fc59-4907-8208-7f3cabb5da3c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.492356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.492289 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhq78\" (UniqueName: \"kubernetes.io/projected/1f08a686-fc59-4907-8208-7f3cabb5da3c-kube-api-access-dhq78\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.492692 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.492670 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f08a686-fc59-4907-8208-7f3cabb5da3c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tf6k4\" (UID: \"1f08a686-fc59-4907-8208-7f3cabb5da3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.556267 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.556225 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:32.713681 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.713646 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4"] Jul 20 09:44:32.715215 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:44:32.715172 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f08a686_fc59_4907_8208_7f3cabb5da3c.slice/crio-af6c686e1638f3cb6d198fb3e5bfba5e6791b67158ce78c927ca0c93be24a681 WatchSource:0}: Error finding container af6c686e1638f3cb6d198fb3e5bfba5e6791b67158ce78c927ca0c93be24a681: Status 404 returned error can't find the container with id af6c686e1638f3cb6d198fb3e5bfba5e6791b67158ce78c927ca0c93be24a681 Jul 20 09:44:32.743463 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.743362 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" event={"ID":"5a18c88b-396a-4e97-b010-1151901faa2b","Type":"ContainerStarted","Data":"dfe5369c15152c24634732e453416c74486f8f5b89be2c56eb14bfa606ee66cc"} Jul 20 09:44:32.744914 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:32.744886 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" event={"ID":"1f08a686-fc59-4907-8208-7f3cabb5da3c","Type":"ContainerStarted","Data":"af6c686e1638f3cb6d198fb3e5bfba5e6791b67158ce78c927ca0c93be24a681"} Jul 20 09:44:35.579774 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:35.579702 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 09:44:35.580142 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:35.579798 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 09:44:35.580142 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:35.579830 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 09:44:35.581384 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:35.581347 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 09:44:35.581482 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:35.581414 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 09:44:35.765993 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:35.765946 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" event={"ID":"1f08a686-fc59-4907-8208-7f3cabb5da3c","Type":"ContainerStarted","Data":"f8cb4267c7ea64468290e4298977f976ae53b4512e6ee9e75b7dad4bfa1228b5"} Jul 20 09:44:35.766194 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:35.766173 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:35.768156 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:35.768122 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" event={"ID":"5a18c88b-396a-4e97-b010-1151901faa2b","Type":"ContainerStarted","Data":"128f0ccdfc51c8f1b5912802ed09f49c97ac3c647714f422af3c6b4fec9ceeab"} Jul 20 09:44:35.840717 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:35.840612 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" podStartSLOduration=0.977714545 podStartE2EDuration="3.840593318s" totalImagesPullingTime="2.862878773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:44:35.837713578 +0000 UTC m=+355.311814619" watchObservedRunningTime="2026-07-20 09:44:35.840593318 +0000 UTC m=+355.314694349" Jul 20 09:44:35.883369 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:35.883312 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" podStartSLOduration=1.3439758880000001 podStartE2EDuration="4.883295186s" totalImagesPullingTime="3.539319298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:44:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:44:35.881918317 +0000 UTC m=+355.356019349" watchObservedRunningTime="2026-07-20 09:44:35.883295186 +0000 UTC m=+355.357396216" Jul 20 09:44:35.887925 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:35.887899 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:36.714703 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:36.714674 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-7wmjd" Jul 20 09:44:36.775697 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:36.775666 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tf6k4" Jul 20 09:44:36.892067 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:36.892034 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:37.779022 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:37.778981 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:44:37.779924 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:44:37.779905 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpr6t" Jul 20 09:45:40.340504 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.340463 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86"] Jul 20 09:45:40.343063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.343047 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" Jul 20 09:45:40.345587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.345555 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 20 09:45:40.345743 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.345687 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 20 09:45:40.346464 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.346447 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6tgfg\"" Jul 20 09:45:40.351820 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.351799 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86"] Jul 20 09:45:40.451245 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.451211 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03fc3694-f582-4e91-87c2-63fbc41d839f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86\" (UID: \"03fc3694-f582-4e91-87c2-63fbc41d839f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" Jul 20 09:45:40.451245 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.451255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03fc3694-f582-4e91-87c2-63fbc41d839f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86\" (UID: \"03fc3694-f582-4e91-87c2-63fbc41d839f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" Jul 20 09:45:40.451455 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.451310 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8mm5\" (UniqueName: \"kubernetes.io/projected/03fc3694-f582-4e91-87c2-63fbc41d839f-kube-api-access-v8mm5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86\" (UID: \"03fc3694-f582-4e91-87c2-63fbc41d839f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" Jul 20 09:45:40.552420 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.552378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8mm5\" (UniqueName: \"kubernetes.io/projected/03fc3694-f582-4e91-87c2-63fbc41d839f-kube-api-access-v8mm5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86\" (UID: \"03fc3694-f582-4e91-87c2-63fbc41d839f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" Jul 20 09:45:40.552588 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.552482 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03fc3694-f582-4e91-87c2-63fbc41d839f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86\" (UID: \"03fc3694-f582-4e91-87c2-63fbc41d839f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" Jul 20 09:45:40.552588 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.552521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03fc3694-f582-4e91-87c2-63fbc41d839f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86\" (UID: \"03fc3694-f582-4e91-87c2-63fbc41d839f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" Jul 20 09:45:40.552903 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.552882 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03fc3694-f582-4e91-87c2-63fbc41d839f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86\" (UID: \"03fc3694-f582-4e91-87c2-63fbc41d839f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" Jul 20 09:45:40.552955 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.552926 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03fc3694-f582-4e91-87c2-63fbc41d839f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86\" (UID: \"03fc3694-f582-4e91-87c2-63fbc41d839f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" Jul 20 09:45:40.561668 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.561642 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8mm5\" (UniqueName: \"kubernetes.io/projected/03fc3694-f582-4e91-87c2-63fbc41d839f-kube-api-access-v8mm5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86\" (UID: \"03fc3694-f582-4e91-87c2-63fbc41d839f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" Jul 20 09:45:40.653203 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.653110 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" Jul 20 09:45:40.787784 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.787756 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86"] Jul 20 09:45:40.790184 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:45:40.790157 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03fc3694_f582_4e91_87c2_63fbc41d839f.slice/crio-65ed9e328c7e69108983d13e67adf65e11d8744d98907c5293bad82b636b6dd9 WatchSource:0}: Error finding container 65ed9e328c7e69108983d13e67adf65e11d8744d98907c5293bad82b636b6dd9: Status 404 returned error can't find the container with id 65ed9e328c7e69108983d13e67adf65e11d8744d98907c5293bad82b636b6dd9 Jul 20 09:45:40.937262 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.937187 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8"] Jul 20 09:45:40.939932 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.939912 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" Jul 20 09:45:40.950200 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:40.950165 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8"] Jul 20 09:45:41.056331 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.056301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f542e940-b3dc-447f-84c4-9593932c5dcc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8\" (UID: \"f542e940-b3dc-447f-84c4-9593932c5dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" Jul 20 09:45:41.056504 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.056338 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29ddj\" (UniqueName: \"kubernetes.io/projected/f542e940-b3dc-447f-84c4-9593932c5dcc-kube-api-access-29ddj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8\" (UID: \"f542e940-b3dc-447f-84c4-9593932c5dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" Jul 20 09:45:41.056504 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.056362 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f542e940-b3dc-447f-84c4-9593932c5dcc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8\" (UID: \"f542e940-b3dc-447f-84c4-9593932c5dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" Jul 20 09:45:41.080434 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.080396 2577 generic.go:356] "Generic (PLEG): container finished" podID="03fc3694-f582-4e91-87c2-63fbc41d839f" containerID="e46c975b415bac7e79d569ff0d34a103e4e90ae69a78c490c529d0f5cd058ef0" exitCode=0 Jul 20 09:45:41.080598 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.080439 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" event={"ID":"03fc3694-f582-4e91-87c2-63fbc41d839f","Type":"ContainerDied","Data":"e46c975b415bac7e79d569ff0d34a103e4e90ae69a78c490c529d0f5cd058ef0"} Jul 20 09:45:41.080598 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.080497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" event={"ID":"03fc3694-f582-4e91-87c2-63fbc41d839f","Type":"ContainerStarted","Data":"65ed9e328c7e69108983d13e67adf65e11d8744d98907c5293bad82b636b6dd9"} Jul 20 09:45:41.157537 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.157506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f542e940-b3dc-447f-84c4-9593932c5dcc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8\" (UID: \"f542e940-b3dc-447f-84c4-9593932c5dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" Jul 20 09:45:41.157737 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.157547 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29ddj\" (UniqueName: \"kubernetes.io/projected/f542e940-b3dc-447f-84c4-9593932c5dcc-kube-api-access-29ddj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8\" (UID: \"f542e940-b3dc-447f-84c4-9593932c5dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" Jul 20 09:45:41.157737 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.157570 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f542e940-b3dc-447f-84c4-9593932c5dcc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8\" (UID: \"f542e940-b3dc-447f-84c4-9593932c5dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" Jul 20 09:45:41.157939 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.157917 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f542e940-b3dc-447f-84c4-9593932c5dcc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8\" (UID: \"f542e940-b3dc-447f-84c4-9593932c5dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" Jul 20 09:45:41.158004 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.157966 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f542e940-b3dc-447f-84c4-9593932c5dcc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8\" (UID: \"f542e940-b3dc-447f-84c4-9593932c5dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" Jul 20 09:45:41.167495 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.167474 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29ddj\" (UniqueName: \"kubernetes.io/projected/f542e940-b3dc-447f-84c4-9593932c5dcc-kube-api-access-29ddj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8\" (UID: \"f542e940-b3dc-447f-84c4-9593932c5dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" Jul 20 09:45:41.256220 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.256135 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" Jul 20 09:45:41.337680 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.337640 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25"] Jul 20 09:45:41.340923 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.340900 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" Jul 20 09:45:41.351028 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.350539 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25"] Jul 20 09:45:41.358580 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.358536 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgnp2\" (UniqueName: \"kubernetes.io/projected/fa723aba-83e1-4a7a-986c-e9eff546922d-kube-api-access-wgnp2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25\" (UID: \"fa723aba-83e1-4a7a-986c-e9eff546922d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" Jul 20 09:45:41.358702 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.358622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa723aba-83e1-4a7a-986c-e9eff546922d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25\" (UID: \"fa723aba-83e1-4a7a-986c-e9eff546922d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" Jul 20 09:45:41.358702 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.358655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa723aba-83e1-4a7a-986c-e9eff546922d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25\" (UID: \"fa723aba-83e1-4a7a-986c-e9eff546922d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" Jul 20 09:45:41.391055 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.391034 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8"] Jul 20 09:45:41.393171 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:45:41.393142 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf542e940_b3dc_447f_84c4_9593932c5dcc.slice/crio-6d289495343f79d5732bcc7ef5b2e29bc905f170829d3bb47ffaec193e743354 WatchSource:0}: Error finding container 6d289495343f79d5732bcc7ef5b2e29bc905f170829d3bb47ffaec193e743354: Status 404 returned error can't find the container with id 6d289495343f79d5732bcc7ef5b2e29bc905f170829d3bb47ffaec193e743354 Jul 20 09:45:41.459297 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.459273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa723aba-83e1-4a7a-986c-e9eff546922d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25\" (UID: \"fa723aba-83e1-4a7a-986c-e9eff546922d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" Jul 20 09:45:41.459407 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.459325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa723aba-83e1-4a7a-986c-e9eff546922d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25\" (UID: \"fa723aba-83e1-4a7a-986c-e9eff546922d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" Jul 20 09:45:41.459407 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.459376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgnp2\" (UniqueName: \"kubernetes.io/projected/fa723aba-83e1-4a7a-986c-e9eff546922d-kube-api-access-wgnp2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25\" (UID: \"fa723aba-83e1-4a7a-986c-e9eff546922d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" Jul 20 09:45:41.459673 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.459651 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa723aba-83e1-4a7a-986c-e9eff546922d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25\" (UID: \"fa723aba-83e1-4a7a-986c-e9eff546922d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" Jul 20 09:45:41.459819 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.459796 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa723aba-83e1-4a7a-986c-e9eff546922d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25\" (UID: \"fa723aba-83e1-4a7a-986c-e9eff546922d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" Jul 20 09:45:41.467497 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.467476 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgnp2\" (UniqueName: \"kubernetes.io/projected/fa723aba-83e1-4a7a-986c-e9eff546922d-kube-api-access-wgnp2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25\" (UID: \"fa723aba-83e1-4a7a-986c-e9eff546922d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" Jul 20 09:45:41.653051 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.653023 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" Jul 20 09:45:41.734609 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.734544 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx"] Jul 20 09:45:41.737727 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.737704 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" Jul 20 09:45:41.748783 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.748748 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx"] Jul 20 09:45:41.761994 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.761960 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx\" (UID: \"b160ad9c-1db8-4b3b-afcb-91697bf4c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" Jul 20 09:45:41.762167 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.762098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx\" (UID: \"b160ad9c-1db8-4b3b-afcb-91697bf4c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" Jul 20 09:45:41.762167 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.762130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp7fx\" (UniqueName: \"kubernetes.io/projected/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-kube-api-access-fp7fx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx\" (UID: \"b160ad9c-1db8-4b3b-afcb-91697bf4c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" Jul 20 09:45:41.798735 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.798707 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25"] Jul 20 09:45:41.834204 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:45:41.834123 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa723aba_83e1_4a7a_986c_e9eff546922d.slice/crio-c45455b59df595e9ad8d4a495b33807123ab8272b600eb4ecb7ac766c59810c9 WatchSource:0}: Error finding container c45455b59df595e9ad8d4a495b33807123ab8272b600eb4ecb7ac766c59810c9: Status 404 returned error can't find the container with id c45455b59df595e9ad8d4a495b33807123ab8272b600eb4ecb7ac766c59810c9 Jul 20 09:45:41.862982 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.862824 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx\" (UID: \"b160ad9c-1db8-4b3b-afcb-91697bf4c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" Jul 20 09:45:41.862982 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.862956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx\" (UID: \"b160ad9c-1db8-4b3b-afcb-91697bf4c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" Jul 20 09:45:41.863118 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.862989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp7fx\" (UniqueName: \"kubernetes.io/projected/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-kube-api-access-fp7fx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx\" (UID: \"b160ad9c-1db8-4b3b-afcb-91697bf4c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" Jul 20 09:45:41.863446 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.863367 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx\" (UID: \"b160ad9c-1db8-4b3b-afcb-91697bf4c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" Jul 20 09:45:41.863446 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.863422 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx\" (UID: \"b160ad9c-1db8-4b3b-afcb-91697bf4c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" Jul 20 09:45:41.871995 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:41.871973 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp7fx\" (UniqueName: \"kubernetes.io/projected/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-kube-api-access-fp7fx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx\" (UID: \"b160ad9c-1db8-4b3b-afcb-91697bf4c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" Jul 20 09:45:42.052362 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:42.052333 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" Jul 20 09:45:42.087888 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:42.087781 2577 generic.go:356] "Generic (PLEG): container finished" podID="03fc3694-f582-4e91-87c2-63fbc41d839f" containerID="16d3b9d0b79e279a6bd0f08a887d1045c35089cd9a993bf2d3f0e4c93d642f23" exitCode=0 Jul 20 09:45:42.087888 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:42.087875 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" event={"ID":"03fc3694-f582-4e91-87c2-63fbc41d839f","Type":"ContainerDied","Data":"16d3b9d0b79e279a6bd0f08a887d1045c35089cd9a993bf2d3f0e4c93d642f23"} Jul 20 09:45:42.089656 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:42.089566 2577 generic.go:356] "Generic (PLEG): container finished" podID="f542e940-b3dc-447f-84c4-9593932c5dcc" containerID="ae48f353237f47c5569c8019ca93d43f2e065ad7f6b56c37219b990389cdb1aa" exitCode=0 Jul 20 09:45:42.089729 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:42.089679 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" event={"ID":"f542e940-b3dc-447f-84c4-9593932c5dcc","Type":"ContainerDied","Data":"ae48f353237f47c5569c8019ca93d43f2e065ad7f6b56c37219b990389cdb1aa"} Jul 20 09:45:42.089790 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:42.089731 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" event={"ID":"f542e940-b3dc-447f-84c4-9593932c5dcc","Type":"ContainerStarted","Data":"6d289495343f79d5732bcc7ef5b2e29bc905f170829d3bb47ffaec193e743354"} Jul 20 09:45:42.091451 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:42.091425 2577 generic.go:356] "Generic (PLEG): container finished" podID="fa723aba-83e1-4a7a-986c-e9eff546922d" containerID="b9b5da3e99a25a6ffdc3f8abef19cf99ce8df7e77cbd3a5efcea44e4f66b2999" exitCode=0 Jul 20 09:45:42.091563 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:42.091478 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" event={"ID":"fa723aba-83e1-4a7a-986c-e9eff546922d","Type":"ContainerDied","Data":"b9b5da3e99a25a6ffdc3f8abef19cf99ce8df7e77cbd3a5efcea44e4f66b2999"} Jul 20 09:45:42.091563 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:42.091537 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" event={"ID":"fa723aba-83e1-4a7a-986c-e9eff546922d","Type":"ContainerStarted","Data":"c45455b59df595e9ad8d4a495b33807123ab8272b600eb4ecb7ac766c59810c9"} Jul 20 09:45:42.193263 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:42.193236 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx"] Jul 20 09:45:42.194692 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:45:42.194671 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb160ad9c_1db8_4b3b_afcb_91697bf4c24f.slice/crio-b9c7838bd682aa204a1b6159653a9578fff804ac42e462a0448745e3e178e084 WatchSource:0}: Error finding container b9c7838bd682aa204a1b6159653a9578fff804ac42e462a0448745e3e178e084: Status 404 returned error can't find the container with id b9c7838bd682aa204a1b6159653a9578fff804ac42e462a0448745e3e178e084 Jul 20 09:45:43.098826 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:43.098793 2577 generic.go:356] "Generic (PLEG): container finished" podID="b160ad9c-1db8-4b3b-afcb-91697bf4c24f" containerID="107af9fab17a284654c288b1b6a3516a7ef872e261a423de4bb6d0edecc045dd" exitCode=0 Jul 20 09:45:43.099212 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:43.098870 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" event={"ID":"b160ad9c-1db8-4b3b-afcb-91697bf4c24f","Type":"ContainerDied","Data":"107af9fab17a284654c288b1b6a3516a7ef872e261a423de4bb6d0edecc045dd"} Jul 20 09:45:43.099212 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:43.098966 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" event={"ID":"b160ad9c-1db8-4b3b-afcb-91697bf4c24f","Type":"ContainerStarted","Data":"b9c7838bd682aa204a1b6159653a9578fff804ac42e462a0448745e3e178e084"} Jul 20 09:45:43.101557 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:43.101529 2577 generic.go:356] "Generic (PLEG): container finished" podID="03fc3694-f582-4e91-87c2-63fbc41d839f" containerID="fa3f43be33429eb32f1d135c7e5bb58537fc2b18ed94c5ebbac806ed9ad08ced" exitCode=0 Jul 20 09:45:43.101658 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:43.101616 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" event={"ID":"03fc3694-f582-4e91-87c2-63fbc41d839f","Type":"ContainerDied","Data":"fa3f43be33429eb32f1d135c7e5bb58537fc2b18ed94c5ebbac806ed9ad08ced"} Jul 20 09:45:43.103440 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:43.103414 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" event={"ID":"f542e940-b3dc-447f-84c4-9593932c5dcc","Type":"ContainerStarted","Data":"1a5814d83d144a3103aa7830a6b526cfb200211875391a406bf93790ac5e0586"} Jul 20 09:45:44.110788 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.110757 2577 generic.go:356] "Generic (PLEG): container finished" podID="f542e940-b3dc-447f-84c4-9593932c5dcc" containerID="1a5814d83d144a3103aa7830a6b526cfb200211875391a406bf93790ac5e0586" exitCode=0 Jul 20 09:45:44.111201 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.110885 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" event={"ID":"f542e940-b3dc-447f-84c4-9593932c5dcc","Type":"ContainerDied","Data":"1a5814d83d144a3103aa7830a6b526cfb200211875391a406bf93790ac5e0586"} Jul 20 09:45:44.112894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.112874 2577 generic.go:356] "Generic (PLEG): container finished" podID="fa723aba-83e1-4a7a-986c-e9eff546922d" containerID="753f2c74bdb20778fa054dc515118b7c6feeafaf8758efacbe98c27b1db04679" exitCode=0 Jul 20 09:45:44.113005 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.112959 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" event={"ID":"fa723aba-83e1-4a7a-986c-e9eff546922d","Type":"ContainerDied","Data":"753f2c74bdb20778fa054dc515118b7c6feeafaf8758efacbe98c27b1db04679"} Jul 20 09:45:44.114880 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.114861 2577 generic.go:356] "Generic (PLEG): container finished" podID="b160ad9c-1db8-4b3b-afcb-91697bf4c24f" containerID="c3e98c4702925d5bc367779ebb7e576d52c2ba93f85af25c2a9cb7ce9dfa1478" exitCode=0 Jul 20 09:45:44.115012 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.114920 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" event={"ID":"b160ad9c-1db8-4b3b-afcb-91697bf4c24f","Type":"ContainerDied","Data":"c3e98c4702925d5bc367779ebb7e576d52c2ba93f85af25c2a9cb7ce9dfa1478"} Jul 20 09:45:44.293881 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.293784 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" Jul 20 09:45:44.384948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.384919 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03fc3694-f582-4e91-87c2-63fbc41d839f-util\") pod \"03fc3694-f582-4e91-87c2-63fbc41d839f\" (UID: \"03fc3694-f582-4e91-87c2-63fbc41d839f\") " Jul 20 09:45:44.385069 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.385055 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03fc3694-f582-4e91-87c2-63fbc41d839f-bundle\") pod \"03fc3694-f582-4e91-87c2-63fbc41d839f\" (UID: \"03fc3694-f582-4e91-87c2-63fbc41d839f\") " Jul 20 09:45:44.385144 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.385089 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8mm5\" (UniqueName: \"kubernetes.io/projected/03fc3694-f582-4e91-87c2-63fbc41d839f-kube-api-access-v8mm5\") pod \"03fc3694-f582-4e91-87c2-63fbc41d839f\" (UID: \"03fc3694-f582-4e91-87c2-63fbc41d839f\") " Jul 20 09:45:44.385491 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.385468 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03fc3694-f582-4e91-87c2-63fbc41d839f-bundle" (OuterVolumeSpecName: "bundle") pod "03fc3694-f582-4e91-87c2-63fbc41d839f" (UID: "03fc3694-f582-4e91-87c2-63fbc41d839f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:45:44.387164 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.387135 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03fc3694-f582-4e91-87c2-63fbc41d839f-kube-api-access-v8mm5" (OuterVolumeSpecName: "kube-api-access-v8mm5") pod "03fc3694-f582-4e91-87c2-63fbc41d839f" (UID: "03fc3694-f582-4e91-87c2-63fbc41d839f"). InnerVolumeSpecName "kube-api-access-v8mm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 09:45:44.390976 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.390944 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03fc3694-f582-4e91-87c2-63fbc41d839f-util" (OuterVolumeSpecName: "util") pod "03fc3694-f582-4e91-87c2-63fbc41d839f" (UID: "03fc3694-f582-4e91-87c2-63fbc41d839f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:45:44.485877 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.485783 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03fc3694-f582-4e91-87c2-63fbc41d839f-util\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:45:44.485877 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.485808 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03fc3694-f582-4e91-87c2-63fbc41d839f-bundle\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:45:44.485877 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:44.485818 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8mm5\" (UniqueName: \"kubernetes.io/projected/03fc3694-f582-4e91-87c2-63fbc41d839f-kube-api-access-v8mm5\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:45:45.122197 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:45.122156 2577 generic.go:356] "Generic (PLEG): container finished" podID="f542e940-b3dc-447f-84c4-9593932c5dcc" containerID="f87797efc8c401bfd4d466f6db17f4627b8b2480ec488e6230a9ddc721d51251" exitCode=0 Jul 20 09:45:45.122640 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:45.122202 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" event={"ID":"f542e940-b3dc-447f-84c4-9593932c5dcc","Type":"ContainerDied","Data":"f87797efc8c401bfd4d466f6db17f4627b8b2480ec488e6230a9ddc721d51251"} Jul 20 09:45:45.124462 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:45.124434 2577 generic.go:356] "Generic (PLEG): container finished" podID="fa723aba-83e1-4a7a-986c-e9eff546922d" containerID="9bedc9c8ccf999d64111a1eb7204c7c7af515d7e366d20065fab1ca67ef5f928" exitCode=0 Jul 20 09:45:45.124583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:45.124516 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" event={"ID":"fa723aba-83e1-4a7a-986c-e9eff546922d","Type":"ContainerDied","Data":"9bedc9c8ccf999d64111a1eb7204c7c7af515d7e366d20065fab1ca67ef5f928"} Jul 20 09:45:45.126555 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:45.126533 2577 generic.go:356] "Generic (PLEG): container finished" podID="b160ad9c-1db8-4b3b-afcb-91697bf4c24f" containerID="60639cfe87cb28933d366090ad88035b9a51be87d205c4eeb7c6417b75074223" exitCode=0 Jul 20 09:45:45.126715 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:45.126615 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" event={"ID":"b160ad9c-1db8-4b3b-afcb-91697bf4c24f","Type":"ContainerDied","Data":"60639cfe87cb28933d366090ad88035b9a51be87d205c4eeb7c6417b75074223"} Jul 20 09:45:45.128438 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:45.128416 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" event={"ID":"03fc3694-f582-4e91-87c2-63fbc41d839f","Type":"ContainerDied","Data":"65ed9e328c7e69108983d13e67adf65e11d8744d98907c5293bad82b636b6dd9"} Jul 20 09:45:45.128527 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:45.128456 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65ed9e328c7e69108983d13e67adf65e11d8744d98907c5293bad82b636b6dd9" Jul 20 09:45:45.128527 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:45.128458 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86" Jul 20 09:45:46.312188 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.312159 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" Jul 20 09:45:46.320301 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.320279 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" Jul 20 09:45:46.322971 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.322950 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" Jul 20 09:45:46.403862 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.403770 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa723aba-83e1-4a7a-986c-e9eff546922d-util\") pod \"fa723aba-83e1-4a7a-986c-e9eff546922d\" (UID: \"fa723aba-83e1-4a7a-986c-e9eff546922d\") " Jul 20 09:45:46.403862 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.403832 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f542e940-b3dc-447f-84c4-9593932c5dcc-util\") pod \"f542e940-b3dc-447f-84c4-9593932c5dcc\" (UID: \"f542e940-b3dc-447f-84c4-9593932c5dcc\") " Jul 20 09:45:46.404084 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.403869 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-util\") pod \"b160ad9c-1db8-4b3b-afcb-91697bf4c24f\" (UID: \"b160ad9c-1db8-4b3b-afcb-91697bf4c24f\") " Jul 20 09:45:46.404084 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.403938 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-bundle\") pod \"b160ad9c-1db8-4b3b-afcb-91697bf4c24f\" (UID: \"b160ad9c-1db8-4b3b-afcb-91697bf4c24f\") " Jul 20 09:45:46.404084 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.403967 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp7fx\" (UniqueName: \"kubernetes.io/projected/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-kube-api-access-fp7fx\") pod \"b160ad9c-1db8-4b3b-afcb-91697bf4c24f\" (UID: \"b160ad9c-1db8-4b3b-afcb-91697bf4c24f\") " Jul 20 09:45:46.404084 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.403991 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f542e940-b3dc-447f-84c4-9593932c5dcc-bundle\") pod \"f542e940-b3dc-447f-84c4-9593932c5dcc\" (UID: \"f542e940-b3dc-447f-84c4-9593932c5dcc\") " Jul 20 09:45:46.404084 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.404011 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa723aba-83e1-4a7a-986c-e9eff546922d-bundle\") pod \"fa723aba-83e1-4a7a-986c-e9eff546922d\" (UID: \"fa723aba-83e1-4a7a-986c-e9eff546922d\") " Jul 20 09:45:46.404084 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.404042 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgnp2\" (UniqueName: \"kubernetes.io/projected/fa723aba-83e1-4a7a-986c-e9eff546922d-kube-api-access-wgnp2\") pod \"fa723aba-83e1-4a7a-986c-e9eff546922d\" (UID: \"fa723aba-83e1-4a7a-986c-e9eff546922d\") " Jul 20 09:45:46.404084 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.404073 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29ddj\" (UniqueName: \"kubernetes.io/projected/f542e940-b3dc-447f-84c4-9593932c5dcc-kube-api-access-29ddj\") pod \"f542e940-b3dc-447f-84c4-9593932c5dcc\" (UID: \"f542e940-b3dc-447f-84c4-9593932c5dcc\") " Jul 20 09:45:46.405397 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.405124 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f542e940-b3dc-447f-84c4-9593932c5dcc-bundle" (OuterVolumeSpecName: "bundle") pod "f542e940-b3dc-447f-84c4-9593932c5dcc" (UID: "f542e940-b3dc-447f-84c4-9593932c5dcc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:45:46.405666 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.405639 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-bundle" (OuterVolumeSpecName: "bundle") pod "b160ad9c-1db8-4b3b-afcb-91697bf4c24f" (UID: "b160ad9c-1db8-4b3b-afcb-91697bf4c24f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:45:46.405773 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.405710 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa723aba-83e1-4a7a-986c-e9eff546922d-bundle" (OuterVolumeSpecName: "bundle") pod "fa723aba-83e1-4a7a-986c-e9eff546922d" (UID: "fa723aba-83e1-4a7a-986c-e9eff546922d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:45:46.407109 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.407081 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-kube-api-access-fp7fx" (OuterVolumeSpecName: "kube-api-access-fp7fx") pod "b160ad9c-1db8-4b3b-afcb-91697bf4c24f" (UID: "b160ad9c-1db8-4b3b-afcb-91697bf4c24f"). InnerVolumeSpecName "kube-api-access-fp7fx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 09:45:46.407614 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.407590 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f542e940-b3dc-447f-84c4-9593932c5dcc-kube-api-access-29ddj" (OuterVolumeSpecName: "kube-api-access-29ddj") pod "f542e940-b3dc-447f-84c4-9593932c5dcc" (UID: "f542e940-b3dc-447f-84c4-9593932c5dcc"). InnerVolumeSpecName "kube-api-access-29ddj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 09:45:46.407953 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.407922 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa723aba-83e1-4a7a-986c-e9eff546922d-kube-api-access-wgnp2" (OuterVolumeSpecName: "kube-api-access-wgnp2") pod "fa723aba-83e1-4a7a-986c-e9eff546922d" (UID: "fa723aba-83e1-4a7a-986c-e9eff546922d"). InnerVolumeSpecName "kube-api-access-wgnp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 09:45:46.411145 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.411116 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f542e940-b3dc-447f-84c4-9593932c5dcc-util" (OuterVolumeSpecName: "util") pod "f542e940-b3dc-447f-84c4-9593932c5dcc" (UID: "f542e940-b3dc-447f-84c4-9593932c5dcc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:45:46.411488 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.411465 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa723aba-83e1-4a7a-986c-e9eff546922d-util" (OuterVolumeSpecName: "util") pod "fa723aba-83e1-4a7a-986c-e9eff546922d" (UID: "fa723aba-83e1-4a7a-986c-e9eff546922d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:45:46.412222 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.412199 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-util" (OuterVolumeSpecName: "util") pod "b160ad9c-1db8-4b3b-afcb-91697bf4c24f" (UID: "b160ad9c-1db8-4b3b-afcb-91697bf4c24f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:45:46.504709 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.504672 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa723aba-83e1-4a7a-986c-e9eff546922d-util\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:45:46.504709 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.504704 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f542e940-b3dc-447f-84c4-9593932c5dcc-util\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:45:46.504709 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.504716 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-util\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:45:46.504974 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.504756 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-bundle\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:45:46.504974 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.504772 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp7fx\" (UniqueName: \"kubernetes.io/projected/b160ad9c-1db8-4b3b-afcb-91697bf4c24f-kube-api-access-fp7fx\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:45:46.504974 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.504786 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f542e940-b3dc-447f-84c4-9593932c5dcc-bundle\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:45:46.504974 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.504798 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa723aba-83e1-4a7a-986c-e9eff546922d-bundle\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:45:46.504974 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.504810 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgnp2\" (UniqueName: \"kubernetes.io/projected/fa723aba-83e1-4a7a-986c-e9eff546922d-kube-api-access-wgnp2\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:45:46.504974 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:46.504823 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29ddj\" (UniqueName: \"kubernetes.io/projected/f542e940-b3dc-447f-84c4-9593932c5dcc-kube-api-access-29ddj\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:45:47.140800 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:47.140770 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" Jul 20 09:45:47.140999 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:47.140762 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8" event={"ID":"f542e940-b3dc-447f-84c4-9593932c5dcc","Type":"ContainerDied","Data":"6d289495343f79d5732bcc7ef5b2e29bc905f170829d3bb47ffaec193e743354"} Jul 20 09:45:47.140999 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:47.140905 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d289495343f79d5732bcc7ef5b2e29bc905f170829d3bb47ffaec193e743354" Jul 20 09:45:47.142894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:47.142838 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" event={"ID":"fa723aba-83e1-4a7a-986c-e9eff546922d","Type":"ContainerDied","Data":"c45455b59df595e9ad8d4a495b33807123ab8272b600eb4ecb7ac766c59810c9"} Jul 20 09:45:47.143048 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:47.142897 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c45455b59df595e9ad8d4a495b33807123ab8272b600eb4ecb7ac766c59810c9" Jul 20 09:45:47.143048 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:47.142863 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25" Jul 20 09:45:47.145037 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:47.144975 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" event={"ID":"b160ad9c-1db8-4b3b-afcb-91697bf4c24f","Type":"ContainerDied","Data":"b9c7838bd682aa204a1b6159653a9578fff804ac42e462a0448745e3e178e084"} Jul 20 09:45:47.145037 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:47.145014 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9c7838bd682aa204a1b6159653a9578fff804ac42e462a0448745e3e178e084" Jul 20 09:45:47.145233 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:45:47.145038 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx" Jul 20 09:46:42.695363 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.695325 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65945f4c8-27dfr"] Jul 20 09:46:42.695907 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.695831 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f542e940-b3dc-447f-84c4-9593932c5dcc" containerName="extract" Jul 20 09:46:42.695907 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.695869 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f542e940-b3dc-447f-84c4-9593932c5dcc" containerName="extract" Jul 20 09:46:42.695907 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.695888 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03fc3694-f582-4e91-87c2-63fbc41d839f" containerName="pull" Jul 20 09:46:42.695907 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.695896 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="03fc3694-f582-4e91-87c2-63fbc41d839f" containerName="pull" Jul 20 09:46:42.695907 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.695906 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b160ad9c-1db8-4b3b-afcb-91697bf4c24f" containerName="pull" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.695915 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b160ad9c-1db8-4b3b-afcb-91697bf4c24f" containerName="pull" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.695926 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f542e940-b3dc-447f-84c4-9593932c5dcc" containerName="util" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.695935 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f542e940-b3dc-447f-84c4-9593932c5dcc" containerName="util" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.695944 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03fc3694-f582-4e91-87c2-63fbc41d839f" containerName="extract" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.695952 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="03fc3694-f582-4e91-87c2-63fbc41d839f" containerName="extract" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.695963 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b160ad9c-1db8-4b3b-afcb-91697bf4c24f" containerName="util" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.695971 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b160ad9c-1db8-4b3b-afcb-91697bf4c24f" containerName="util" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.695987 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03fc3694-f582-4e91-87c2-63fbc41d839f" containerName="util" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.695995 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="03fc3694-f582-4e91-87c2-63fbc41d839f" containerName="util" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.696005 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa723aba-83e1-4a7a-986c-e9eff546922d" containerName="pull" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.696017 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa723aba-83e1-4a7a-986c-e9eff546922d" containerName="pull" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.696026 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b160ad9c-1db8-4b3b-afcb-91697bf4c24f" containerName="extract" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.696034 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b160ad9c-1db8-4b3b-afcb-91697bf4c24f" containerName="extract" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.696043 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa723aba-83e1-4a7a-986c-e9eff546922d" containerName="extract" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.696051 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa723aba-83e1-4a7a-986c-e9eff546922d" containerName="extract" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.696070 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa723aba-83e1-4a7a-986c-e9eff546922d" containerName="util" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.696079 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa723aba-83e1-4a7a-986c-e9eff546922d" containerName="util" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.696090 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f542e940-b3dc-447f-84c4-9593932c5dcc" containerName="pull" Jul 20 09:46:42.696180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.696098 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f542e940-b3dc-447f-84c4-9593932c5dcc" containerName="pull" Jul 20 09:46:42.697078 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.696203 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b160ad9c-1db8-4b3b-afcb-91697bf4c24f" containerName="extract" Jul 20 09:46:42.697078 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.696218 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="03fc3694-f582-4e91-87c2-63fbc41d839f" containerName="extract" Jul 20 09:46:42.697078 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.696227 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f542e940-b3dc-447f-84c4-9593932c5dcc" containerName="extract" Jul 20 09:46:42.697078 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.696236 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa723aba-83e1-4a7a-986c-e9eff546922d" containerName="extract" Jul 20 09:46:42.699577 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.699556 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.722026 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.721997 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65945f4c8-27dfr"] Jul 20 09:46:42.795081 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.795046 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78da6324-da08-4966-a019-6ca1aaf6aacf-service-ca\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.795081 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.795083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78da6324-da08-4966-a019-6ca1aaf6aacf-oauth-serving-cert\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.795350 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.795117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78da6324-da08-4966-a019-6ca1aaf6aacf-console-oauth-config\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.795350 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.795187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5s2f\" (UniqueName: \"kubernetes.io/projected/78da6324-da08-4966-a019-6ca1aaf6aacf-kube-api-access-s5s2f\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.795350 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.795236 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78da6324-da08-4966-a019-6ca1aaf6aacf-trusted-ca-bundle\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.795350 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.795297 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78da6324-da08-4966-a019-6ca1aaf6aacf-console-serving-cert\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.795350 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.795339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78da6324-da08-4966-a019-6ca1aaf6aacf-console-config\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.896418 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.896379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78da6324-da08-4966-a019-6ca1aaf6aacf-console-oauth-config\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.896418 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.896430 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5s2f\" (UniqueName: \"kubernetes.io/projected/78da6324-da08-4966-a019-6ca1aaf6aacf-kube-api-access-s5s2f\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.896682 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.896477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78da6324-da08-4966-a019-6ca1aaf6aacf-trusted-ca-bundle\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.896682 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.896514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78da6324-da08-4966-a019-6ca1aaf6aacf-console-serving-cert\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.896682 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.896568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78da6324-da08-4966-a019-6ca1aaf6aacf-console-config\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.896682 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.896599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78da6324-da08-4966-a019-6ca1aaf6aacf-service-ca\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.896682 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.896633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78da6324-da08-4966-a019-6ca1aaf6aacf-oauth-serving-cert\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.897473 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.897440 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78da6324-da08-4966-a019-6ca1aaf6aacf-service-ca\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.897618 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.897490 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78da6324-da08-4966-a019-6ca1aaf6aacf-trusted-ca-bundle\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.897618 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.897504 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78da6324-da08-4966-a019-6ca1aaf6aacf-console-config\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.897618 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.897490 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78da6324-da08-4966-a019-6ca1aaf6aacf-oauth-serving-cert\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.899068 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.899041 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78da6324-da08-4966-a019-6ca1aaf6aacf-console-oauth-config\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.899162 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.899132 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78da6324-da08-4966-a019-6ca1aaf6aacf-console-serving-cert\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:42.906137 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:42.906117 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5s2f\" (UniqueName: \"kubernetes.io/projected/78da6324-da08-4966-a019-6ca1aaf6aacf-kube-api-access-s5s2f\") pod \"console-65945f4c8-27dfr\" (UID: \"78da6324-da08-4966-a019-6ca1aaf6aacf\") " pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:43.009351 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:43.009262 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:43.172579 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:43.172549 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65945f4c8-27dfr"] Jul 20 09:46:43.173163 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:46:43.173135 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78da6324_da08_4966_a019_6ca1aaf6aacf.slice/crio-918009087ffb71f14ecd99c131b3f989100fa037fa9b1735d46e10304014f9af WatchSource:0}: Error finding container 918009087ffb71f14ecd99c131b3f989100fa037fa9b1735d46e10304014f9af: Status 404 returned error can't find the container with id 918009087ffb71f14ecd99c131b3f989100fa037fa9b1735d46e10304014f9af Jul 20 09:46:43.431078 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:43.431038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65945f4c8-27dfr" event={"ID":"78da6324-da08-4966-a019-6ca1aaf6aacf","Type":"ContainerStarted","Data":"e5363350dc17222c4865e26a0827d78277c27b334bf2a0ed8b6243d3c711caf5"} Jul 20 09:46:43.431267 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:43.431091 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65945f4c8-27dfr" event={"ID":"78da6324-da08-4966-a019-6ca1aaf6aacf","Type":"ContainerStarted","Data":"918009087ffb71f14ecd99c131b3f989100fa037fa9b1735d46e10304014f9af"} Jul 20 09:46:53.010112 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:53.010058 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:53.010615 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:53.010142 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:53.014708 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:53.014680 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:53.032306 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:53.032258 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65945f4c8-27dfr" podStartSLOduration=11.032241878 podStartE2EDuration="11.032241878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:46:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:46:43.467869136 +0000 UTC m=+482.941970162" watchObservedRunningTime="2026-07-20 09:46:53.032241878 +0000 UTC m=+492.506342909" Jul 20 09:46:53.485976 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:53.485944 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65945f4c8-27dfr" Jul 20 09:46:53.532041 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:53.532004 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66fcdbd84d-58px5"] Jul 20 09:46:58.038416 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.038379 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj"] Jul 20 09:46:58.041835 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.041813 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.047106 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.047086 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-thtz7\"" Jul 20 09:46:58.068467 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.068439 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj"] Jul 20 09:46:58.137275 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.137230 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b3c2629-1615-41f9-9696-306a7f65ffc9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.137455 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.137285 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b3c2629-1615-41f9-9696-306a7f65ffc9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.137455 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.137339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4dhx\" (UniqueName: \"kubernetes.io/projected/0b3c2629-1615-41f9-9696-306a7f65ffc9-kube-api-access-b4dhx\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.137455 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.137381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b3c2629-1615-41f9-9696-306a7f65ffc9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.137455 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.137428 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b3c2629-1615-41f9-9696-306a7f65ffc9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.137455 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.137445 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b3c2629-1615-41f9-9696-306a7f65ffc9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.137681 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.137473 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b3c2629-1615-41f9-9696-306a7f65ffc9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.137681 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.137584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b3c2629-1615-41f9-9696-306a7f65ffc9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.137681 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.137644 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b3c2629-1615-41f9-9696-306a7f65ffc9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.238691 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.238652 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b3c2629-1615-41f9-9696-306a7f65ffc9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.238898 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.238704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b3c2629-1615-41f9-9696-306a7f65ffc9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.238898 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.238725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b3c2629-1615-41f9-9696-306a7f65ffc9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.238898 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.238746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4dhx\" (UniqueName: \"kubernetes.io/projected/0b3c2629-1615-41f9-9696-306a7f65ffc9-kube-api-access-b4dhx\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.238898 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.238775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b3c2629-1615-41f9-9696-306a7f65ffc9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.238898 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.238802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b3c2629-1615-41f9-9696-306a7f65ffc9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.238898 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.238823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b3c2629-1615-41f9-9696-306a7f65ffc9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.238898 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.238891 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b3c2629-1615-41f9-9696-306a7f65ffc9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.239256 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.239109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b3c2629-1615-41f9-9696-306a7f65ffc9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.239256 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.239226 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b3c2629-1615-41f9-9696-306a7f65ffc9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.239256 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.239252 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b3c2629-1615-41f9-9696-306a7f65ffc9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.239356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.239315 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b3c2629-1615-41f9-9696-306a7f65ffc9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.239461 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.239444 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b3c2629-1615-41f9-9696-306a7f65ffc9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.239554 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.239535 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b3c2629-1615-41f9-9696-306a7f65ffc9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.241243 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.241225 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b3c2629-1615-41f9-9696-306a7f65ffc9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.241408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.241381 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b3c2629-1615-41f9-9696-306a7f65ffc9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.248959 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.248938 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b3c2629-1615-41f9-9696-306a7f65ffc9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.249568 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.249545 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4dhx\" (UniqueName: \"kubernetes.io/projected/0b3c2629-1615-41f9-9696-306a7f65ffc9-kube-api-access-b4dhx\") pod \"maas-default-gateway-openshift-default-56654dcf7-vwsqj\" (UID: \"0b3c2629-1615-41f9-9696-306a7f65ffc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.352564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.352526 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:46:58.494635 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.494599 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj"] Jul 20 09:46:58.496529 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:46:58.496504 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3c2629_1615_41f9_9696_306a7f65ffc9.slice/crio-55f7c9dfba8b9be71db455fe14c710273d94585f39f4a64b187e765363faf79d WatchSource:0}: Error finding container 55f7c9dfba8b9be71db455fe14c710273d94585f39f4a64b187e765363faf79d: Status 404 returned error can't find the container with id 55f7c9dfba8b9be71db455fe14c710273d94585f39f4a64b187e765363faf79d Jul 20 09:46:58.498784 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.498753 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 09:46:58.498887 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.498814 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 09:46:58.498887 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.498841 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 09:46:58.507918 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:58.507883 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" event={"ID":"0b3c2629-1615-41f9-9696-306a7f65ffc9","Type":"ContainerStarted","Data":"55f7c9dfba8b9be71db455fe14c710273d94585f39f4a64b187e765363faf79d"} Jul 20 09:46:59.514503 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:59.514452 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" event={"ID":"0b3c2629-1615-41f9-9696-306a7f65ffc9","Type":"ContainerStarted","Data":"b501d0c286912b7ee1e17fbdfb19838614de8276208d1bc7665e8281bd7fdb74"} Jul 20 09:46:59.537705 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:46:59.537659 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" podStartSLOduration=2.537644947 podStartE2EDuration="2.537644947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:46:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:46:59.536008211 +0000 UTC m=+499.010109267" watchObservedRunningTime="2026-07-20 09:46:59.537644947 +0000 UTC m=+499.011745977" Jul 20 09:47:00.352910 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:00.352872 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:47:00.357819 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:00.357796 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:47:00.520191 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:00.520153 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:47:00.521185 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:00.521164 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:47:18.559929 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.559883 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66fcdbd84d-58px5" podUID="b408e0e5-df5a-459b-9e22-d752215ee8b9" containerName="console" containerID="cri-o://54411dfb53ac2bafadfde3f8d92c7167259107a14bdabfe18d86c3f138da0a76" gracePeriod=15 Jul 20 09:47:18.804911 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.804885 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:47:18.918683 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.918643 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-trusted-ca-bundle\") pod \"b408e0e5-df5a-459b-9e22-d752215ee8b9\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " Jul 20 09:47:18.918919 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.918701 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-oauth-config\") pod \"b408e0e5-df5a-459b-9e22-d752215ee8b9\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " Jul 20 09:47:18.918919 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.918734 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-service-ca\") pod \"b408e0e5-df5a-459b-9e22-d752215ee8b9\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " Jul 20 09:47:18.918919 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.918769 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-serving-cert\") pod \"b408e0e5-df5a-459b-9e22-d752215ee8b9\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " Jul 20 09:47:18.918919 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.918793 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-oauth-serving-cert\") pod \"b408e0e5-df5a-459b-9e22-d752215ee8b9\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " Jul 20 09:47:18.918919 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.918897 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj2xq\" (UniqueName: \"kubernetes.io/projected/b408e0e5-df5a-459b-9e22-d752215ee8b9-kube-api-access-qj2xq\") pod \"b408e0e5-df5a-459b-9e22-d752215ee8b9\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " Jul 20 09:47:18.919198 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.918926 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-config\") pod \"b408e0e5-df5a-459b-9e22-d752215ee8b9\" (UID: \"b408e0e5-df5a-459b-9e22-d752215ee8b9\") " Jul 20 09:47:18.919248 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.919208 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b408e0e5-df5a-459b-9e22-d752215ee8b9" (UID: "b408e0e5-df5a-459b-9e22-d752215ee8b9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 09:47:18.919355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.919329 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b408e0e5-df5a-459b-9e22-d752215ee8b9" (UID: "b408e0e5-df5a-459b-9e22-d752215ee8b9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 09:47:18.919355 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.919241 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-service-ca" (OuterVolumeSpecName: "service-ca") pod "b408e0e5-df5a-459b-9e22-d752215ee8b9" (UID: "b408e0e5-df5a-459b-9e22-d752215ee8b9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 09:47:18.919460 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.919432 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-config" (OuterVolumeSpecName: "console-config") pod "b408e0e5-df5a-459b-9e22-d752215ee8b9" (UID: "b408e0e5-df5a-459b-9e22-d752215ee8b9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 09:47:18.921138 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.921111 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b408e0e5-df5a-459b-9e22-d752215ee8b9" (UID: "b408e0e5-df5a-459b-9e22-d752215ee8b9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 09:47:18.921258 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.921151 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b408e0e5-df5a-459b-9e22-d752215ee8b9" (UID: "b408e0e5-df5a-459b-9e22-d752215ee8b9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 09:47:18.921258 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:18.921158 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b408e0e5-df5a-459b-9e22-d752215ee8b9-kube-api-access-qj2xq" (OuterVolumeSpecName: "kube-api-access-qj2xq") pod "b408e0e5-df5a-459b-9e22-d752215ee8b9" (UID: "b408e0e5-df5a-459b-9e22-d752215ee8b9"). InnerVolumeSpecName "kube-api-access-qj2xq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 09:47:19.020428 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.020398 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-oauth-config\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:47:19.020428 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.020425 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-service-ca\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:47:19.020428 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.020436 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-serving-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:47:19.020657 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.020446 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-oauth-serving-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:47:19.020657 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.020456 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj2xq\" (UniqueName: \"kubernetes.io/projected/b408e0e5-df5a-459b-9e22-d752215ee8b9-kube-api-access-qj2xq\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:47:19.020657 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.020464 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-console-config\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:47:19.020657 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.020473 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b408e0e5-df5a-459b-9e22-d752215ee8b9-trusted-ca-bundle\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 09:47:19.617779 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.617747 2577 generic.go:356] "Generic (PLEG): container finished" podID="b408e0e5-df5a-459b-9e22-d752215ee8b9" containerID="54411dfb53ac2bafadfde3f8d92c7167259107a14bdabfe18d86c3f138da0a76" exitCode=0 Jul 20 09:47:19.618217 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.617798 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fcdbd84d-58px5" Jul 20 09:47:19.618217 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.617837 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fcdbd84d-58px5" event={"ID":"b408e0e5-df5a-459b-9e22-d752215ee8b9","Type":"ContainerDied","Data":"54411dfb53ac2bafadfde3f8d92c7167259107a14bdabfe18d86c3f138da0a76"} Jul 20 09:47:19.618217 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.617897 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fcdbd84d-58px5" event={"ID":"b408e0e5-df5a-459b-9e22-d752215ee8b9","Type":"ContainerDied","Data":"1a223dc7603d2a102790d3bbe9f791f16530273b623890803a79976127338581"} Jul 20 09:47:19.618217 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.617916 2577 scope.go:117] "RemoveContainer" containerID="54411dfb53ac2bafadfde3f8d92c7167259107a14bdabfe18d86c3f138da0a76" Jul 20 09:47:19.626567 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.626551 2577 scope.go:117] "RemoveContainer" containerID="54411dfb53ac2bafadfde3f8d92c7167259107a14bdabfe18d86c3f138da0a76" Jul 20 09:47:19.626833 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:47:19.626814 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54411dfb53ac2bafadfde3f8d92c7167259107a14bdabfe18d86c3f138da0a76\": container with ID starting with 54411dfb53ac2bafadfde3f8d92c7167259107a14bdabfe18d86c3f138da0a76 not found: ID does not exist" containerID="54411dfb53ac2bafadfde3f8d92c7167259107a14bdabfe18d86c3f138da0a76" Jul 20 09:47:19.626903 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.626840 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54411dfb53ac2bafadfde3f8d92c7167259107a14bdabfe18d86c3f138da0a76"} err="failed to get container status \"54411dfb53ac2bafadfde3f8d92c7167259107a14bdabfe18d86c3f138da0a76\": rpc error: code = NotFound desc = could not find container \"54411dfb53ac2bafadfde3f8d92c7167259107a14bdabfe18d86c3f138da0a76\": container with ID starting with 54411dfb53ac2bafadfde3f8d92c7167259107a14bdabfe18d86c3f138da0a76 not found: ID does not exist" Jul 20 09:47:19.641606 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.641582 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66fcdbd84d-58px5"] Jul 20 09:47:19.645773 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:19.645750 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66fcdbd84d-58px5"] Jul 20 09:47:21.024661 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:47:21.024625 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b408e0e5-df5a-459b-9e22-d752215ee8b9" path="/var/lib/kubelet/pods/b408e0e5-df5a-459b-9e22-d752215ee8b9/volumes" Jul 20 09:48:37.016922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:37.016888 2577 generic.go:356] "Generic (PLEG): container finished" podID="0b3c2629-1615-41f9-9696-306a7f65ffc9" containerID="b501d0c286912b7ee1e17fbdfb19838614de8276208d1bc7665e8281bd7fdb74" exitCode=0 Jul 20 09:48:37.017472 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:37.016971 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" event={"ID":"0b3c2629-1615-41f9-9696-306a7f65ffc9","Type":"ContainerDied","Data":"b501d0c286912b7ee1e17fbdfb19838614de8276208d1bc7665e8281bd7fdb74"} Jul 20 09:48:37.017545 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:37.017484 2577 scope.go:117] "RemoveContainer" containerID="b501d0c286912b7ee1e17fbdfb19838614de8276208d1bc7665e8281bd7fdb74" Jul 20 09:48:37.018593 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:37.018560 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 09:48:37.018699 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:37.018648 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 09:48:37.018760 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:37.018701 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 09:48:38.024441 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:38.024402 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" event={"ID":"0b3c2629-1615-41f9-9696-306a7f65ffc9","Type":"ContainerStarted","Data":"ef5e462f1ae96b978ce05dffc9c39cf7c8b2350e203aa63b435dd7327e1fc5bd"} Jul 20 09:48:38.353753 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:38.353710 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:48:38.353988 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:38.353861 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vwsqj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 20 09:48:38.353988 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:38.353919 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" podUID="0b3c2629-1615-41f9-9696-306a7f65ffc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 20 09:48:39.354036 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:39.353987 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vwsqj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 20 09:48:39.354555 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:39.354060 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" podUID="0b3c2629-1615-41f9-9696-306a7f65ffc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 20 09:48:40.353147 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:40.353101 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vwsqj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 20 09:48:40.353372 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:40.353170 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" podUID="0b3c2629-1615-41f9-9696-306a7f65ffc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 20 09:48:40.958193 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:40.958158 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 09:48:40.958713 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:40.958258 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 09:48:41.353180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:41.353131 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vwsqj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 20 09:48:41.353390 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:41.353220 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" podUID="0b3c2629-1615-41f9-9696-306a7f65ffc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 20 09:48:42.357350 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:42.357319 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:48:42.357756 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:42.357611 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:48:42.358448 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:48:42.358426 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vwsqj" Jul 20 09:49:06.111207 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.111128 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz"] Jul 20 09:49:06.111683 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.111482 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b408e0e5-df5a-459b-9e22-d752215ee8b9" containerName="console" Jul 20 09:49:06.111683 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.111494 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b408e0e5-df5a-459b-9e22-d752215ee8b9" containerName="console" Jul 20 09:49:06.111683 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.111556 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b408e0e5-df5a-459b-9e22-d752215ee8b9" containerName="console" Jul 20 09:49:06.114488 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.114466 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.118160 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.118131 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 20 09:49:06.118267 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.118140 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 20 09:49:06.118267 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.118140 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hbv28\"" Jul 20 09:49:06.118267 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.118203 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 20 09:49:06.124432 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.124404 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz"] Jul 20 09:49:06.158403 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.158364 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hpg4\" (UniqueName: \"kubernetes.io/projected/0ce460b3-6ecb-4951-9ef1-b469e28ef554-kube-api-access-6hpg4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.158618 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.158417 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ce460b3-6ecb-4951-9ef1-b469e28ef554-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.158618 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.158438 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ce460b3-6ecb-4951-9ef1-b469e28ef554-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.158618 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.158517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ce460b3-6ecb-4951-9ef1-b469e28ef554-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.158618 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.158587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ce460b3-6ecb-4951-9ef1-b469e28ef554-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.158794 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.158637 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ce460b3-6ecb-4951-9ef1-b469e28ef554-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.260059 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.260014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ce460b3-6ecb-4951-9ef1-b469e28ef554-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.260059 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.260063 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ce460b3-6ecb-4951-9ef1-b469e28ef554-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.260327 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.260107 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ce460b3-6ecb-4951-9ef1-b469e28ef554-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.260327 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.260155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ce460b3-6ecb-4951-9ef1-b469e28ef554-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.260327 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.260199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ce460b3-6ecb-4951-9ef1-b469e28ef554-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.260327 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.260245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hpg4\" (UniqueName: \"kubernetes.io/projected/0ce460b3-6ecb-4951-9ef1-b469e28ef554-kube-api-access-6hpg4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.260526 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.260461 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ce460b3-6ecb-4951-9ef1-b469e28ef554-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.260581 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.260538 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ce460b3-6ecb-4951-9ef1-b469e28ef554-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.260671 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.260651 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ce460b3-6ecb-4951-9ef1-b469e28ef554-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.262479 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.262454 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ce460b3-6ecb-4951-9ef1-b469e28ef554-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.262647 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.262630 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ce460b3-6ecb-4951-9ef1-b469e28ef554-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.269228 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.269205 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hpg4\" (UniqueName: \"kubernetes.io/projected/0ce460b3-6ecb-4951-9ef1-b469e28ef554-kube-api-access-6hpg4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rshbz\" (UID: \"0ce460b3-6ecb-4951-9ef1-b469e28ef554\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.426189 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.426091 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:06.560053 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.560024 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz"] Jul 20 09:49:06.561390 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:49:06.561359 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce460b3_6ecb_4951_9ef1_b469e28ef554.slice/crio-f375bcef03dce19728517e21ae34b95bbb81b79389b422f0cd90f4a3f45d82d1 WatchSource:0}: Error finding container f375bcef03dce19728517e21ae34b95bbb81b79389b422f0cd90f4a3f45d82d1: Status 404 returned error can't find the container with id f375bcef03dce19728517e21ae34b95bbb81b79389b422f0cd90f4a3f45d82d1 Jul 20 09:49:06.562535 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:06.562517 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 09:49:07.209635 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:07.209599 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" event={"ID":"0ce460b3-6ecb-4951-9ef1-b469e28ef554","Type":"ContainerStarted","Data":"f375bcef03dce19728517e21ae34b95bbb81b79389b422f0cd90f4a3f45d82d1"} Jul 20 09:49:08.216620 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:08.216576 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" event={"ID":"0ce460b3-6ecb-4951-9ef1-b469e28ef554","Type":"ContainerStarted","Data":"6f34e28a6e2f6ec1fd7dda3c0d958c42ed517a6bd13f033104d62ee4cd602301"} Jul 20 09:49:08.238167 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:08.238110 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" podStartSLOduration=1.2316750810000001 podStartE2EDuration="2.238089639s" totalImagesPullingTime="1.006414558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:49:08.237761818 +0000 UTC m=+627.711862886" watchObservedRunningTime="2026-07-20 09:49:08.238089639 +0000 UTC m=+627.712190671" Jul 20 09:49:12.908006 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:12.907969 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p"] Jul 20 09:49:12.911395 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:12.911375 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:12.913963 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:12.913937 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 20 09:49:12.922670 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:12.922647 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p"] Jul 20 09:49:13.016141 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.016097 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7vdw\" (UniqueName: \"kubernetes.io/projected/56d0d28b-2ba2-4557-9625-21d8da930e97-kube-api-access-c7vdw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.016323 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.016186 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d0d28b-2ba2-4557-9625-21d8da930e97-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.016323 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.016227 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d0d28b-2ba2-4557-9625-21d8da930e97-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.016323 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.016244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d0d28b-2ba2-4557-9625-21d8da930e97-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.016323 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.016299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d0d28b-2ba2-4557-9625-21d8da930e97-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.016472 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.016356 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d0d28b-2ba2-4557-9625-21d8da930e97-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.117017 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.116980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d0d28b-2ba2-4557-9625-21d8da930e97-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.117017 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.117021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7vdw\" (UniqueName: \"kubernetes.io/projected/56d0d28b-2ba2-4557-9625-21d8da930e97-kube-api-access-c7vdw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.117322 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.117162 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d0d28b-2ba2-4557-9625-21d8da930e97-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.117322 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.117230 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d0d28b-2ba2-4557-9625-21d8da930e97-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.117322 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.117258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d0d28b-2ba2-4557-9625-21d8da930e97-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.117493 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.117354 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d0d28b-2ba2-4557-9625-21d8da930e97-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.117493 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.117380 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d0d28b-2ba2-4557-9625-21d8da930e97-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.117618 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.117598 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d0d28b-2ba2-4557-9625-21d8da930e97-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.117666 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.117607 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d0d28b-2ba2-4557-9625-21d8da930e97-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.119498 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.119473 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d0d28b-2ba2-4557-9625-21d8da930e97-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.119654 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.119635 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d0d28b-2ba2-4557-9625-21d8da930e97-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.125219 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.125199 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7vdw\" (UniqueName: \"kubernetes.io/projected/56d0d28b-2ba2-4557-9625-21d8da930e97-kube-api-access-c7vdw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p\" (UID: \"56d0d28b-2ba2-4557-9625-21d8da930e97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.221571 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.221468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:13.363173 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:13.363149 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p"] Jul 20 09:49:13.364980 ip-10-0-142-133 kubenswrapper[2577]: W0720 09:49:13.364952 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d0d28b_2ba2_4557_9625_21d8da930e97.slice/crio-ccbf750945774b3a1b007dd12def8a8544cf60bd53c9c477621cc00184069466 WatchSource:0}: Error finding container ccbf750945774b3a1b007dd12def8a8544cf60bd53c9c477621cc00184069466: Status 404 returned error can't find the container with id ccbf750945774b3a1b007dd12def8a8544cf60bd53c9c477621cc00184069466 Jul 20 09:49:14.255484 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:14.255442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" event={"ID":"56d0d28b-2ba2-4557-9625-21d8da930e97","Type":"ContainerStarted","Data":"6ca245ad5a6165034d8919798229ad6849745e28656a5c3e259461a8c7a45838"} Jul 20 09:49:14.255924 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:14.255540 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" event={"ID":"56d0d28b-2ba2-4557-9625-21d8da930e97","Type":"ContainerStarted","Data":"ccbf750945774b3a1b007dd12def8a8544cf60bd53c9c477621cc00184069466"} Jul 20 09:49:14.277136 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:14.277081 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" podStartSLOduration=2.083708525 podStartE2EDuration="2.277065424s" totalImagesPullingTime="193.356899ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:49:14.275305097 +0000 UTC m=+633.749406146" watchObservedRunningTime="2026-07-20 09:49:14.277065424 +0000 UTC m=+633.751166456" Jul 20 09:49:16.426275 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:16.426237 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:16.426691 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:16.426316 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:16.438819 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:16.438792 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:17.283439 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:17.283402 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rshbz" Jul 20 09:49:23.222269 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:23.222225 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:23.222776 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:23.222297 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:23.234915 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:23.234883 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:49:23.318303 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:49:23.318274 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p" Jul 20 09:51:47.492085 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:51:47.492041 2577 controller.go:195] "Failed to update lease" err="Put \"https://a7b96ae60c8a94500b31f5cf65e477ab-eeb1d14d881e3edf.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-142-133.ec2.internal?timeout=10s\": context deadline exceeded" Jul 20 09:51:57.492552 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:51:57.492509 2577 controller.go:195] "Failed to update lease" err="Put \"https://a7b96ae60c8a94500b31f5cf65e477ab-eeb1d14d881e3edf.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-142-133.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Jul 20 09:52:07.493233 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:52:07.493141 2577 controller.go:195] "Failed to update lease" err="Put \"https://a7b96ae60c8a94500b31f5cf65e477ab-eeb1d14d881e3edf.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-142-133.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Jul 20 09:52:17.494044 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:52:17.494000 2577 controller.go:195] "Failed to update lease" err="Put \"https://a7b96ae60c8a94500b31f5cf65e477ab-eeb1d14d881e3edf.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-142-133.ec2.internal?timeout=10s\": context deadline exceeded" Jul 20 09:52:17.637056 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637003 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637056 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637013 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dlgms\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637056 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637013 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x46x7\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637056 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637043 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637056 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637033 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637056 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637046 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637014 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637060 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-dockercfg-bwk56\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637078 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"default-dockercfg-b6rcl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637085 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637095 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637118 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6tr7c\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637149 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637162 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637167 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637187 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xxgbn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637194 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637201 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637211 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637232 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-924jw\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.637874 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637247 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.638564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637255 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.638564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637271 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.638564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637296 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kbvld\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.638564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637297 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x2ghp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.638564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637313 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.638564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637318 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"cacerts\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.638564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637336 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.638564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637357 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.638564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637361 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.638564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637381 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.638564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637392 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.638564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637407 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.638564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637425 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.638564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637424 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.638564 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637445 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7qc5b\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637453 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5znxb\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637479 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637485 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zb7xs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637497 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637514 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637517 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637531 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jz444\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637533 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637535 2577 reflector.go:571] "Warning: watch ended with error" reflector="pkg/kubelet/config/apiserver.go:66" type="*v1.Pod" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637555 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ttkbh\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637572 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637575 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637587 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637588 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639063 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637602 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xtf86\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637589 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bmb7h\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637620 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xnnq6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637640 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637650 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637652 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637670 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637673 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637701 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637721 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637731 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637735 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637763 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"original-pull-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637770 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637782 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.639583 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637786 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640043 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637814 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640043 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637819 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640043 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637819 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fkkj9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640043 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637830 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640043 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637816 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640043 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637820 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640043 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:52:17.637822 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-20T09:52:17Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-20T09:52:17Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-20T09:52:17Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-20T09:52:17Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-142-133.ec2.internal\": Patch \"https://a7b96ae60c8a94500b31f5cf65e477ab-eeb1d14d881e3edf.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-142-133.ec2.internal/status?timeout=10s\": http2: client connection lost" Jul 20 09:52:17.640043 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637883 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640043 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637886 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640043 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637914 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640043 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637926 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640043 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637947 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637956 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637970 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637970 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-dockercfg-8tnzg\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637990 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"default-dockercfg-fwpzl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.637998 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638005 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638009 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"default-dockercfg-hbv28\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638030 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638033 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638045 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"service-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638045 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-pphp6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638032 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638064 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rn2wz\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638070 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640408 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638079 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638085 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638089 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638096 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638110 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638117 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9vmvl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638116 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638130 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638114 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638148 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v7wvr\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638148 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638159 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rj45t\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638165 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638162 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xnvpv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638170 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.640894 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638171 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638194 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638198 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638213 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638210 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638225 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9rrwk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638234 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-oauth-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638180 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638241 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9tbq2\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: E0720 09:52:17.638223 2577 controller.go:195] "Failed to update lease" err="Put \"https://a7b96ae60c8a94500b31f5cf65e477ab-eeb1d14d881e3edf.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-142-133.ec2.internal?timeout=10s\": http2: client connection lost" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638258 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638270 2577 controller.go:115] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638273 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hssrx\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638283 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638285 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638290 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641412 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638288 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638274 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638316 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638330 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638339 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tv2st\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638342 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638320 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-thtz7\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638361 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638367 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638367 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638383 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638348 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xm7ld\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638387 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vz98l\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638396 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638412 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6kkln\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.641922 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638392 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.642356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638425 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.642356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638339 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.642356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638438 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-79h7l\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.642356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638419 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.642356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638455 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.642356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638448 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.642356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638464 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.642356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638425 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.642356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638469 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ncwcj\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.642356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638470 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pgl5c\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.642356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638485 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.642356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638476 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.642356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638498 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:17.642356 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:17.638522 2577 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 20 09:52:18.453139 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.453104 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 20 09:52:18.467511 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.467480 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 20 09:52:18.478640 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.478615 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 09:52:18.484587 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.484566 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x2ghp\"" Jul 20 09:52:18.486665 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.486648 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ttkbh\"" Jul 20 09:52:18.496903 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.496882 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xm7ld\"" Jul 20 09:52:18.497219 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.496970 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tv2st\"" Jul 20 09:52:18.498429 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.498414 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 20 09:52:18.521492 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.521459 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 20 09:52:18.521665 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.521509 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 20 09:52:18.521665 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.521514 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.523197 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.523179 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 20 09:52:18.549780 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.549753 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 09:52:18.549780 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.549776 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 09:52:18.553212 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.553192 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 20 09:52:18.556592 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.556575 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 09:52:18.557124 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.557110 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 20 09:52:18.560605 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.560590 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6tr7c\"" Jul 20 09:52:18.566011 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.565992 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6kkln\"" Jul 20 09:52:18.577446 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.577429 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zb7xs\"" Jul 20 09:52:18.593696 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.593676 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 09:52:18.594764 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.594749 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 20 09:52:18.612768 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.612738 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v7wvr\"" Jul 20 09:52:18.619129 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.619111 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 09:52:18.624950 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.624933 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 09:52:18.632781 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.632765 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 09:52:18.636180 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.636164 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9tbq2\"" Jul 20 09:52:18.641970 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.641949 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.643767 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.643751 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 09:52:18.646908 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.646889 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 09:52:18.649409 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.649393 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:52:18.649649 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.649636 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 20 09:52:18.649696 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.649672 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 09:52:18.658403 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.658384 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rj45t\"" Jul 20 09:52:18.671271 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.671245 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 20 09:52:18.672032 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.672014 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 20 09:52:18.687818 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.687799 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hbv28\"" Jul 20 09:52:18.688079 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.688063 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 09:52:18.700976 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.700956 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9vmvl\"" Jul 20 09:52:18.704629 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.704575 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ncwcj\"" Jul 20 09:52:18.704731 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.704676 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 20 09:52:18.713242 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.713216 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.716049 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.716033 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 09:52:18.717697 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.717682 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.721681 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.721665 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:52:18.724204 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.724188 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rn2wz\"" Jul 20 09:52:18.737939 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.737922 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.747184 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.747169 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 20 09:52:18.754884 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.754867 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.755707 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.755693 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 20 09:52:18.755781 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.755764 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9rrwk\"" Jul 20 09:52:18.761952 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.761934 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pgl5c\"" Jul 20 09:52:18.764695 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.764680 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 20 09:52:18.765187 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.765173 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 20 09:52:18.766767 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.766752 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.767762 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.767659 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 20 09:52:18.774440 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.774420 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.780183 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.780169 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bmb7h\"" Jul 20 09:52:18.780366 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.780352 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 20 09:52:18.788834 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.788814 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 20 09:52:18.789900 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.789886 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 20 09:52:18.798653 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.798638 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.807151 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.807131 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8tnzg\"" Jul 20 09:52:18.808902 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.808888 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.811382 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.811370 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 20 09:52:18.812794 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.812779 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 20 09:52:18.814123 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.814108 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xxgbn\"" Jul 20 09:52:18.815049 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.815036 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.815809 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.815796 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xnvpv\"" Jul 20 09:52:18.820362 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.820345 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5znxb\"" Jul 20 09:52:18.827064 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.827049 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xnnq6\"" Jul 20 09:52:18.827139 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.827124 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 09:52:18.845150 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.845131 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.845353 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.845339 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dlgms\"" Jul 20 09:52:18.846238 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.846226 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 20 09:52:18.851957 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.851941 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-79h7l\"" Jul 20 09:52:18.852066 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.851982 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 09:52:18.855531 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.855514 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 20 09:52:18.857130 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.857114 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 20 09:52:18.858159 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.858146 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 20 09:52:18.865001 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.864985 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 20 09:52:18.872948 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.872932 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.876545 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.876531 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-thtz7\"" Jul 20 09:52:18.896773 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.896754 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.899639 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.899623 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 09:52:18.899890 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.899877 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 09:52:18.905271 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.905257 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 09:52:18.923781 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.923757 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 20 09:52:18.925263 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.925248 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:52:18.925394 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.925373 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x46x7\"" Jul 20 09:52:18.925450 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.925408 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 20 09:52:18.935668 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.935652 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kbvld\"" Jul 20 09:52:18.937490 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.937475 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 20 09:52:18.941794 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.941777 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 09:52:18.952289 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.952272 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 09:52:18.962980 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.962919 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.964483 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.964467 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:52:18.967103 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.967084 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hssrx\"" Jul 20 09:52:18.995504 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.995481 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 09:52:18.997111 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:18.997094 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 09:52:19.004815 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.004798 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 09:52:19.007809 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.007794 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 09:52:19.012072 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.012056 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 20 09:52:19.013125 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.013109 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 09:52:19.013310 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.013298 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 09:52:19.023946 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.023928 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:52:19.025501 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.025472 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 09:52:19.025501 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.025495 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 09:52:19.047915 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.047890 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 20 09:52:19.050939 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.050922 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 09:52:19.052419 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.052401 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fwpzl\"" Jul 20 09:52:19.054018 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.054001 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 09:52:19.055453 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.055438 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 20 09:52:19.068125 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.068103 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xtf86\"" Jul 20 09:52:19.068996 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.068975 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 20 09:52:19.069114 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.068998 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 09:52:19.069476 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.069461 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 20 09:52:19.080210 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.080189 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 09:52:19.085146 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.085131 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 20 09:52:19.085919 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.085906 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-pphp6\"" Jul 20 09:52:19.086493 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.086480 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 09:52:19.097482 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.097462 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 20 09:52:19.100257 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.100242 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 20 09:52:19.121475 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.121453 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 09:52:19.122006 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.121992 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 09:52:19.123374 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.123355 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 09:52:19.124781 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.124765 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 20 09:52:19.139361 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.139338 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vz98l\"" Jul 20 09:52:19.140693 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.140678 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7qc5b\"" Jul 20 09:52:19.140970 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.140956 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:52:19.142214 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.142201 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 09:52:19.142258 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.142201 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 09:52:19.149997 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.149976 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 20 09:52:19.165210 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.165187 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fkkj9\"" Jul 20 09:52:19.173360 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.173339 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:52:19.178766 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.178743 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 20 09:52:19.188156 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.188136 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 20 09:52:19.208862 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.208816 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jz444\"" Jul 20 09:52:19.228521 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.228459 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bwk56\"" Jul 20 09:52:19.248077 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.248053 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-924jw\"" Jul 20 09:52:19.268199 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.268166 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 09:52:19.288057 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.288029 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 09:52:19.307917 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.307895 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 20 09:52:19.329108 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.329087 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 20 09:52:19.348502 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.348478 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-b6rcl\"" Jul 20 09:52:19.368505 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.368482 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 20 09:52:19.388831 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.388806 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 20 09:52:19.408067 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.408046 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 20 09:52:19.428764 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.428742 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 20 09:52:19.448655 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:52:19.448634 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 09:53:40.995636 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:53:40.995605 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 09:53:40.997898 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:53:40.995829 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 09:58:41.030330 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:58:41.030236 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 09:58:41.033541 ip-10-0-142-133 kubenswrapper[2577]: I0720 09:58:41.031012 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 10:03:41.064252 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:03:41.064229 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 10:03:41.066415 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:03:41.065776 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 10:06:08.921311 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:08.921275 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz"] Jul 20 10:06:08.924751 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:08.924734 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:08.927259 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:08.927236 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d4aaf29e-openshift-default-dockercfg-pstmc\"" Jul 20 10:06:08.964227 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:08.964195 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz"] Jul 20 10:06:09.041995 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.041958 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-workload-certs\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.041995 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.041999 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-workload-socket\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.042233 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.042048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-token\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.042233 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.042079 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7spv\" (UniqueName: \"kubernetes.io/projected/4fc572e9-b214-4375-9baa-973922bd5d4c-kube-api-access-q7spv\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.042233 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.042131 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-envoy\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.042233 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.042160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-podinfo\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.042233 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.042179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fc572e9-b214-4375-9baa-973922bd5d4c-istiod-ca-cert\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.042233 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.042203 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-data\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.042451 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.042260 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-credential-socket\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.143518 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.143483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7spv\" (UniqueName: \"kubernetes.io/projected/4fc572e9-b214-4375-9baa-973922bd5d4c-kube-api-access-q7spv\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.143695 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.143533 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-envoy\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.143695 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.143568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-podinfo\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.143695 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.143594 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fc572e9-b214-4375-9baa-973922bd5d4c-istiod-ca-cert\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.143695 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.143621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-data\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.143955 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.143773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-credential-socket\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.143955 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.143869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-workload-certs\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.143955 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.143917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-workload-socket\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.144112 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.143991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-token\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.144112 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.144068 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-data\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.144207 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.144159 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-credential-socket\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.144272 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.144243 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-workload-certs\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.144327 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.144312 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-workload-socket\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.144472 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.144452 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fc572e9-b214-4375-9baa-973922bd5d4c-istiod-ca-cert\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.146042 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.146022 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-envoy\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.146156 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.146139 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-podinfo\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.152087 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.152061 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-token\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.152288 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.152267 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7spv\" (UniqueName: \"kubernetes.io/projected/4fc572e9-b214-4375-9baa-973922bd5d4c-kube-api-access-q7spv\") pod \"e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.234769 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.234688 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:09.372014 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.371982 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz"] Jul 20 10:06:09.372785 ip-10-0-142-133 kubenswrapper[2577]: W0720 10:06:09.372759 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc572e9_b214_4375_9baa_973922bd5d4c.slice/crio-c4dff946694123eb2761d9bafeb23e98d700ebb1c23fccb26f57bf60309ade37 WatchSource:0}: Error finding container c4dff946694123eb2761d9bafeb23e98d700ebb1c23fccb26f57bf60309ade37: Status 404 returned error can't find the container with id c4dff946694123eb2761d9bafeb23e98d700ebb1c23fccb26f57bf60309ade37 Jul 20 10:06:09.375252 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.375217 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:06:09.375327 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.375280 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:06:09.375327 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.375308 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:06:09.583176 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.583128 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" event={"ID":"4fc572e9-b214-4375-9baa-973922bd5d4c","Type":"ContainerStarted","Data":"a272bfa77792d9e7f2ecc1b65bcc44a90e42f52ee59f8d332e33531e4ea91616"} Jul 20 10:06:09.583343 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.583212 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" event={"ID":"4fc572e9-b214-4375-9baa-973922bd5d4c","Type":"ContainerStarted","Data":"c4dff946694123eb2761d9bafeb23e98d700ebb1c23fccb26f57bf60309ade37"} Jul 20 10:06:09.604746 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:09.604696 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" podStartSLOduration=1.60467607 podStartE2EDuration="1.60467607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:06:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:06:09.602142638 +0000 UTC m=+1649.076243669" watchObservedRunningTime="2026-07-20 10:06:09.60467607 +0000 UTC m=+1649.078777175" Jul 20 10:06:10.235691 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:10.235657 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:10.237064 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:10.237036 2577 patch_prober.go:28] interesting pod/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 20 10:06:10.237251 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:10.237084 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" podUID="4fc572e9-b214-4375-9baa-973922bd5d4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 20 10:06:11.244879 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:11.244817 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:11.594787 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:11.594758 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:11.595822 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:11.595800 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:26.596530 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:26.596495 2577 patch_prober.go:28] interesting pod/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 20 10:06:26.596960 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:26.596547 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" podUID="4fc572e9-b214-4375-9baa-973922bd5d4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 20 10:06:26.688166 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:26.688133 2577 generic.go:356] "Generic (PLEG): container finished" podID="4fc572e9-b214-4375-9baa-973922bd5d4c" containerID="a272bfa77792d9e7f2ecc1b65bcc44a90e42f52ee59f8d332e33531e4ea91616" exitCode=0 Jul 20 10:06:26.688321 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:26.688218 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" event={"ID":"4fc572e9-b214-4375-9baa-973922bd5d4c","Type":"ContainerDied","Data":"a272bfa77792d9e7f2ecc1b65bcc44a90e42f52ee59f8d332e33531e4ea91616"} Jul 20 10:06:26.688788 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:26.688770 2577 scope.go:117] "RemoveContainer" containerID="a272bfa77792d9e7f2ecc1b65bcc44a90e42f52ee59f8d332e33531e4ea91616" Jul 20 10:06:26.689902 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:26.689870 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:06:26.689973 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:26.689955 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:06:26.690016 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:26.689987 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:06:27.695193 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:27.695156 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" event={"ID":"4fc572e9-b214-4375-9baa-973922bd5d4c","Type":"ContainerStarted","Data":"90979019b8ab64100e9f9d6e1c05e18ffef54ffda7b3628d3ac6e7b67b814f88"} Jul 20 10:06:28.235217 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:28.235172 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:28.235424 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:28.235306 2577 patch_prober.go:28] interesting pod/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 20 10:06:28.235424 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:28.235367 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" podUID="4fc572e9-b214-4375-9baa-973922bd5d4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 20 10:06:29.235574 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:29.235542 2577 patch_prober.go:28] interesting pod/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 20 10:06:29.236169 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:29.236138 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" podUID="4fc572e9-b214-4375-9baa-973922bd5d4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 20 10:06:30.236075 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:30.235605 2577 patch_prober.go:28] interesting pod/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 20 10:06:30.236075 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:30.235670 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" podUID="4fc572e9-b214-4375-9baa-973922bd5d4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 20 10:06:31.235428 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:31.235388 2577 patch_prober.go:28] interesting pod/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 20 10:06:31.235702 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:31.235455 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" podUID="4fc572e9-b214-4375-9baa-973922bd5d4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 20 10:06:32.239417 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:32.239388 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:32.239788 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:32.239655 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:32.240436 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:32.240419 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:51.733998 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:51.733963 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz"] Jul 20 10:06:51.734628 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:51.734210 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" podUID="4fc572e9-b214-4375-9baa-973922bd5d4c" containerName="istio-proxy" containerID="cri-o://90979019b8ab64100e9f9d6e1c05e18ffef54ffda7b3628d3ac6e7b67b814f88" gracePeriod=30 Jul 20 10:06:52.781155 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.781114 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp"] Jul 20 10:06:52.784535 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.784512 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.787386 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.787365 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-d95536fc-gw-openshift-default-dockercfg-h46fd\"" Jul 20 10:06:52.800741 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.800719 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp"] Jul 20 10:06:52.864784 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.864743 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-envoy\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.864969 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.864831 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-workload-certs\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.864969 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.864894 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-token\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.864969 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.864919 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istiod-ca-cert\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.864969 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.864947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-workload-socket\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.865199 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.864978 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndv5w\" (UniqueName: \"kubernetes.io/projected/cc1ed42a-bd19-45f0-ae10-5b7c25125317-kube-api-access-ndv5w\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.865199 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.865103 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-podinfo\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.865199 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.865150 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-data\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.865355 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.865199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-credential-socket\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.966218 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.966183 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-podinfo\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.966218 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.966222 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-data\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.966469 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.966246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-credential-socket\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.966533 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.966457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-envoy\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.966587 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.966550 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-workload-certs\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.966640 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.966585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-token\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.966640 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.966611 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istiod-ca-cert\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.966737 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.966634 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-credential-socket\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.966737 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.966646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-workload-socket\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.966737 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.966668 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-data\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.966737 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.966691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndv5w\" (UniqueName: \"kubernetes.io/projected/cc1ed42a-bd19-45f0-ae10-5b7c25125317-kube-api-access-ndv5w\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.966973 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.966945 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-workload-certs\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.967034 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.967004 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-workload-socket\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.967323 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.967300 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istiod-ca-cert\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.968807 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.968761 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-envoy\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.968980 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.968955 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-podinfo\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.977067 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.977043 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-token\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:52.977212 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:52.977115 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndv5w\" (UniqueName: \"kubernetes.io/projected/cc1ed42a-bd19-45f0-ae10-5b7c25125317-kube-api-access-ndv5w\") pod \"e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:53.094088 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:53.094060 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:53.248186 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:53.248155 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp"] Jul 20 10:06:53.249326 ip-10-0-142-133 kubenswrapper[2577]: W0720 10:06:53.249298 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1ed42a_bd19_45f0_ae10_5b7c25125317.slice/crio-c1ad52291735099f1217b816b76c9eededebed1909c5a6a262b228f4aa049501 WatchSource:0}: Error finding container c1ad52291735099f1217b816b76c9eededebed1909c5a6a262b228f4aa049501: Status 404 returned error can't find the container with id c1ad52291735099f1217b816b76c9eededebed1909c5a6a262b228f4aa049501 Jul 20 10:06:53.251948 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:53.251913 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:06:53.252045 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:53.251996 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:06:53.252111 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:53.252040 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:06:53.830086 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:53.830047 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" event={"ID":"cc1ed42a-bd19-45f0-ae10-5b7c25125317","Type":"ContainerStarted","Data":"a9bab60c71edb022c00e44c6c5ba36703f69d1c95a57ed03266d028b29cbbc99"} Jul 20 10:06:53.830501 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:53.830111 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" event={"ID":"cc1ed42a-bd19-45f0-ae10-5b7c25125317","Type":"ContainerStarted","Data":"c1ad52291735099f1217b816b76c9eededebed1909c5a6a262b228f4aa049501"} Jul 20 10:06:53.866269 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:53.866218 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" podStartSLOduration=1.8662031890000002 podStartE2EDuration="1.866203189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:06:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:06:53.862503203 +0000 UTC m=+1693.336604232" watchObservedRunningTime="2026-07-20 10:06:53.866203189 +0000 UTC m=+1693.340304220" Jul 20 10:06:54.094423 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:54.094325 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:54.099348 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:54.099325 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:54.835276 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:54.835242 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:54.836169 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:54.836149 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:06:56.993591 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:56.993526 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:57.107381 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.107346 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7spv\" (UniqueName: \"kubernetes.io/projected/4fc572e9-b214-4375-9baa-973922bd5d4c-kube-api-access-q7spv\") pod \"4fc572e9-b214-4375-9baa-973922bd5d4c\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " Jul 20 10:06:57.107580 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.107417 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-credential-socket\") pod \"4fc572e9-b214-4375-9baa-973922bd5d4c\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " Jul 20 10:06:57.107580 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.107446 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-workload-certs\") pod \"4fc572e9-b214-4375-9baa-973922bd5d4c\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " Jul 20 10:06:57.107580 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.107469 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fc572e9-b214-4375-9baa-973922bd5d4c-istiod-ca-cert\") pod \"4fc572e9-b214-4375-9baa-973922bd5d4c\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " Jul 20 10:06:57.107580 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.107484 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-data\") pod \"4fc572e9-b214-4375-9baa-973922bd5d4c\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " Jul 20 10:06:57.107580 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.107548 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-envoy\") pod \"4fc572e9-b214-4375-9baa-973922bd5d4c\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " Jul 20 10:06:57.107580 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.107572 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-podinfo\") pod \"4fc572e9-b214-4375-9baa-973922bd5d4c\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " Jul 20 10:06:57.107929 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.107599 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-workload-socket\") pod \"4fc572e9-b214-4375-9baa-973922bd5d4c\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " Jul 20 10:06:57.107929 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.107651 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-token\") pod \"4fc572e9-b214-4375-9baa-973922bd5d4c\" (UID: \"4fc572e9-b214-4375-9baa-973922bd5d4c\") " Jul 20 10:06:57.107929 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.107772 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4fc572e9-b214-4375-9baa-973922bd5d4c" (UID: "4fc572e9-b214-4375-9baa-973922bd5d4c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:06:57.107929 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.107785 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4fc572e9-b214-4375-9baa-973922bd5d4c" (UID: "4fc572e9-b214-4375-9baa-973922bd5d4c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:06:57.107929 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.107885 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fc572e9-b214-4375-9baa-973922bd5d4c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4fc572e9-b214-4375-9baa-973922bd5d4c" (UID: "4fc572e9-b214-4375-9baa-973922bd5d4c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:06:57.108168 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.108037 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4fc572e9-b214-4375-9baa-973922bd5d4c" (UID: "4fc572e9-b214-4375-9baa-973922bd5d4c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:06:57.108168 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.108094 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-credential-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:06:57.108168 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.108114 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-workload-certs\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:06:57.108168 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.108128 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fc572e9-b214-4375-9baa-973922bd5d4c-istiod-ca-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:06:57.108934 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.108901 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-data" (OuterVolumeSpecName: "istio-data") pod "4fc572e9-b214-4375-9baa-973922bd5d4c" (UID: "4fc572e9-b214-4375-9baa-973922bd5d4c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:06:57.109749 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.109726 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fc572e9-b214-4375-9baa-973922bd5d4c-kube-api-access-q7spv" (OuterVolumeSpecName: "kube-api-access-q7spv") pod "4fc572e9-b214-4375-9baa-973922bd5d4c" (UID: "4fc572e9-b214-4375-9baa-973922bd5d4c"). InnerVolumeSpecName "kube-api-access-q7spv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:06:57.109827 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.109761 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4fc572e9-b214-4375-9baa-973922bd5d4c" (UID: "4fc572e9-b214-4375-9baa-973922bd5d4c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:06:57.109827 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.109810 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-token" (OuterVolumeSpecName: "istio-token") pod "4fc572e9-b214-4375-9baa-973922bd5d4c" (UID: "4fc572e9-b214-4375-9baa-973922bd5d4c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:06:57.109982 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.109958 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4fc572e9-b214-4375-9baa-973922bd5d4c" (UID: "4fc572e9-b214-4375-9baa-973922bd5d4c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 10:06:57.209570 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.209528 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-envoy\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:06:57.209570 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.209568 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-podinfo\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:06:57.209570 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.209578 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-workload-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:06:57.209570 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.209588 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-token\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:06:57.209823 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.209596 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7spv\" (UniqueName: \"kubernetes.io/projected/4fc572e9-b214-4375-9baa-973922bd5d4c-kube-api-access-q7spv\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:06:57.209823 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.209606 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fc572e9-b214-4375-9baa-973922bd5d4c-istio-data\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:06:57.854296 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.854257 2577 generic.go:356] "Generic (PLEG): container finished" podID="4fc572e9-b214-4375-9baa-973922bd5d4c" containerID="90979019b8ab64100e9f9d6e1c05e18ffef54ffda7b3628d3ac6e7b67b814f88" exitCode=0 Jul 20 10:06:57.854509 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.854307 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" Jul 20 10:06:57.854509 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.854342 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" event={"ID":"4fc572e9-b214-4375-9baa-973922bd5d4c","Type":"ContainerDied","Data":"90979019b8ab64100e9f9d6e1c05e18ffef54ffda7b3628d3ac6e7b67b814f88"} Jul 20 10:06:57.854509 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.854404 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz" event={"ID":"4fc572e9-b214-4375-9baa-973922bd5d4c","Type":"ContainerDied","Data":"c4dff946694123eb2761d9bafeb23e98d700ebb1c23fccb26f57bf60309ade37"} Jul 20 10:06:57.854509 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.854446 2577 scope.go:117] "RemoveContainer" containerID="90979019b8ab64100e9f9d6e1c05e18ffef54ffda7b3628d3ac6e7b67b814f88" Jul 20 10:06:57.864062 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.864044 2577 scope.go:117] "RemoveContainer" containerID="a272bfa77792d9e7f2ecc1b65bcc44a90e42f52ee59f8d332e33531e4ea91616" Jul 20 10:06:57.872445 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.872425 2577 scope.go:117] "RemoveContainer" containerID="90979019b8ab64100e9f9d6e1c05e18ffef54ffda7b3628d3ac6e7b67b814f88" Jul 20 10:06:57.872679 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:06:57.872660 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90979019b8ab64100e9f9d6e1c05e18ffef54ffda7b3628d3ac6e7b67b814f88\": container with ID starting with 90979019b8ab64100e9f9d6e1c05e18ffef54ffda7b3628d3ac6e7b67b814f88 not found: ID does not exist" containerID="90979019b8ab64100e9f9d6e1c05e18ffef54ffda7b3628d3ac6e7b67b814f88" Jul 20 10:06:57.872748 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.872692 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90979019b8ab64100e9f9d6e1c05e18ffef54ffda7b3628d3ac6e7b67b814f88"} err="failed to get container status \"90979019b8ab64100e9f9d6e1c05e18ffef54ffda7b3628d3ac6e7b67b814f88\": rpc error: code = NotFound desc = could not find container \"90979019b8ab64100e9f9d6e1c05e18ffef54ffda7b3628d3ac6e7b67b814f88\": container with ID starting with 90979019b8ab64100e9f9d6e1c05e18ffef54ffda7b3628d3ac6e7b67b814f88 not found: ID does not exist" Jul 20 10:06:57.872748 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.872716 2577 scope.go:117] "RemoveContainer" containerID="a272bfa77792d9e7f2ecc1b65bcc44a90e42f52ee59f8d332e33531e4ea91616" Jul 20 10:06:57.872949 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:06:57.872933 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a272bfa77792d9e7f2ecc1b65bcc44a90e42f52ee59f8d332e33531e4ea91616\": container with ID starting with a272bfa77792d9e7f2ecc1b65bcc44a90e42f52ee59f8d332e33531e4ea91616 not found: ID does not exist" containerID="a272bfa77792d9e7f2ecc1b65bcc44a90e42f52ee59f8d332e33531e4ea91616" Jul 20 10:06:57.873037 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.872955 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a272bfa77792d9e7f2ecc1b65bcc44a90e42f52ee59f8d332e33531e4ea91616"} err="failed to get container status \"a272bfa77792d9e7f2ecc1b65bcc44a90e42f52ee59f8d332e33531e4ea91616\": rpc error: code = NotFound desc = could not find container \"a272bfa77792d9e7f2ecc1b65bcc44a90e42f52ee59f8d332e33531e4ea91616\": container with ID starting with a272bfa77792d9e7f2ecc1b65bcc44a90e42f52ee59f8d332e33531e4ea91616 not found: ID does not exist" Jul 20 10:06:57.876800 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.876778 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz"] Jul 20 10:06:57.880694 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:57.880674 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d4aaf29e-openshift-default-78c9d495dc-7hvvz"] Jul 20 10:06:59.024136 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:06:59.024104 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fc572e9-b214-4375-9baa-973922bd5d4c" path="/var/lib/kubelet/pods/4fc572e9-b214-4375-9baa-973922bd5d4c/volumes" Jul 20 10:07:09.836655 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:09.836612 2577 patch_prober.go:28] interesting pod/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 20 10:07:09.837129 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:09.836674 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" podUID="cc1ed42a-bd19-45f0-ae10-5b7c25125317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 20 10:07:09.925810 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:09.925771 2577 generic.go:356] "Generic (PLEG): container finished" podID="cc1ed42a-bd19-45f0-ae10-5b7c25125317" containerID="a9bab60c71edb022c00e44c6c5ba36703f69d1c95a57ed03266d028b29cbbc99" exitCode=0 Jul 20 10:07:09.926037 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:09.925822 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" event={"ID":"cc1ed42a-bd19-45f0-ae10-5b7c25125317","Type":"ContainerDied","Data":"a9bab60c71edb022c00e44c6c5ba36703f69d1c95a57ed03266d028b29cbbc99"} Jul 20 10:07:09.926317 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:09.926298 2577 scope.go:117] "RemoveContainer" containerID="a9bab60c71edb022c00e44c6c5ba36703f69d1c95a57ed03266d028b29cbbc99" Jul 20 10:07:09.927335 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:09.927305 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:07:09.927394 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:09.927375 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:07:09.927430 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:09.927410 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:07:10.933640 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:10.933594 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" event={"ID":"cc1ed42a-bd19-45f0-ae10-5b7c25125317","Type":"ContainerStarted","Data":"124134d06dd14bb3ae3a1e853ada9a514251990a815083518d065e6c9bd72d99"} Jul 20 10:07:11.094882 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:11.094827 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:07:11.095138 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:11.095117 2577 patch_prober.go:28] interesting pod/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 20 10:07:11.095225 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:11.095173 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" podUID="cc1ed42a-bd19-45f0-ae10-5b7c25125317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 20 10:07:12.094518 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:12.094480 2577 patch_prober.go:28] interesting pod/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 20 10:07:12.094939 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:12.094536 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" podUID="cc1ed42a-bd19-45f0-ae10-5b7c25125317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 20 10:07:13.095203 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:13.095159 2577 patch_prober.go:28] interesting pod/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 20 10:07:13.095637 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:13.095222 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" podUID="cc1ed42a-bd19-45f0-ae10-5b7c25125317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 20 10:07:14.095236 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:14.095192 2577 patch_prober.go:28] interesting pod/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 20 10:07:14.095635 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:14.095250 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" podUID="cc1ed42a-bd19-45f0-ae10-5b7c25125317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 20 10:07:15.099388 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:15.099355 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:07:15.099782 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:15.099704 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:07:15.100405 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:15.100389 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:07:35.544183 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:35.544146 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp"] Jul 20 10:07:35.544779 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:35.544419 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" podUID="cc1ed42a-bd19-45f0-ae10-5b7c25125317" containerName="istio-proxy" containerID="cri-o://124134d06dd14bb3ae3a1e853ada9a514251990a815083518d065e6c9bd72d99" gracePeriod=30 Jul 20 10:07:36.309386 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.309354 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4"] Jul 20 10:07:36.309713 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.309701 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc572e9-b214-4375-9baa-973922bd5d4c" containerName="istio-proxy" Jul 20 10:07:36.309761 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.309716 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc572e9-b214-4375-9baa-973922bd5d4c" containerName="istio-proxy" Jul 20 10:07:36.309761 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.309737 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc572e9-b214-4375-9baa-973922bd5d4c" containerName="istio-proxy" Jul 20 10:07:36.309761 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.309743 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc572e9-b214-4375-9baa-973922bd5d4c" containerName="istio-proxy" Jul 20 10:07:36.309870 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.309800 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fc572e9-b214-4375-9baa-973922bd5d4c" containerName="istio-proxy" Jul 20 10:07:36.309870 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.309809 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fc572e9-b214-4375-9baa-973922bd5d4c" containerName="istio-proxy" Jul 20 10:07:36.311960 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.311939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.314231 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.314212 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c5c080c1-openshift-default-dockercfg-zfw7j\"" Jul 20 10:07:36.325336 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.325306 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4"] Jul 20 10:07:36.396481 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.396436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-envoy\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.396667 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.396526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7tbw\" (UniqueName: \"kubernetes.io/projected/2b669bc8-441e-4d57-b3d3-68fa495948ce-kube-api-access-h7tbw\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.396667 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.396577 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-credential-socket\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.396667 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.396603 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-token\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.396815 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.396698 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-data\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.396815 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.396738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-workload-socket\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.396815 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.396765 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-podinfo\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.396815 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.396787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b669bc8-441e-4d57-b3d3-68fa495948ce-istiod-ca-cert\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.397018 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.396828 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-workload-certs\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.497947 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.497908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7tbw\" (UniqueName: \"kubernetes.io/projected/2b669bc8-441e-4d57-b3d3-68fa495948ce-kube-api-access-h7tbw\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.498161 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.497986 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-credential-socket\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.498161 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.498013 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-token\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.498161 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.498111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-data\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.498161 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.498140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-workload-socket\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.498392 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.498165 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-podinfo\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.498392 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.498192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b669bc8-441e-4d57-b3d3-68fa495948ce-istiod-ca-cert\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.498392 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.498245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-workload-certs\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.498392 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.498302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-envoy\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.498585 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.498562 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-data\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.498651 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.498619 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-workload-socket\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.498690 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.498674 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-workload-certs\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.498788 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.498767 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-credential-socket\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.499060 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.499041 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b669bc8-441e-4d57-b3d3-68fa495948ce-istiod-ca-cert\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.500650 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.500629 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-envoy\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.500789 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.500770 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-podinfo\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.505067 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.505043 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-token\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.505151 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.505123 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7tbw\" (UniqueName: \"kubernetes.io/projected/2b669bc8-441e-4d57-b3d3-68fa495948ce-kube-api-access-h7tbw\") pod \"e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.622880 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.622790 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:36.761293 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.761255 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4"] Jul 20 10:07:36.762341 ip-10-0-142-133 kubenswrapper[2577]: W0720 10:07:36.762303 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b669bc8_441e_4d57_b3d3_68fa495948ce.slice/crio-805719544bc433cac02d7a0409b35ee3552c257553cd32865544267c0fc91e69 WatchSource:0}: Error finding container 805719544bc433cac02d7a0409b35ee3552c257553cd32865544267c0fc91e69: Status 404 returned error can't find the container with id 805719544bc433cac02d7a0409b35ee3552c257553cd32865544267c0fc91e69 Jul 20 10:07:36.764572 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.764536 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:07:36.764659 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.764606 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:07:36.764659 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:36.764638 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:07:37.088070 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:37.088031 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" event={"ID":"2b669bc8-441e-4d57-b3d3-68fa495948ce","Type":"ContainerStarted","Data":"dbcde0795906a7f3cbf9bdffeccd55ea849c2725d1c11bf0fc906f0c0f800398"} Jul 20 10:07:37.088265 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:37.088097 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" event={"ID":"2b669bc8-441e-4d57-b3d3-68fa495948ce","Type":"ContainerStarted","Data":"805719544bc433cac02d7a0409b35ee3552c257553cd32865544267c0fc91e69"} Jul 20 10:07:37.109690 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:37.109640 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" podStartSLOduration=1.109622607 podStartE2EDuration="1.109622607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:07:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:07:37.10711874 +0000 UTC m=+1736.581219771" watchObservedRunningTime="2026-07-20 10:07:37.109622607 +0000 UTC m=+1736.583723638" Jul 20 10:07:37.623906 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:37.623837 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:37.628803 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:37.628779 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:38.093265 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:38.093231 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:38.094235 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:38.094214 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:40.805795 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.805721 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:07:40.941196 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.941161 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndv5w\" (UniqueName: \"kubernetes.io/projected/cc1ed42a-bd19-45f0-ae10-5b7c25125317-kube-api-access-ndv5w\") pod \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " Jul 20 10:07:40.941416 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.941220 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-data\") pod \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " Jul 20 10:07:40.941416 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.941267 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-workload-socket\") pod \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " Jul 20 10:07:40.941416 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.941302 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-workload-certs\") pod \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " Jul 20 10:07:40.941416 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.941328 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-podinfo\") pod \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " Jul 20 10:07:40.941416 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.941361 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-credential-socket\") pod \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " Jul 20 10:07:40.941698 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.941425 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-token\") pod \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " Jul 20 10:07:40.941698 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.941448 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istiod-ca-cert\") pod \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " Jul 20 10:07:40.941698 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.941476 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-envoy\") pod \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\" (UID: \"cc1ed42a-bd19-45f0-ae10-5b7c25125317\") " Jul 20 10:07:40.941698 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.941583 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc1ed42a-bd19-45f0-ae10-5b7c25125317" (UID: "cc1ed42a-bd19-45f0-ae10-5b7c25125317"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:07:40.941698 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.941651 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc1ed42a-bd19-45f0-ae10-5b7c25125317" (UID: "cc1ed42a-bd19-45f0-ae10-5b7c25125317"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:07:40.942005 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.941899 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-workload-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:07:40.942005 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.941923 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-workload-certs\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:07:40.942005 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.941952 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc1ed42a-bd19-45f0-ae10-5b7c25125317" (UID: "cc1ed42a-bd19-45f0-ae10-5b7c25125317"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:07:40.942167 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.942000 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc1ed42a-bd19-45f0-ae10-5b7c25125317" (UID: "cc1ed42a-bd19-45f0-ae10-5b7c25125317"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:07:40.942253 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.942212 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc1ed42a-bd19-45f0-ae10-5b7c25125317" (UID: "cc1ed42a-bd19-45f0-ae10-5b7c25125317"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:07:40.943540 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.943506 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc1ed42a-bd19-45f0-ae10-5b7c25125317" (UID: "cc1ed42a-bd19-45f0-ae10-5b7c25125317"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 10:07:40.943670 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.943577 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1ed42a-bd19-45f0-ae10-5b7c25125317-kube-api-access-ndv5w" (OuterVolumeSpecName: "kube-api-access-ndv5w") pod "cc1ed42a-bd19-45f0-ae10-5b7c25125317" (UID: "cc1ed42a-bd19-45f0-ae10-5b7c25125317"). InnerVolumeSpecName "kube-api-access-ndv5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:07:40.943670 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.943614 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc1ed42a-bd19-45f0-ae10-5b7c25125317" (UID: "cc1ed42a-bd19-45f0-ae10-5b7c25125317"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:07:40.943748 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:40.943693 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc1ed42a-bd19-45f0-ae10-5b7c25125317" (UID: "cc1ed42a-bd19-45f0-ae10-5b7c25125317"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:07:41.043051 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.043025 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-podinfo\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:07:41.043051 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.043053 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-credential-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:07:41.043210 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.043066 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-token\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:07:41.043210 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.043075 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istiod-ca-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:07:41.043210 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.043083 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-envoy\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:07:41.043210 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.043092 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndv5w\" (UniqueName: \"kubernetes.io/projected/cc1ed42a-bd19-45f0-ae10-5b7c25125317-kube-api-access-ndv5w\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:07:41.043210 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.043100 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc1ed42a-bd19-45f0-ae10-5b7c25125317-istio-data\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:07:41.110683 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.110647 2577 generic.go:356] "Generic (PLEG): container finished" podID="cc1ed42a-bd19-45f0-ae10-5b7c25125317" containerID="124134d06dd14bb3ae3a1e853ada9a514251990a815083518d065e6c9bd72d99" exitCode=0 Jul 20 10:07:41.110965 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.110706 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" Jul 20 10:07:41.110965 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.110733 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" event={"ID":"cc1ed42a-bd19-45f0-ae10-5b7c25125317","Type":"ContainerDied","Data":"124134d06dd14bb3ae3a1e853ada9a514251990a815083518d065e6c9bd72d99"} Jul 20 10:07:41.110965 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.110794 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp" event={"ID":"cc1ed42a-bd19-45f0-ae10-5b7c25125317","Type":"ContainerDied","Data":"c1ad52291735099f1217b816b76c9eededebed1909c5a6a262b228f4aa049501"} Jul 20 10:07:41.110965 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.110827 2577 scope.go:117] "RemoveContainer" containerID="124134d06dd14bb3ae3a1e853ada9a514251990a815083518d065e6c9bd72d99" Jul 20 10:07:41.120810 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.120791 2577 scope.go:117] "RemoveContainer" containerID="a9bab60c71edb022c00e44c6c5ba36703f69d1c95a57ed03266d028b29cbbc99" Jul 20 10:07:41.130664 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.130587 2577 scope.go:117] "RemoveContainer" containerID="124134d06dd14bb3ae3a1e853ada9a514251990a815083518d065e6c9bd72d99" Jul 20 10:07:41.131091 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:07:41.131068 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"124134d06dd14bb3ae3a1e853ada9a514251990a815083518d065e6c9bd72d99\": container with ID starting with 124134d06dd14bb3ae3a1e853ada9a514251990a815083518d065e6c9bd72d99 not found: ID does not exist" containerID="124134d06dd14bb3ae3a1e853ada9a514251990a815083518d065e6c9bd72d99" Jul 20 10:07:41.131194 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.131100 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"124134d06dd14bb3ae3a1e853ada9a514251990a815083518d065e6c9bd72d99"} err="failed to get container status \"124134d06dd14bb3ae3a1e853ada9a514251990a815083518d065e6c9bd72d99\": rpc error: code = NotFound desc = could not find container \"124134d06dd14bb3ae3a1e853ada9a514251990a815083518d065e6c9bd72d99\": container with ID starting with 124134d06dd14bb3ae3a1e853ada9a514251990a815083518d065e6c9bd72d99 not found: ID does not exist" Jul 20 10:07:41.131194 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.131128 2577 scope.go:117] "RemoveContainer" containerID="a9bab60c71edb022c00e44c6c5ba36703f69d1c95a57ed03266d028b29cbbc99" Jul 20 10:07:41.131423 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:07:41.131407 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9bab60c71edb022c00e44c6c5ba36703f69d1c95a57ed03266d028b29cbbc99\": container with ID starting with a9bab60c71edb022c00e44c6c5ba36703f69d1c95a57ed03266d028b29cbbc99 not found: ID does not exist" containerID="a9bab60c71edb022c00e44c6c5ba36703f69d1c95a57ed03266d028b29cbbc99" Jul 20 10:07:41.131463 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.131428 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9bab60c71edb022c00e44c6c5ba36703f69d1c95a57ed03266d028b29cbbc99"} err="failed to get container status \"a9bab60c71edb022c00e44c6c5ba36703f69d1c95a57ed03266d028b29cbbc99\": rpc error: code = NotFound desc = could not find container \"a9bab60c71edb022c00e44c6c5ba36703f69d1c95a57ed03266d028b29cbbc99\": container with ID starting with a9bab60c71edb022c00e44c6c5ba36703f69d1c95a57ed03266d028b29cbbc99 not found: ID does not exist" Jul 20 10:07:41.132533 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.132515 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp"] Jul 20 10:07:41.135501 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:41.135480 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-d95536fc-gw-openshift-default-8588446f95-gqhhp"] Jul 20 10:07:43.024251 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:43.024217 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc1ed42a-bd19-45f0-ae10-5b7c25125317" path="/var/lib/kubelet/pods/cc1ed42a-bd19-45f0-ae10-5b7c25125317/volumes" Jul 20 10:07:53.094570 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:53.094534 2577 patch_prober.go:28] interesting pod/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 20 10:07:53.094988 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:53.094605 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" podUID="2b669bc8-441e-4d57-b3d3-68fa495948ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 20 10:07:53.186562 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:53.186526 2577 generic.go:356] "Generic (PLEG): container finished" podID="2b669bc8-441e-4d57-b3d3-68fa495948ce" containerID="dbcde0795906a7f3cbf9bdffeccd55ea849c2725d1c11bf0fc906f0c0f800398" exitCode=0 Jul 20 10:07:53.186743 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:53.186604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" event={"ID":"2b669bc8-441e-4d57-b3d3-68fa495948ce","Type":"ContainerDied","Data":"dbcde0795906a7f3cbf9bdffeccd55ea849c2725d1c11bf0fc906f0c0f800398"} Jul 20 10:07:53.187048 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:53.187025 2577 scope.go:117] "RemoveContainer" containerID="dbcde0795906a7f3cbf9bdffeccd55ea849c2725d1c11bf0fc906f0c0f800398" Jul 20 10:07:53.188073 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:53.188041 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:07:53.188152 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:53.188125 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:07:53.188193 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:53.188171 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:07:54.193690 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:54.193650 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" event={"ID":"2b669bc8-441e-4d57-b3d3-68fa495948ce","Type":"ContainerStarted","Data":"94d27b729150f675f83a1f34fcd1f2d6a93ab9e5e346a4b57fb2524cf21a9309"} Jul 20 10:07:54.623144 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:54.623098 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:54.623401 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:54.623378 2577 patch_prober.go:28] interesting pod/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 20 10:07:54.623457 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:54.623430 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" podUID="2b669bc8-441e-4d57-b3d3-68fa495948ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 20 10:07:55.623297 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:55.623255 2577 patch_prober.go:28] interesting pod/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 20 10:07:55.623699 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:55.623312 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" podUID="2b669bc8-441e-4d57-b3d3-68fa495948ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 20 10:07:56.623336 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:56.623295 2577 patch_prober.go:28] interesting pod/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 20 10:07:56.623747 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:56.623361 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" podUID="2b669bc8-441e-4d57-b3d3-68fa495948ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 20 10:07:57.624033 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:57.623994 2577 patch_prober.go:28] interesting pod/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 20 10:07:57.624487 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:57.624060 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" podUID="2b669bc8-441e-4d57-b3d3-68fa495948ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 20 10:07:58.627548 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:58.627519 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:58.627961 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:58.627781 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:07:58.628505 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:07:58.628485 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:08:20.517422 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:20.517368 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4"] Jul 20 10:08:20.518031 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:20.517630 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" podUID="2b669bc8-441e-4d57-b3d3-68fa495948ce" containerName="istio-proxy" containerID="cri-o://94d27b729150f675f83a1f34fcd1f2d6a93ab9e5e346a4b57fb2524cf21a9309" gracePeriod=30 Jul 20 10:08:21.302471 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.302426 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf"] Jul 20 10:08:21.302957 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.302936 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1ed42a-bd19-45f0-ae10-5b7c25125317" containerName="istio-proxy" Jul 20 10:08:21.302957 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.302958 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1ed42a-bd19-45f0-ae10-5b7c25125317" containerName="istio-proxy" Jul 20 10:08:21.303127 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.302990 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1ed42a-bd19-45f0-ae10-5b7c25125317" containerName="istio-proxy" Jul 20 10:08:21.303127 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.302999 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1ed42a-bd19-45f0-ae10-5b7c25125317" containerName="istio-proxy" Jul 20 10:08:21.303127 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.303096 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1ed42a-bd19-45f0-ae10-5b7c25125317" containerName="istio-proxy" Jul 20 10:08:21.306508 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.306487 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.308879 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.308857 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-26b8b528-openshift-default-dockercfg-9ndk8\"" Jul 20 10:08:21.320265 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.320230 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf"] Jul 20 10:08:21.415109 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.415070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-workload-socket\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.415326 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.415127 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-envoy\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.415326 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.415148 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-podinfo\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.415326 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.415266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-credential-socket\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.415488 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.415328 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-data\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.415488 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.415367 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhjn5\" (UniqueName: \"kubernetes.io/projected/d85febe9-5b1e-4641-901d-5895cfb0ee7b-kube-api-access-qhjn5\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.415488 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.415408 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-workload-certs\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.415488 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.415432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istiod-ca-cert\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.415488 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.415479 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-token\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.517025 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.516984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istiod-ca-cert\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.517248 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.517048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-token\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.517248 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.517098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-workload-socket\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.517248 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.517144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-envoy\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.517248 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.517172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-podinfo\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.517248 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.517214 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-credential-socket\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.517893 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.517266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-data\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.517893 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.517307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhjn5\" (UniqueName: \"kubernetes.io/projected/d85febe9-5b1e-4641-901d-5895cfb0ee7b-kube-api-access-qhjn5\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.517893 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.517344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-workload-certs\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.517893 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.517609 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-workload-socket\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.517893 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.517695 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-credential-socket\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.517893 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.517751 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-data\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.517893 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.517816 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-workload-certs\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.517893 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.517880 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istiod-ca-cert\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.519638 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.519616 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-envoy\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.520074 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.520055 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-podinfo\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.525775 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.525746 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-token\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.525920 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.525894 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhjn5\" (UniqueName: \"kubernetes.io/projected/d85febe9-5b1e-4641-901d-5895cfb0ee7b-kube-api-access-qhjn5\") pod \"e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.616958 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.616917 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:21.766672 ip-10-0-142-133 kubenswrapper[2577]: W0720 10:08:21.766642 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85febe9_5b1e_4641_901d_5895cfb0ee7b.slice/crio-bb4e05a68bfc50bb8ba1ef991fd0df662a4dbb1201ec4acf8a9b73a329bf3218 WatchSource:0}: Error finding container bb4e05a68bfc50bb8ba1ef991fd0df662a4dbb1201ec4acf8a9b73a329bf3218: Status 404 returned error can't find the container with id bb4e05a68bfc50bb8ba1ef991fd0df662a4dbb1201ec4acf8a9b73a329bf3218 Jul 20 10:08:21.766804 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.766772 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf"] Jul 20 10:08:21.769199 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.769154 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:08:21.769289 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.769254 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:08:21.769332 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:21.769309 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:08:22.348823 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:22.348786 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" event={"ID":"d85febe9-5b1e-4641-901d-5895cfb0ee7b","Type":"ContainerStarted","Data":"09e9cf6a7cf146865a6b04d5a8bfa93a670b690db8bc6b216b6ec7e454c0ef80"} Jul 20 10:08:22.349020 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:22.348947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" event={"ID":"d85febe9-5b1e-4641-901d-5895cfb0ee7b","Type":"ContainerStarted","Data":"bb4e05a68bfc50bb8ba1ef991fd0df662a4dbb1201ec4acf8a9b73a329bf3218"} Jul 20 10:08:22.377613 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:22.377556 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" podStartSLOduration=1.377540068 podStartE2EDuration="1.377540068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:08:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:08:22.373750616 +0000 UTC m=+1781.847851648" watchObservedRunningTime="2026-07-20 10:08:22.377540068 +0000 UTC m=+1781.851641098" Jul 20 10:08:22.617736 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:22.617635 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:22.622513 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:22.622484 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:23.354280 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:23.354249 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:23.355209 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:23.355187 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:25.779241 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.779180 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:08:25.962506 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.962468 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-envoy\") pod \"2b669bc8-441e-4d57-b3d3-68fa495948ce\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " Jul 20 10:08:25.962506 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.962510 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b669bc8-441e-4d57-b3d3-68fa495948ce-istiod-ca-cert\") pod \"2b669bc8-441e-4d57-b3d3-68fa495948ce\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " Jul 20 10:08:25.962764 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.962579 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-credential-socket\") pod \"2b669bc8-441e-4d57-b3d3-68fa495948ce\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " Jul 20 10:08:25.962764 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.962607 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-token\") pod \"2b669bc8-441e-4d57-b3d3-68fa495948ce\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " Jul 20 10:08:25.962764 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.962629 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-podinfo\") pod \"2b669bc8-441e-4d57-b3d3-68fa495948ce\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " Jul 20 10:08:25.962764 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.962681 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-data\") pod \"2b669bc8-441e-4d57-b3d3-68fa495948ce\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " Jul 20 10:08:25.962764 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.962705 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-workload-certs\") pod \"2b669bc8-441e-4d57-b3d3-68fa495948ce\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " Jul 20 10:08:25.962764 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.962734 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7tbw\" (UniqueName: \"kubernetes.io/projected/2b669bc8-441e-4d57-b3d3-68fa495948ce-kube-api-access-h7tbw\") pod \"2b669bc8-441e-4d57-b3d3-68fa495948ce\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " Jul 20 10:08:25.963109 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.962777 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-workload-socket\") pod \"2b669bc8-441e-4d57-b3d3-68fa495948ce\" (UID: \"2b669bc8-441e-4d57-b3d3-68fa495948ce\") " Jul 20 10:08:25.963109 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.962929 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2b669bc8-441e-4d57-b3d3-68fa495948ce" (UID: "2b669bc8-441e-4d57-b3d3-68fa495948ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:08:25.963226 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.963061 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b669bc8-441e-4d57-b3d3-68fa495948ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2b669bc8-441e-4d57-b3d3-68fa495948ce" (UID: "2b669bc8-441e-4d57-b3d3-68fa495948ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:08:25.963226 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.963123 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2b669bc8-441e-4d57-b3d3-68fa495948ce" (UID: "2b669bc8-441e-4d57-b3d3-68fa495948ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:08:25.963226 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.963164 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2b669bc8-441e-4d57-b3d3-68fa495948ce" (UID: "2b669bc8-441e-4d57-b3d3-68fa495948ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:08:25.963226 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.963148 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-credential-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:08:25.963718 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.963693 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "2b669bc8-441e-4d57-b3d3-68fa495948ce" (UID: "2b669bc8-441e-4d57-b3d3-68fa495948ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:08:25.964817 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.964790 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "2b669bc8-441e-4d57-b3d3-68fa495948ce" (UID: "2b669bc8-441e-4d57-b3d3-68fa495948ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:08:25.964948 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.964879 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2b669bc8-441e-4d57-b3d3-68fa495948ce" (UID: "2b669bc8-441e-4d57-b3d3-68fa495948ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:08:25.965219 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.965199 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b669bc8-441e-4d57-b3d3-68fa495948ce-kube-api-access-h7tbw" (OuterVolumeSpecName: "kube-api-access-h7tbw") pod "2b669bc8-441e-4d57-b3d3-68fa495948ce" (UID: "2b669bc8-441e-4d57-b3d3-68fa495948ce"). InnerVolumeSpecName "kube-api-access-h7tbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:08:25.965322 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:25.965234 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2b669bc8-441e-4d57-b3d3-68fa495948ce" (UID: "2b669bc8-441e-4d57-b3d3-68fa495948ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 10:08:26.064208 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.064170 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-data\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:08:26.064208 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.064207 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-workload-certs\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:08:26.064407 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.064216 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7tbw\" (UniqueName: \"kubernetes.io/projected/2b669bc8-441e-4d57-b3d3-68fa495948ce-kube-api-access-h7tbw\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:08:26.064407 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.064226 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-workload-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:08:26.064407 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.064235 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-envoy\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:08:26.064407 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.064243 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b669bc8-441e-4d57-b3d3-68fa495948ce-istiod-ca-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:08:26.064407 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.064251 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-token\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:08:26.064407 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.064258 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b669bc8-441e-4d57-b3d3-68fa495948ce-istio-podinfo\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:08:26.372317 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.372214 2577 generic.go:356] "Generic (PLEG): container finished" podID="2b669bc8-441e-4d57-b3d3-68fa495948ce" containerID="94d27b729150f675f83a1f34fcd1f2d6a93ab9e5e346a4b57fb2524cf21a9309" exitCode=0 Jul 20 10:08:26.372317 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.372283 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" Jul 20 10:08:26.372317 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.372298 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" event={"ID":"2b669bc8-441e-4d57-b3d3-68fa495948ce","Type":"ContainerDied","Data":"94d27b729150f675f83a1f34fcd1f2d6a93ab9e5e346a4b57fb2524cf21a9309"} Jul 20 10:08:26.372595 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.372378 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4" event={"ID":"2b669bc8-441e-4d57-b3d3-68fa495948ce","Type":"ContainerDied","Data":"805719544bc433cac02d7a0409b35ee3552c257553cd32865544267c0fc91e69"} Jul 20 10:08:26.372595 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.372403 2577 scope.go:117] "RemoveContainer" containerID="94d27b729150f675f83a1f34fcd1f2d6a93ab9e5e346a4b57fb2524cf21a9309" Jul 20 10:08:26.382266 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.382246 2577 scope.go:117] "RemoveContainer" containerID="dbcde0795906a7f3cbf9bdffeccd55ea849c2725d1c11bf0fc906f0c0f800398" Jul 20 10:08:26.390744 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.390726 2577 scope.go:117] "RemoveContainer" containerID="94d27b729150f675f83a1f34fcd1f2d6a93ab9e5e346a4b57fb2524cf21a9309" Jul 20 10:08:26.391023 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:08:26.391005 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94d27b729150f675f83a1f34fcd1f2d6a93ab9e5e346a4b57fb2524cf21a9309\": container with ID starting with 94d27b729150f675f83a1f34fcd1f2d6a93ab9e5e346a4b57fb2524cf21a9309 not found: ID does not exist" containerID="94d27b729150f675f83a1f34fcd1f2d6a93ab9e5e346a4b57fb2524cf21a9309" Jul 20 10:08:26.391078 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.391033 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94d27b729150f675f83a1f34fcd1f2d6a93ab9e5e346a4b57fb2524cf21a9309"} err="failed to get container status \"94d27b729150f675f83a1f34fcd1f2d6a93ab9e5e346a4b57fb2524cf21a9309\": rpc error: code = NotFound desc = could not find container \"94d27b729150f675f83a1f34fcd1f2d6a93ab9e5e346a4b57fb2524cf21a9309\": container with ID starting with 94d27b729150f675f83a1f34fcd1f2d6a93ab9e5e346a4b57fb2524cf21a9309 not found: ID does not exist" Jul 20 10:08:26.391078 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.391051 2577 scope.go:117] "RemoveContainer" containerID="dbcde0795906a7f3cbf9bdffeccd55ea849c2725d1c11bf0fc906f0c0f800398" Jul 20 10:08:26.391253 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:08:26.391238 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbcde0795906a7f3cbf9bdffeccd55ea849c2725d1c11bf0fc906f0c0f800398\": container with ID starting with dbcde0795906a7f3cbf9bdffeccd55ea849c2725d1c11bf0fc906f0c0f800398 not found: ID does not exist" containerID="dbcde0795906a7f3cbf9bdffeccd55ea849c2725d1c11bf0fc906f0c0f800398" Jul 20 10:08:26.391292 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.391259 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbcde0795906a7f3cbf9bdffeccd55ea849c2725d1c11bf0fc906f0c0f800398"} err="failed to get container status \"dbcde0795906a7f3cbf9bdffeccd55ea849c2725d1c11bf0fc906f0c0f800398\": rpc error: code = NotFound desc = could not find container \"dbcde0795906a7f3cbf9bdffeccd55ea849c2725d1c11bf0fc906f0c0f800398\": container with ID starting with dbcde0795906a7f3cbf9bdffeccd55ea849c2725d1c11bf0fc906f0c0f800398 not found: ID does not exist" Jul 20 10:08:26.395878 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.395792 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4"] Jul 20 10:08:26.399339 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:26.399313 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c5c080c1-openshift-default-8587f9b9d9-9sst4"] Jul 20 10:08:27.023989 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:27.023956 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b669bc8-441e-4d57-b3d3-68fa495948ce" path="/var/lib/kubelet/pods/2b669bc8-441e-4d57-b3d3-68fa495948ce/volumes" Jul 20 10:08:38.355332 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:38.355289 2577 patch_prober.go:28] interesting pod/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 20 10:08:38.355818 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:38.355354 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" podUID="d85febe9-5b1e-4641-901d-5895cfb0ee7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 20 10:08:38.439578 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:38.439540 2577 generic.go:356] "Generic (PLEG): container finished" podID="d85febe9-5b1e-4641-901d-5895cfb0ee7b" containerID="09e9cf6a7cf146865a6b04d5a8bfa93a670b690db8bc6b216b6ec7e454c0ef80" exitCode=0 Jul 20 10:08:38.439767 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:38.439614 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" event={"ID":"d85febe9-5b1e-4641-901d-5895cfb0ee7b","Type":"ContainerDied","Data":"09e9cf6a7cf146865a6b04d5a8bfa93a670b690db8bc6b216b6ec7e454c0ef80"} Jul 20 10:08:38.440073 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:38.440060 2577 scope.go:117] "RemoveContainer" containerID="09e9cf6a7cf146865a6b04d5a8bfa93a670b690db8bc6b216b6ec7e454c0ef80" Jul 20 10:08:38.441105 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:38.441075 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:08:38.441176 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:38.441146 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:08:38.441216 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:38.441182 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:08:39.455994 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:39.455951 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" event={"ID":"d85febe9-5b1e-4641-901d-5895cfb0ee7b","Type":"ContainerStarted","Data":"0b964c72e533635ba748a4b11a4c2622c60ad3cb9b7015642c1a6de54fd64e53"} Jul 20 10:08:39.617341 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:39.617291 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:39.617539 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:39.617515 2577 patch_prober.go:28] interesting pod/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 20 10:08:39.617592 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:39.617569 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" podUID="d85febe9-5b1e-4641-901d-5895cfb0ee7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 20 10:08:40.617723 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:40.617683 2577 patch_prober.go:28] interesting pod/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 20 10:08:40.618163 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:40.617757 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" podUID="d85febe9-5b1e-4641-901d-5895cfb0ee7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 20 10:08:41.106275 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:41.106237 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 10:08:41.109752 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:41.109726 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 10:08:41.618173 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:41.618130 2577 patch_prober.go:28] interesting pod/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 20 10:08:41.618581 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:41.618208 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" podUID="d85febe9-5b1e-4641-901d-5895cfb0ee7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 20 10:08:42.617913 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:42.617837 2577 patch_prober.go:28] interesting pod/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 20 10:08:42.618112 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:42.617938 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" podUID="d85febe9-5b1e-4641-901d-5895cfb0ee7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 20 10:08:43.621408 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:43.621376 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:43.621885 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:43.621646 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:08:43.622497 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:08:43.622480 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:09:03.799195 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:03.799163 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf"] Jul 20 10:09:03.799717 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:03.799372 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" podUID="d85febe9-5b1e-4641-901d-5895cfb0ee7b" containerName="istio-proxy" containerID="cri-o://0b964c72e533635ba748a4b11a4c2622c60ad3cb9b7015642c1a6de54fd64e53" gracePeriod=30 Jul 20 10:09:09.055416 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.055389 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:09:09.167667 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.167622 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-data\") pod \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " Jul 20 10:09:09.167667 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.167672 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-token\") pod \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " Jul 20 10:09:09.167963 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.167692 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-workload-certs\") pod \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " Jul 20 10:09:09.167963 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.167716 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-workload-socket\") pod \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " Jul 20 10:09:09.167963 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.167739 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhjn5\" (UniqueName: \"kubernetes.io/projected/d85febe9-5b1e-4641-901d-5895cfb0ee7b-kube-api-access-qhjn5\") pod \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " Jul 20 10:09:09.167963 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.167763 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istiod-ca-cert\") pod \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " Jul 20 10:09:09.167963 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.167804 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-credential-socket\") pod \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " Jul 20 10:09:09.167963 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.167836 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-podinfo\") pod \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " Jul 20 10:09:09.167963 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.167917 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-envoy\") pod \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\" (UID: \"d85febe9-5b1e-4641-901d-5895cfb0ee7b\") " Jul 20 10:09:09.168332 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.168055 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d85febe9-5b1e-4641-901d-5895cfb0ee7b" (UID: "d85febe9-5b1e-4641-901d-5895cfb0ee7b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:09:09.168332 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.168167 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d85febe9-5b1e-4641-901d-5895cfb0ee7b" (UID: "d85febe9-5b1e-4641-901d-5895cfb0ee7b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:09:09.168332 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.168266 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d85febe9-5b1e-4641-901d-5895cfb0ee7b" (UID: "d85febe9-5b1e-4641-901d-5895cfb0ee7b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:09:09.168332 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.168288 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-workload-certs\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:09:09.168332 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.168314 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-workload-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:09:09.168576 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.168534 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d85febe9-5b1e-4641-901d-5895cfb0ee7b" (UID: "d85febe9-5b1e-4641-901d-5895cfb0ee7b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:09:09.168683 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.168661 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-data" (OuterVolumeSpecName: "istio-data") pod "d85febe9-5b1e-4641-901d-5895cfb0ee7b" (UID: "d85febe9-5b1e-4641-901d-5895cfb0ee7b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:09:09.170416 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.170390 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d85febe9-5b1e-4641-901d-5895cfb0ee7b" (UID: "d85febe9-5b1e-4641-901d-5895cfb0ee7b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:09:09.170416 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.170412 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-token" (OuterVolumeSpecName: "istio-token") pod "d85febe9-5b1e-4641-901d-5895cfb0ee7b" (UID: "d85febe9-5b1e-4641-901d-5895cfb0ee7b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:09:09.170559 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.170499 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d85febe9-5b1e-4641-901d-5895cfb0ee7b" (UID: "d85febe9-5b1e-4641-901d-5895cfb0ee7b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 10:09:09.170559 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.170497 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d85febe9-5b1e-4641-901d-5895cfb0ee7b-kube-api-access-qhjn5" (OuterVolumeSpecName: "kube-api-access-qhjn5") pod "d85febe9-5b1e-4641-901d-5895cfb0ee7b" (UID: "d85febe9-5b1e-4641-901d-5895cfb0ee7b"). InnerVolumeSpecName "kube-api-access-qhjn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:09:09.269190 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.269143 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-data\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:09:09.269190 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.269182 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-token\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:09:09.269190 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.269194 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhjn5\" (UniqueName: \"kubernetes.io/projected/d85febe9-5b1e-4641-901d-5895cfb0ee7b-kube-api-access-qhjn5\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:09:09.269448 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.269205 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istiod-ca-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:09:09.269448 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.269218 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-credential-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:09:09.269448 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.269228 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-podinfo\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:09:09.269448 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.269239 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d85febe9-5b1e-4641-901d-5895cfb0ee7b-istio-envoy\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:09:09.620800 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.620766 2577 generic.go:356] "Generic (PLEG): container finished" podID="d85febe9-5b1e-4641-901d-5895cfb0ee7b" containerID="0b964c72e533635ba748a4b11a4c2622c60ad3cb9b7015642c1a6de54fd64e53" exitCode=0 Jul 20 10:09:09.621021 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.620807 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" event={"ID":"d85febe9-5b1e-4641-901d-5895cfb0ee7b","Type":"ContainerDied","Data":"0b964c72e533635ba748a4b11a4c2622c60ad3cb9b7015642c1a6de54fd64e53"} Jul 20 10:09:09.621021 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.620826 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" Jul 20 10:09:09.621021 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.620873 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf" event={"ID":"d85febe9-5b1e-4641-901d-5895cfb0ee7b","Type":"ContainerDied","Data":"bb4e05a68bfc50bb8ba1ef991fd0df662a4dbb1201ec4acf8a9b73a329bf3218"} Jul 20 10:09:09.621021 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.620896 2577 scope.go:117] "RemoveContainer" containerID="0b964c72e533635ba748a4b11a4c2622c60ad3cb9b7015642c1a6de54fd64e53" Jul 20 10:09:09.630911 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.630891 2577 scope.go:117] "RemoveContainer" containerID="09e9cf6a7cf146865a6b04d5a8bfa93a670b690db8bc6b216b6ec7e454c0ef80" Jul 20 10:09:09.639305 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.639214 2577 scope.go:117] "RemoveContainer" containerID="0b964c72e533635ba748a4b11a4c2622c60ad3cb9b7015642c1a6de54fd64e53" Jul 20 10:09:09.639523 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:09:09.639503 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b964c72e533635ba748a4b11a4c2622c60ad3cb9b7015642c1a6de54fd64e53\": container with ID starting with 0b964c72e533635ba748a4b11a4c2622c60ad3cb9b7015642c1a6de54fd64e53 not found: ID does not exist" containerID="0b964c72e533635ba748a4b11a4c2622c60ad3cb9b7015642c1a6de54fd64e53" Jul 20 10:09:09.639579 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.639532 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b964c72e533635ba748a4b11a4c2622c60ad3cb9b7015642c1a6de54fd64e53"} err="failed to get container status \"0b964c72e533635ba748a4b11a4c2622c60ad3cb9b7015642c1a6de54fd64e53\": rpc error: code = NotFound desc = could not find container \"0b964c72e533635ba748a4b11a4c2622c60ad3cb9b7015642c1a6de54fd64e53\": container with ID starting with 0b964c72e533635ba748a4b11a4c2622c60ad3cb9b7015642c1a6de54fd64e53 not found: ID does not exist" Jul 20 10:09:09.639579 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.639552 2577 scope.go:117] "RemoveContainer" containerID="09e9cf6a7cf146865a6b04d5a8bfa93a670b690db8bc6b216b6ec7e454c0ef80" Jul 20 10:09:09.639788 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:09:09.639770 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09e9cf6a7cf146865a6b04d5a8bfa93a670b690db8bc6b216b6ec7e454c0ef80\": container with ID starting with 09e9cf6a7cf146865a6b04d5a8bfa93a670b690db8bc6b216b6ec7e454c0ef80 not found: ID does not exist" containerID="09e9cf6a7cf146865a6b04d5a8bfa93a670b690db8bc6b216b6ec7e454c0ef80" Jul 20 10:09:09.639863 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.639798 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09e9cf6a7cf146865a6b04d5a8bfa93a670b690db8bc6b216b6ec7e454c0ef80"} err="failed to get container status \"09e9cf6a7cf146865a6b04d5a8bfa93a670b690db8bc6b216b6ec7e454c0ef80\": rpc error: code = NotFound desc = could not find container \"09e9cf6a7cf146865a6b04d5a8bfa93a670b690db8bc6b216b6ec7e454c0ef80\": container with ID starting with 09e9cf6a7cf146865a6b04d5a8bfa93a670b690db8bc6b216b6ec7e454c0ef80 not found: ID does not exist" Jul 20 10:09:09.645487 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.645460 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf"] Jul 20 10:09:09.649919 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:09.649894 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-26b8b528-openshift-default-567c4455bc-q85zf"] Jul 20 10:09:11.024645 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:09:11.024611 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d85febe9-5b1e-4641-901d-5895cfb0ee7b" path="/var/lib/kubelet/pods/d85febe9-5b1e-4641-901d-5895cfb0ee7b/volumes" Jul 20 10:10:40.723756 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.723709 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x"] Jul 20 10:10:40.724278 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.724129 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85febe9-5b1e-4641-901d-5895cfb0ee7b" containerName="istio-proxy" Jul 20 10:10:40.724278 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.724143 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85febe9-5b1e-4641-901d-5895cfb0ee7b" containerName="istio-proxy" Jul 20 10:10:40.724278 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.724150 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85febe9-5b1e-4641-901d-5895cfb0ee7b" containerName="istio-proxy" Jul 20 10:10:40.724278 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.724156 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85febe9-5b1e-4641-901d-5895cfb0ee7b" containerName="istio-proxy" Jul 20 10:10:40.724278 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.724169 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b669bc8-441e-4d57-b3d3-68fa495948ce" containerName="istio-proxy" Jul 20 10:10:40.724278 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.724175 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b669bc8-441e-4d57-b3d3-68fa495948ce" containerName="istio-proxy" Jul 20 10:10:40.724278 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.724194 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b669bc8-441e-4d57-b3d3-68fa495948ce" containerName="istio-proxy" Jul 20 10:10:40.724278 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.724200 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b669bc8-441e-4d57-b3d3-68fa495948ce" containerName="istio-proxy" Jul 20 10:10:40.724278 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.724254 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85febe9-5b1e-4641-901d-5895cfb0ee7b" containerName="istio-proxy" Jul 20 10:10:40.724278 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.724262 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85febe9-5b1e-4641-901d-5895cfb0ee7b" containerName="istio-proxy" Jul 20 10:10:40.724278 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.724269 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b669bc8-441e-4d57-b3d3-68fa495948ce" containerName="istio-proxy" Jul 20 10:10:40.724278 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.724275 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b669bc8-441e-4d57-b3d3-68fa495948ce" containerName="istio-proxy" Jul 20 10:10:40.724278 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.724280 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1ed42a-bd19-45f0-ae10-5b7c25125317" containerName="istio-proxy" Jul 20 10:10:40.727274 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.727254 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.729442 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.729417 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bc2fab5a-openshift-default-dockercfg-q6ghs\"" Jul 20 10:10:40.749929 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.749889 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x"] Jul 20 10:10:40.897063 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.897024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-credential-socket\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.897063 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.897063 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-token\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.897293 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.897098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-workload-socket\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.897293 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.897154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-podinfo\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.897293 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.897174 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c363285-aec2-4677-abdf-fd1b6f9a2007-istiod-ca-cert\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.897293 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.897247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-data\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.897293 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.897281 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rtmd\" (UniqueName: \"kubernetes.io/projected/0c363285-aec2-4677-abdf-fd1b6f9a2007-kube-api-access-9rtmd\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.897451 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.897341 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-workload-certs\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.897451 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.897363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-envoy\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.998679 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.998586 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-workload-socket\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.998679 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.998635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-podinfo\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.998679 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.998659 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c363285-aec2-4677-abdf-fd1b6f9a2007-istiod-ca-cert\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.999069 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.998699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-data\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.999069 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.998738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rtmd\" (UniqueName: \"kubernetes.io/projected/0c363285-aec2-4677-abdf-fd1b6f9a2007-kube-api-access-9rtmd\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.999069 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.998802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-workload-certs\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.999069 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.998837 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-envoy\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.999069 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.998895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-credential-socket\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.999069 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.998922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-token\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.999371 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.999134 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-workload-socket\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.999371 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.999134 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-data\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.999371 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.999360 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-credential-socket\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.999495 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.999428 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-workload-certs\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:40.999606 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:40.999581 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c363285-aec2-4677-abdf-fd1b6f9a2007-istiod-ca-cert\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:41.001148 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:41.001125 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-envoy\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:41.001481 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:41.001458 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-podinfo\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:41.006695 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:41.006666 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-token\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:41.006802 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:41.006784 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rtmd\" (UniqueName: \"kubernetes.io/projected/0c363285-aec2-4677-abdf-fd1b6f9a2007-kube-api-access-9rtmd\") pod \"e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:41.040267 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:41.040239 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bc2fab5a-openshift-default-dockercfg-q6ghs\"" Jul 20 10:10:41.048964 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:41.048938 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:41.197389 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:41.197359 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x"] Jul 20 10:10:41.198878 ip-10-0-142-133 kubenswrapper[2577]: W0720 10:10:41.198835 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c363285_aec2_4677_abdf_fd1b6f9a2007.slice/crio-dbffe6966cb4794fd9d347c48b958c0fb02d8ba1efc32949bba9a6d6b74b0a11 WatchSource:0}: Error finding container dbffe6966cb4794fd9d347c48b958c0fb02d8ba1efc32949bba9a6d6b74b0a11: Status 404 returned error can't find the container with id dbffe6966cb4794fd9d347c48b958c0fb02d8ba1efc32949bba9a6d6b74b0a11 Jul 20 10:10:41.201393 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:41.201358 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:10:41.201478 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:41.201427 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:10:41.201478 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:41.201456 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:10:42.125772 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:42.125726 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" event={"ID":"0c363285-aec2-4677-abdf-fd1b6f9a2007","Type":"ContainerStarted","Data":"a094e0e65cead1f5901aee54a8f50f48618e77aaa8bd58b47dfc4e7a7529366e"} Jul 20 10:10:42.126218 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:42.125789 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" event={"ID":"0c363285-aec2-4677-abdf-fd1b6f9a2007","Type":"ContainerStarted","Data":"dbffe6966cb4794fd9d347c48b958c0fb02d8ba1efc32949bba9a6d6b74b0a11"} Jul 20 10:10:42.147600 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:42.147549 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" podStartSLOduration=2.147531171 podStartE2EDuration="2.147531171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:10:42.144414123 +0000 UTC m=+1921.618515155" watchObservedRunningTime="2026-07-20 10:10:42.147531171 +0000 UTC m=+1921.621632272" Jul 20 10:10:43.049185 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:43.049144 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:43.054722 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:43.054693 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:43.131631 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:43.131600 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:43.132758 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:43.132736 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:53.193211 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:53.193129 2577 generic.go:356] "Generic (PLEG): container finished" podID="0c363285-aec2-4677-abdf-fd1b6f9a2007" containerID="a094e0e65cead1f5901aee54a8f50f48618e77aaa8bd58b47dfc4e7a7529366e" exitCode=0 Jul 20 10:10:53.193211 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:53.193200 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" event={"ID":"0c363285-aec2-4677-abdf-fd1b6f9a2007","Type":"ContainerDied","Data":"a094e0e65cead1f5901aee54a8f50f48618e77aaa8bd58b47dfc4e7a7529366e"} Jul 20 10:10:53.193697 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:53.193602 2577 scope.go:117] "RemoveContainer" containerID="a094e0e65cead1f5901aee54a8f50f48618e77aaa8bd58b47dfc4e7a7529366e" Jul 20 10:10:53.194572 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:53.194546 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:10:53.194633 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:53.194619 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:10:53.194679 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:53.194659 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:10:54.200606 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:54.200572 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" event={"ID":"0c363285-aec2-4677-abdf-fd1b6f9a2007","Type":"ContainerStarted","Data":"1e8746607809a00cb2c990a55aa8adfd61e90ae62c06a6f46a941d353d2a27d5"} Jul 20 10:10:55.051305 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:55.051256 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:55.051525 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:55.051456 2577 patch_prober.go:28] interesting pod/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 20 10:10:55.051599 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:55.051522 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" podUID="0c363285-aec2-4677-abdf-fd1b6f9a2007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 20 10:10:56.050336 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:56.050291 2577 patch_prober.go:28] interesting pod/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 20 10:10:56.050902 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:56.050383 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" podUID="0c363285-aec2-4677-abdf-fd1b6f9a2007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 20 10:10:57.050293 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:57.050240 2577 patch_prober.go:28] interesting pod/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 20 10:10:57.050524 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:57.050355 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" podUID="0c363285-aec2-4677-abdf-fd1b6f9a2007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 20 10:10:58.049864 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:58.049799 2577 patch_prober.go:28] interesting pod/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 20 10:10:58.050083 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:58.049896 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" podUID="0c363285-aec2-4677-abdf-fd1b6f9a2007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 20 10:10:58.131952 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:58.131912 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:59.053458 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:59.053427 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:10:59.054513 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:10:59.054495 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:11:17.291483 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:17.291448 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x"] Jul 20 10:11:17.292071 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:17.291668 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" podUID="0c363285-aec2-4677-abdf-fd1b6f9a2007" containerName="istio-proxy" containerID="cri-o://1e8746607809a00cb2c990a55aa8adfd61e90ae62c06a6f46a941d353d2a27d5" gracePeriod=30 Jul 20 10:11:22.549323 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.549297 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:11:22.694467 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.694426 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-workload-certs\") pod \"0c363285-aec2-4677-abdf-fd1b6f9a2007\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " Jul 20 10:11:22.694467 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.694467 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-token\") pod \"0c363285-aec2-4677-abdf-fd1b6f9a2007\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " Jul 20 10:11:22.694712 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.694498 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c363285-aec2-4677-abdf-fd1b6f9a2007-istiod-ca-cert\") pod \"0c363285-aec2-4677-abdf-fd1b6f9a2007\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " Jul 20 10:11:22.694712 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.694548 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rtmd\" (UniqueName: \"kubernetes.io/projected/0c363285-aec2-4677-abdf-fd1b6f9a2007-kube-api-access-9rtmd\") pod \"0c363285-aec2-4677-abdf-fd1b6f9a2007\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " Jul 20 10:11:22.694712 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.694602 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-podinfo\") pod \"0c363285-aec2-4677-abdf-fd1b6f9a2007\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " Jul 20 10:11:22.694712 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.694634 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-envoy\") pod \"0c363285-aec2-4677-abdf-fd1b6f9a2007\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " Jul 20 10:11:22.694712 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.694660 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-workload-socket\") pod \"0c363285-aec2-4677-abdf-fd1b6f9a2007\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " Jul 20 10:11:22.694995 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.694761 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c363285-aec2-4677-abdf-fd1b6f9a2007" (UID: "0c363285-aec2-4677-abdf-fd1b6f9a2007"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:11:22.694995 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.694888 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-credential-socket\") pod \"0c363285-aec2-4677-abdf-fd1b6f9a2007\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " Jul 20 10:11:22.694995 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.694922 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-data\") pod \"0c363285-aec2-4677-abdf-fd1b6f9a2007\" (UID: \"0c363285-aec2-4677-abdf-fd1b6f9a2007\") " Jul 20 10:11:22.695168 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.695021 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c363285-aec2-4677-abdf-fd1b6f9a2007" (UID: "0c363285-aec2-4677-abdf-fd1b6f9a2007"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:11:22.695225 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.695168 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c363285-aec2-4677-abdf-fd1b6f9a2007" (UID: "0c363285-aec2-4677-abdf-fd1b6f9a2007"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:11:22.695387 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.695363 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-workload-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:11:22.695458 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.695394 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-credential-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:11:22.695458 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.695411 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-workload-certs\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:11:22.695597 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.695575 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c363285-aec2-4677-abdf-fd1b6f9a2007-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c363285-aec2-4677-abdf-fd1b6f9a2007" (UID: "0c363285-aec2-4677-abdf-fd1b6f9a2007"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:11:22.695937 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.695912 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c363285-aec2-4677-abdf-fd1b6f9a2007" (UID: "0c363285-aec2-4677-abdf-fd1b6f9a2007"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:11:22.696899 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.696832 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c363285-aec2-4677-abdf-fd1b6f9a2007" (UID: "0c363285-aec2-4677-abdf-fd1b6f9a2007"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:11:22.696899 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.696866 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c363285-aec2-4677-abdf-fd1b6f9a2007-kube-api-access-9rtmd" (OuterVolumeSpecName: "kube-api-access-9rtmd") pod "0c363285-aec2-4677-abdf-fd1b6f9a2007" (UID: "0c363285-aec2-4677-abdf-fd1b6f9a2007"). InnerVolumeSpecName "kube-api-access-9rtmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:11:22.697035 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.696942 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c363285-aec2-4677-abdf-fd1b6f9a2007" (UID: "0c363285-aec2-4677-abdf-fd1b6f9a2007"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 10:11:22.697035 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.696959 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c363285-aec2-4677-abdf-fd1b6f9a2007" (UID: "0c363285-aec2-4677-abdf-fd1b6f9a2007"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:11:22.796798 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.796755 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-data\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:11:22.796798 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.796789 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-token\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:11:22.796798 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.796798 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c363285-aec2-4677-abdf-fd1b6f9a2007-istiod-ca-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:11:22.796798 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.796807 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rtmd\" (UniqueName: \"kubernetes.io/projected/0c363285-aec2-4677-abdf-fd1b6f9a2007-kube-api-access-9rtmd\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:11:22.797154 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.796816 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-podinfo\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:11:22.797154 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:22.796825 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c363285-aec2-4677-abdf-fd1b6f9a2007-istio-envoy\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:11:23.357751 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:23.357703 2577 generic.go:356] "Generic (PLEG): container finished" podID="0c363285-aec2-4677-abdf-fd1b6f9a2007" containerID="1e8746607809a00cb2c990a55aa8adfd61e90ae62c06a6f46a941d353d2a27d5" exitCode=0 Jul 20 10:11:23.357969 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:23.357760 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" Jul 20 10:11:23.357969 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:23.357790 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" event={"ID":"0c363285-aec2-4677-abdf-fd1b6f9a2007","Type":"ContainerDied","Data":"1e8746607809a00cb2c990a55aa8adfd61e90ae62c06a6f46a941d353d2a27d5"} Jul 20 10:11:23.357969 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:23.357861 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x" event={"ID":"0c363285-aec2-4677-abdf-fd1b6f9a2007","Type":"ContainerDied","Data":"dbffe6966cb4794fd9d347c48b958c0fb02d8ba1efc32949bba9a6d6b74b0a11"} Jul 20 10:11:23.357969 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:23.357884 2577 scope.go:117] "RemoveContainer" containerID="1e8746607809a00cb2c990a55aa8adfd61e90ae62c06a6f46a941d353d2a27d5" Jul 20 10:11:23.367290 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:23.367269 2577 scope.go:117] "RemoveContainer" containerID="a094e0e65cead1f5901aee54a8f50f48618e77aaa8bd58b47dfc4e7a7529366e" Jul 20 10:11:23.376043 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:23.376022 2577 scope.go:117] "RemoveContainer" containerID="1e8746607809a00cb2c990a55aa8adfd61e90ae62c06a6f46a941d353d2a27d5" Jul 20 10:11:23.376316 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:11:23.376295 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e8746607809a00cb2c990a55aa8adfd61e90ae62c06a6f46a941d353d2a27d5\": container with ID starting with 1e8746607809a00cb2c990a55aa8adfd61e90ae62c06a6f46a941d353d2a27d5 not found: ID does not exist" containerID="1e8746607809a00cb2c990a55aa8adfd61e90ae62c06a6f46a941d353d2a27d5" Jul 20 10:11:23.376395 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:23.376331 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e8746607809a00cb2c990a55aa8adfd61e90ae62c06a6f46a941d353d2a27d5"} err="failed to get container status \"1e8746607809a00cb2c990a55aa8adfd61e90ae62c06a6f46a941d353d2a27d5\": rpc error: code = NotFound desc = could not find container \"1e8746607809a00cb2c990a55aa8adfd61e90ae62c06a6f46a941d353d2a27d5\": container with ID starting with 1e8746607809a00cb2c990a55aa8adfd61e90ae62c06a6f46a941d353d2a27d5 not found: ID does not exist" Jul 20 10:11:23.376395 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:23.376357 2577 scope.go:117] "RemoveContainer" containerID="a094e0e65cead1f5901aee54a8f50f48618e77aaa8bd58b47dfc4e7a7529366e" Jul 20 10:11:23.376628 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:11:23.376603 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a094e0e65cead1f5901aee54a8f50f48618e77aaa8bd58b47dfc4e7a7529366e\": container with ID starting with a094e0e65cead1f5901aee54a8f50f48618e77aaa8bd58b47dfc4e7a7529366e not found: ID does not exist" containerID="a094e0e65cead1f5901aee54a8f50f48618e77aaa8bd58b47dfc4e7a7529366e" Jul 20 10:11:23.376735 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:23.376644 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a094e0e65cead1f5901aee54a8f50f48618e77aaa8bd58b47dfc4e7a7529366e"} err="failed to get container status \"a094e0e65cead1f5901aee54a8f50f48618e77aaa8bd58b47dfc4e7a7529366e\": rpc error: code = NotFound desc = could not find container \"a094e0e65cead1f5901aee54a8f50f48618e77aaa8bd58b47dfc4e7a7529366e\": container with ID starting with a094e0e65cead1f5901aee54a8f50f48618e77aaa8bd58b47dfc4e7a7529366e not found: ID does not exist" Jul 20 10:11:23.383864 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:23.383795 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x"] Jul 20 10:11:23.387517 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:23.387490 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bc2fab5a-openshift-default-64bc95755f-4qz9x"] Jul 20 10:11:25.024281 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:25.024246 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c363285-aec2-4677-abdf-fd1b6f9a2007" path="/var/lib/kubelet/pods/0c363285-aec2-4677-abdf-fd1b6f9a2007/volumes" Jul 20 10:11:36.654969 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.654887 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb"] Jul 20 10:11:36.655327 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.655249 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c363285-aec2-4677-abdf-fd1b6f9a2007" containerName="istio-proxy" Jul 20 10:11:36.655327 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.655261 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c363285-aec2-4677-abdf-fd1b6f9a2007" containerName="istio-proxy" Jul 20 10:11:36.655327 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.655278 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c363285-aec2-4677-abdf-fd1b6f9a2007" containerName="istio-proxy" Jul 20 10:11:36.655327 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.655283 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c363285-aec2-4677-abdf-fd1b6f9a2007" containerName="istio-proxy" Jul 20 10:11:36.655457 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.655340 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c363285-aec2-4677-abdf-fd1b6f9a2007" containerName="istio-proxy" Jul 20 10:11:36.655457 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.655348 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c363285-aec2-4677-abdf-fd1b6f9a2007" containerName="istio-proxy" Jul 20 10:11:36.660046 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.660025 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.662496 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.662475 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3a0aa251-openshift-default-dockercfg-mbjtt\"" Jul 20 10:11:36.670757 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.670735 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb"] Jul 20 10:11:36.724483 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.724446 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-workload-certs\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.724483 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.724481 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-workload-socket\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.724701 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.724502 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-podinfo\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.724701 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.724521 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-token\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.724701 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.724563 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istiod-ca-cert\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.724701 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.724588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-data\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.724701 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.724635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5pd4\" (UniqueName: \"kubernetes.io/projected/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-kube-api-access-h5pd4\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.724885 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.724712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-credential-socket\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.724885 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.724751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-envoy\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.825461 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.825419 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-credential-socket\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.825668 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.825475 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-envoy\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.825668 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.825591 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-workload-certs\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.825668 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.825618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-workload-socket\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.825668 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.825645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-podinfo\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.826799 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.825677 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-token\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.826799 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.825759 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istiod-ca-cert\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.826799 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.825834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-data\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.826799 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.825964 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5pd4\" (UniqueName: \"kubernetes.io/projected/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-kube-api-access-h5pd4\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.826799 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.826016 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-credential-socket\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.826799 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.826082 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-workload-certs\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.826799 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.826346 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-data\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.826799 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.826640 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-workload-socket\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.826799 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.826779 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istiod-ca-cert\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.830946 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.829174 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-envoy\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.830946 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.829403 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-podinfo\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.834462 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.834436 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-token\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.834601 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.834579 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5pd4\" (UniqueName: \"kubernetes.io/projected/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-kube-api-access-h5pd4\") pod \"e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:36.973644 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:36.973546 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:37.119651 ip-10-0-142-133 kubenswrapper[2577]: W0720 10:11:37.119620 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe3e9b1_d887_4ea6_b532_6c176aa090e1.slice/crio-f6f1a4c29494a728cff69d6186907af2bf30292b601081f9cd85880c72137abc WatchSource:0}: Error finding container f6f1a4c29494a728cff69d6186907af2bf30292b601081f9cd85880c72137abc: Status 404 returned error can't find the container with id f6f1a4c29494a728cff69d6186907af2bf30292b601081f9cd85880c72137abc Jul 20 10:11:37.119796 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:37.119686 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb"] Jul 20 10:11:37.121945 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:37.121911 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:11:37.122016 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:37.121986 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:11:37.122067 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:37.122020 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:11:37.438956 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:37.438915 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" event={"ID":"fbe3e9b1-d887-4ea6-b532-6c176aa090e1","Type":"ContainerStarted","Data":"890dae4151c962a307ae00da33f9e6fb359078e2c66c7e336732486a822a820b"} Jul 20 10:11:37.439150 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:37.438973 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" event={"ID":"fbe3e9b1-d887-4ea6-b532-6c176aa090e1","Type":"ContainerStarted","Data":"f6f1a4c29494a728cff69d6186907af2bf30292b601081f9cd85880c72137abc"} Jul 20 10:11:37.460651 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:37.460597 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" podStartSLOduration=1.460578258 podStartE2EDuration="1.460578258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:11:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:11:37.458135604 +0000 UTC m=+1976.932236634" watchObservedRunningTime="2026-07-20 10:11:37.460578258 +0000 UTC m=+1976.934679359" Jul 20 10:11:37.973691 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:37.973655 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:38.979765 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:38.979729 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:39.455367 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:39.455334 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:39.456572 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:39.456545 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:53.533195 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:53.533096 2577 generic.go:356] "Generic (PLEG): container finished" podID="fbe3e9b1-d887-4ea6-b532-6c176aa090e1" containerID="890dae4151c962a307ae00da33f9e6fb359078e2c66c7e336732486a822a820b" exitCode=0 Jul 20 10:11:53.533195 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:53.533175 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" event={"ID":"fbe3e9b1-d887-4ea6-b532-6c176aa090e1","Type":"ContainerDied","Data":"890dae4151c962a307ae00da33f9e6fb359078e2c66c7e336732486a822a820b"} Jul 20 10:11:53.533902 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:53.533621 2577 scope.go:117] "RemoveContainer" containerID="890dae4151c962a307ae00da33f9e6fb359078e2c66c7e336732486a822a820b" Jul 20 10:11:53.534716 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:53.534684 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:11:53.534802 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:53.534784 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:11:53.534897 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:53.534824 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:11:54.456392 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:54.456328 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:54.545447 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:54.545399 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" event={"ID":"fbe3e9b1-d887-4ea6-b532-6c176aa090e1","Type":"ContainerStarted","Data":"148c23e569b4c88ea030797a5effffd4cfe061aad7f4c9205144ade038c0b3a9"} Jul 20 10:11:54.974036 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:54.973994 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:54.975281 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:54.975254 2577 patch_prober.go:28] interesting pod/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 20 10:11:54.975404 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:54.975304 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" podUID="fbe3e9b1-d887-4ea6-b532-6c176aa090e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 20 10:11:55.974613 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:55.974569 2577 patch_prober.go:28] interesting pod/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 20 10:11:55.975078 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:55.974636 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" podUID="fbe3e9b1-d887-4ea6-b532-6c176aa090e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 20 10:11:56.974339 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:56.974296 2577 patch_prober.go:28] interesting pod/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 20 10:11:56.974513 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:56.974357 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" podUID="fbe3e9b1-d887-4ea6-b532-6c176aa090e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 20 10:11:57.974391 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:57.974347 2577 patch_prober.go:28] interesting pod/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 20 10:11:57.974810 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:57.974408 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" podUID="fbe3e9b1-d887-4ea6-b532-6c176aa090e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 20 10:11:58.979081 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:58.979047 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:58.979473 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:58.979411 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:11:58.980128 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:11:58.980110 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:13:22.411131 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:22.411026 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb"] Jul 20 10:13:22.411714 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:22.411310 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" podUID="fbe3e9b1-d887-4ea6-b532-6c176aa090e1" containerName="istio-proxy" containerID="cri-o://148c23e569b4c88ea030797a5effffd4cfe061aad7f4c9205144ade038c0b3a9" gracePeriod=30 Jul 20 10:13:27.670218 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.670188 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:13:27.745837 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.745762 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-podinfo\") pod \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " Jul 20 10:13:27.745837 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.745805 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-envoy\") pod \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " Jul 20 10:13:27.745837 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.745839 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istiod-ca-cert\") pod \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " Jul 20 10:13:27.746234 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.745917 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-workload-certs\") pod \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " Jul 20 10:13:27.746234 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.745937 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-token\") pod \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " Jul 20 10:13:27.746234 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.745966 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-credential-socket\") pod \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " Jul 20 10:13:27.746234 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.745998 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-workload-socket\") pod \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " Jul 20 10:13:27.746234 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.746016 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-data\") pod \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " Jul 20 10:13:27.746234 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.746042 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5pd4\" (UniqueName: \"kubernetes.io/projected/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-kube-api-access-h5pd4\") pod \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\" (UID: \"fbe3e9b1-d887-4ea6-b532-6c176aa090e1\") " Jul 20 10:13:27.746552 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.746313 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fbe3e9b1-d887-4ea6-b532-6c176aa090e1" (UID: "fbe3e9b1-d887-4ea6-b532-6c176aa090e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:13:27.746552 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.746329 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fbe3e9b1-d887-4ea6-b532-6c176aa090e1" (UID: "fbe3e9b1-d887-4ea6-b532-6c176aa090e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:13:27.746552 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.746411 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fbe3e9b1-d887-4ea6-b532-6c176aa090e1" (UID: "fbe3e9b1-d887-4ea6-b532-6c176aa090e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:13:27.746915 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.746889 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fbe3e9b1-d887-4ea6-b532-6c176aa090e1" (UID: "fbe3e9b1-d887-4ea6-b532-6c176aa090e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:13:27.747292 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.747267 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "fbe3e9b1-d887-4ea6-b532-6c176aa090e1" (UID: "fbe3e9b1-d887-4ea6-b532-6c176aa090e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:13:27.748296 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.748270 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fbe3e9b1-d887-4ea6-b532-6c176aa090e1" (UID: "fbe3e9b1-d887-4ea6-b532-6c176aa090e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 10:13:27.748399 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.748350 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-kube-api-access-h5pd4" (OuterVolumeSpecName: "kube-api-access-h5pd4") pod "fbe3e9b1-d887-4ea6-b532-6c176aa090e1" (UID: "fbe3e9b1-d887-4ea6-b532-6c176aa090e1"). InnerVolumeSpecName "kube-api-access-h5pd4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:13:27.748477 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.748461 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fbe3e9b1-d887-4ea6-b532-6c176aa090e1" (UID: "fbe3e9b1-d887-4ea6-b532-6c176aa090e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:13:27.748572 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.748550 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "fbe3e9b1-d887-4ea6-b532-6c176aa090e1" (UID: "fbe3e9b1-d887-4ea6-b532-6c176aa090e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:13:27.846750 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.846705 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-workload-certs\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:13:27.846750 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.846746 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-token\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:13:27.846750 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.846755 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-credential-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:13:27.846750 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.846763 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-workload-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:13:27.847069 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.846774 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-data\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:13:27.847069 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.846783 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5pd4\" (UniqueName: \"kubernetes.io/projected/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-kube-api-access-h5pd4\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:13:27.847069 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.846792 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-podinfo\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:13:27.847069 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.846800 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istio-envoy\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:13:27.847069 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:27.846808 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbe3e9b1-d887-4ea6-b532-6c176aa090e1-istiod-ca-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:13:28.053034 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:28.052934 2577 generic.go:356] "Generic (PLEG): container finished" podID="fbe3e9b1-d887-4ea6-b532-6c176aa090e1" containerID="148c23e569b4c88ea030797a5effffd4cfe061aad7f4c9205144ade038c0b3a9" exitCode=0 Jul 20 10:13:28.053034 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:28.052983 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" Jul 20 10:13:28.053034 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:28.053023 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" event={"ID":"fbe3e9b1-d887-4ea6-b532-6c176aa090e1","Type":"ContainerDied","Data":"148c23e569b4c88ea030797a5effffd4cfe061aad7f4c9205144ade038c0b3a9"} Jul 20 10:13:28.053267 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:28.053078 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb" event={"ID":"fbe3e9b1-d887-4ea6-b532-6c176aa090e1","Type":"ContainerDied","Data":"f6f1a4c29494a728cff69d6186907af2bf30292b601081f9cd85880c72137abc"} Jul 20 10:13:28.053267 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:28.053103 2577 scope.go:117] "RemoveContainer" containerID="148c23e569b4c88ea030797a5effffd4cfe061aad7f4c9205144ade038c0b3a9" Jul 20 10:13:28.062812 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:28.062792 2577 scope.go:117] "RemoveContainer" containerID="890dae4151c962a307ae00da33f9e6fb359078e2c66c7e336732486a822a820b" Jul 20 10:13:28.074291 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:28.074274 2577 scope.go:117] "RemoveContainer" containerID="148c23e569b4c88ea030797a5effffd4cfe061aad7f4c9205144ade038c0b3a9" Jul 20 10:13:28.075045 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:13:28.075018 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"148c23e569b4c88ea030797a5effffd4cfe061aad7f4c9205144ade038c0b3a9\": container with ID starting with 148c23e569b4c88ea030797a5effffd4cfe061aad7f4c9205144ade038c0b3a9 not found: ID does not exist" containerID="148c23e569b4c88ea030797a5effffd4cfe061aad7f4c9205144ade038c0b3a9" Jul 20 10:13:28.075156 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:28.075051 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"148c23e569b4c88ea030797a5effffd4cfe061aad7f4c9205144ade038c0b3a9"} err="failed to get container status \"148c23e569b4c88ea030797a5effffd4cfe061aad7f4c9205144ade038c0b3a9\": rpc error: code = NotFound desc = could not find container \"148c23e569b4c88ea030797a5effffd4cfe061aad7f4c9205144ade038c0b3a9\": container with ID starting with 148c23e569b4c88ea030797a5effffd4cfe061aad7f4c9205144ade038c0b3a9 not found: ID does not exist" Jul 20 10:13:28.075156 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:28.075070 2577 scope.go:117] "RemoveContainer" containerID="890dae4151c962a307ae00da33f9e6fb359078e2c66c7e336732486a822a820b" Jul 20 10:13:28.075392 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:13:28.075371 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"890dae4151c962a307ae00da33f9e6fb359078e2c66c7e336732486a822a820b\": container with ID starting with 890dae4151c962a307ae00da33f9e6fb359078e2c66c7e336732486a822a820b not found: ID does not exist" containerID="890dae4151c962a307ae00da33f9e6fb359078e2c66c7e336732486a822a820b" Jul 20 10:13:28.075456 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:28.075406 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"890dae4151c962a307ae00da33f9e6fb359078e2c66c7e336732486a822a820b"} err="failed to get container status \"890dae4151c962a307ae00da33f9e6fb359078e2c66c7e336732486a822a820b\": rpc error: code = NotFound desc = could not find container \"890dae4151c962a307ae00da33f9e6fb359078e2c66c7e336732486a822a820b\": container with ID starting with 890dae4151c962a307ae00da33f9e6fb359078e2c66c7e336732486a822a820b not found: ID does not exist" Jul 20 10:13:28.077761 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:28.077741 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb"] Jul 20 10:13:28.081914 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:28.081886 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3a0aa251-openshift-default-9cc665699-2dvkb"] Jul 20 10:13:29.025404 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:29.025370 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbe3e9b1-d887-4ea6-b532-6c176aa090e1" path="/var/lib/kubelet/pods/fbe3e9b1-d887-4ea6-b532-6c176aa090e1/volumes" Jul 20 10:13:41.142078 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:41.142042 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 10:13:41.149061 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:13:41.149034 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 10:14:17.396675 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.396639 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b"] Jul 20 10:14:17.397228 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.397008 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe3e9b1-d887-4ea6-b532-6c176aa090e1" containerName="istio-proxy" Jul 20 10:14:17.397228 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.397020 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe3e9b1-d887-4ea6-b532-6c176aa090e1" containerName="istio-proxy" Jul 20 10:14:17.397228 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.397090 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe3e9b1-d887-4ea6-b532-6c176aa090e1" containerName="istio-proxy" Jul 20 10:14:17.397228 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.397099 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe3e9b1-d887-4ea6-b532-6c176aa090e1" containerName="istio-proxy" Jul 20 10:14:17.400069 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.400052 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.402339 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.402319 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-11ee60-openshift-default-dockercfg-b6ttn\"" Jul 20 10:14:17.411470 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.411440 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b"] Jul 20 10:14:17.502331 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.502287 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-workload-socket\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.502547 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.502340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-workload-certs\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.502547 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.502388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-podinfo\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.502547 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.502467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-credential-socket\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.502547 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.502499 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-envoy\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.502547 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.502525 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-data\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.502811 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.502620 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsfwh\" (UniqueName: \"kubernetes.io/projected/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-kube-api-access-nsfwh\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.502811 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.502677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-token\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.502811 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.502696 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istiod-ca-cert\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.603787 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.603742 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-token\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.603787 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.603789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istiod-ca-cert\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.604090 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.603820 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-workload-socket\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.604090 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.603838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-workload-certs\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.604090 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.603915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-podinfo\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.604090 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.603968 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-credential-socket\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.604090 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.603999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-envoy\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.604090 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.604021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-data\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.604408 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.604097 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsfwh\" (UniqueName: \"kubernetes.io/projected/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-kube-api-access-nsfwh\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.604408 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.604370 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-workload-certs\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.604495 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.604448 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-workload-socket\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.604495 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.604484 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-credential-socket\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.604607 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.604589 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-data\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.604678 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.604661 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istiod-ca-cert\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.606915 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.606890 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-envoy\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.607101 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.607078 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-podinfo\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.611732 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.611700 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-token\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.611839 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.611767 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsfwh\" (UniqueName: \"kubernetes.io/projected/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-kube-api-access-nsfwh\") pod \"e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.712031 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.711926 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:17.855652 ip-10-0-142-133 kubenswrapper[2577]: W0720 10:14:17.855613 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25acf52e_c320_4df2_8b32_ce8f51c5a8a7.slice/crio-127b5f316f870df38ee31b06dc9633cbc1b0e5f5337a3b3f23d207f1436918a7 WatchSource:0}: Error finding container 127b5f316f870df38ee31b06dc9633cbc1b0e5f5337a3b3f23d207f1436918a7: Status 404 returned error can't find the container with id 127b5f316f870df38ee31b06dc9633cbc1b0e5f5337a3b3f23d207f1436918a7 Jul 20 10:14:17.857319 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.857293 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b"] Jul 20 10:14:17.857701 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.857668 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:14:17.857752 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.857737 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:14:17.857787 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:17.857764 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:14:18.336358 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:18.336318 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" event={"ID":"25acf52e-c320-4df2-8b32-ce8f51c5a8a7","Type":"ContainerStarted","Data":"d3d56cdc1c15d7e1c39c84a15c1fc73344c560a7fd569067f993702789123c02"} Jul 20 10:14:18.336571 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:18.336383 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" event={"ID":"25acf52e-c320-4df2-8b32-ce8f51c5a8a7","Type":"ContainerStarted","Data":"127b5f316f870df38ee31b06dc9633cbc1b0e5f5337a3b3f23d207f1436918a7"} Jul 20 10:14:18.356173 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:18.356115 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" podStartSLOduration=1.356093272 podStartE2EDuration="1.356093272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:14:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:14:18.354680298 +0000 UTC m=+2137.828781328" watchObservedRunningTime="2026-07-20 10:14:18.356093272 +0000 UTC m=+2137.830194376" Jul 20 10:14:18.713072 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:18.712984 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:18.718141 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:18.718110 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:19.342035 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:19.342003 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:19.343079 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:19.343061 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:25.481933 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.481897 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6"] Jul 20 10:14:25.482379 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.482261 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe3e9b1-d887-4ea6-b532-6c176aa090e1" containerName="istio-proxy" Jul 20 10:14:25.482379 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.482272 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe3e9b1-d887-4ea6-b532-6c176aa090e1" containerName="istio-proxy" Jul 20 10:14:25.485419 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.485398 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.487934 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.487911 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-8a2a58-openshift-default-dockercfg-8xvh4\"" Jul 20 10:14:25.497363 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.497337 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6"] Jul 20 10:14:25.581349 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.581315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-credential-socket\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.581349 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.581365 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-envoy\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.581614 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.581496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istiod-ca-cert\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.581614 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.581564 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-workload-certs\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.581614 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.581599 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdrgh\" (UniqueName: \"kubernetes.io/projected/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-kube-api-access-vdrgh\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.581791 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.581649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-workload-socket\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.581791 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.581680 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-data\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.581791 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.581741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-podinfo\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.581791 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.581771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-token\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.682564 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.682529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istiod-ca-cert\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.682766 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.682578 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-workload-certs\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.682766 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.682701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdrgh\" (UniqueName: \"kubernetes.io/projected/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-kube-api-access-vdrgh\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.683011 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.682785 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-workload-socket\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.683011 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.682835 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-data\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.683011 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.682920 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-podinfo\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.683011 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.682954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-token\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.683011 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.682982 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-workload-certs\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.683271 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.683016 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-credential-socket\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.683271 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.683057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-envoy\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.683271 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.683133 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-workload-socket\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.683440 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.683281 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-data\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.683440 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.683315 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-credential-socket\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.683440 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.683355 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istiod-ca-cert\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.685208 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.685189 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-envoy\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.685478 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.685457 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-podinfo\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.695469 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.695444 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdrgh\" (UniqueName: \"kubernetes.io/projected/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-kube-api-access-vdrgh\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.695776 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.695758 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-token\") pod \"e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.798227 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.798128 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:25.989043 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.989014 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6"] Jul 20 10:14:25.991109 ip-10-0-142-133 kubenswrapper[2577]: W0720 10:14:25.991077 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d3b1ea8_a0f0_47b1_bc11_e2e6caf7ace5.slice/crio-35dfcc1becdce264956c631c32c3cb6fa41ccc32f2aedc7c3057fc3c62194561 WatchSource:0}: Error finding container 35dfcc1becdce264956c631c32c3cb6fa41ccc32f2aedc7c3057fc3c62194561: Status 404 returned error can't find the container with id 35dfcc1becdce264956c631c32c3cb6fa41ccc32f2aedc7c3057fc3c62194561 Jul 20 10:14:25.993319 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.993282 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:14:25.993413 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.993350 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:14:25.993413 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:25.993379 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:14:26.390864 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:26.390816 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" event={"ID":"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5","Type":"ContainerStarted","Data":"de2502f3ceaf41158efca29d67154ea2afc8217985a697bbe7ea8e19f840787b"} Jul 20 10:14:26.391055 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:26.390917 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" event={"ID":"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5","Type":"ContainerStarted","Data":"35dfcc1becdce264956c631c32c3cb6fa41ccc32f2aedc7c3057fc3c62194561"} Jul 20 10:14:26.410083 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:26.410014 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" podStartSLOduration=1.409996634 podStartE2EDuration="1.409996634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:14:26.409145281 +0000 UTC m=+2145.883246314" watchObservedRunningTime="2026-07-20 10:14:26.409996634 +0000 UTC m=+2145.884097667" Jul 20 10:14:26.798948 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:26.798840 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:27.803956 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:27.803914 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:28.401773 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:28.401735 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:28.402641 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:28.402618 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:33.433050 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:33.432960 2577 generic.go:356] "Generic (PLEG): container finished" podID="25acf52e-c320-4df2-8b32-ce8f51c5a8a7" containerID="d3d56cdc1c15d7e1c39c84a15c1fc73344c560a7fd569067f993702789123c02" exitCode=0 Jul 20 10:14:33.433050 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:33.433034 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" event={"ID":"25acf52e-c320-4df2-8b32-ce8f51c5a8a7","Type":"ContainerDied","Data":"d3d56cdc1c15d7e1c39c84a15c1fc73344c560a7fd569067f993702789123c02"} Jul 20 10:14:33.433597 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:33.433449 2577 scope.go:117] "RemoveContainer" containerID="d3d56cdc1c15d7e1c39c84a15c1fc73344c560a7fd569067f993702789123c02" Jul 20 10:14:33.434594 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:33.434560 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:14:33.434707 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:33.434633 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:14:33.434707 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:33.434666 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:14:34.342594 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:34.342545 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:34.445385 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:34.444682 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" event={"ID":"25acf52e-c320-4df2-8b32-ce8f51c5a8a7","Type":"ContainerStarted","Data":"cc3ad3cce7dc22383edfd6a6f418682edf733555562974429f7591d6c2853edc"} Jul 20 10:14:34.713019 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:34.712912 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:34.714198 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:34.714171 2577 patch_prober.go:28] interesting pod/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 20 10:14:34.714316 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:34.714228 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" podUID="25acf52e-c320-4df2-8b32-ce8f51c5a8a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 20 10:14:35.712667 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:35.712626 2577 patch_prober.go:28] interesting pod/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 20 10:14:35.713151 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:35.712685 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" podUID="25acf52e-c320-4df2-8b32-ce8f51c5a8a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 20 10:14:36.712925 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:36.712880 2577 patch_prober.go:28] interesting pod/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 20 10:14:36.713391 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:36.712954 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" podUID="25acf52e-c320-4df2-8b32-ce8f51c5a8a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 20 10:14:37.712675 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:37.712637 2577 patch_prober.go:28] interesting pod/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 20 10:14:37.712867 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:37.712718 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" podUID="25acf52e-c320-4df2-8b32-ce8f51c5a8a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 20 10:14:38.716761 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:38.716730 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:38.717265 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:38.716979 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:38.717762 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:38.717743 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:14:43.761797 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:43.760326 2577 patch_prober.go:28] interesting pod/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:47092->10.132.0.51:15021: read: connection reset by peer" start-of-body= Jul 20 10:14:43.761797 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:43.760395 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" podUID="4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:47092->10.132.0.51:15021: read: connection reset by peer" Jul 20 10:14:44.521661 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:44.521627 2577 generic.go:356] "Generic (PLEG): container finished" podID="4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" containerID="de2502f3ceaf41158efca29d67154ea2afc8217985a697bbe7ea8e19f840787b" exitCode=0 Jul 20 10:14:44.521868 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:44.521701 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" event={"ID":"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5","Type":"ContainerDied","Data":"de2502f3ceaf41158efca29d67154ea2afc8217985a697bbe7ea8e19f840787b"} Jul 20 10:14:44.522166 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:44.522151 2577 scope.go:117] "RemoveContainer" containerID="de2502f3ceaf41158efca29d67154ea2afc8217985a697bbe7ea8e19f840787b" Jul 20 10:14:44.523252 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:44.523222 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:14:44.523379 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:44.523308 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:14:44.523379 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:44.523359 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:14:45.529701 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:45.529665 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" event={"ID":"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5","Type":"ContainerStarted","Data":"2381bb77b3dd8eaa74a7d25c2b6287e08d77bbe947b0d44ae0fd2e1fb8287f94"} Jul 20 10:14:45.798657 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:45.798555 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:45.798815 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:45.798791 2577 patch_prober.go:28] interesting pod/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 20 10:14:45.798892 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:45.798875 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" podUID="4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 20 10:14:46.799460 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:46.799418 2577 patch_prober.go:28] interesting pod/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 20 10:14:46.799928 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:46.799476 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" podUID="4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 20 10:14:47.799528 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:47.799476 2577 patch_prober.go:28] interesting pod/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 20 10:14:47.800123 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:47.799548 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" podUID="4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 20 10:14:48.798764 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:48.798719 2577 patch_prober.go:28] interesting pod/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 20 10:14:48.799011 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:48.798786 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" podUID="4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 20 10:14:49.802729 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:49.802697 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:49.803211 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:49.803106 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:14:49.804147 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:14:49.804118 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:16:05.045807 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:05.045709 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b"] Jul 20 10:16:05.046351 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:05.045995 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" podUID="25acf52e-c320-4df2-8b32-ce8f51c5a8a7" containerName="istio-proxy" containerID="cri-o://cc3ad3cce7dc22383edfd6a6f418682edf733555562974429f7591d6c2853edc" gracePeriod=30 Jul 20 10:16:08.719998 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:08.719948 2577 patch_prober.go:28] interesting pod/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 10:16:08.720379 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:08.720045 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" podUID="25acf52e-c320-4df2-8b32-ce8f51c5a8a7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 10:16:10.306555 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.306477 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:16:10.386223 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.386178 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-token\") pod \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " Jul 20 10:16:10.386223 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.386236 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-workload-socket\") pod \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " Jul 20 10:16:10.386485 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.386255 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsfwh\" (UniqueName: \"kubernetes.io/projected/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-kube-api-access-nsfwh\") pod \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " Jul 20 10:16:10.386485 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.386272 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istiod-ca-cert\") pod \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " Jul 20 10:16:10.386485 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.386297 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-credential-socket\") pod \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " Jul 20 10:16:10.386485 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.386350 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-workload-certs\") pod \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " Jul 20 10:16:10.386485 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.386368 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-podinfo\") pod \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " Jul 20 10:16:10.386485 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.386394 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-data\") pod \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " Jul 20 10:16:10.386485 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.386462 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-envoy\") pod \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\" (UID: \"25acf52e-c320-4df2-8b32-ce8f51c5a8a7\") " Jul 20 10:16:10.386756 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.386571 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "25acf52e-c320-4df2-8b32-ce8f51c5a8a7" (UID: "25acf52e-c320-4df2-8b32-ce8f51c5a8a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:16:10.386822 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.386753 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "25acf52e-c320-4df2-8b32-ce8f51c5a8a7" (UID: "25acf52e-c320-4df2-8b32-ce8f51c5a8a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:16:10.386822 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.386734 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "25acf52e-c320-4df2-8b32-ce8f51c5a8a7" (UID: "25acf52e-c320-4df2-8b32-ce8f51c5a8a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:16:10.386969 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.386866 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-workload-certs\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:10.386969 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.386886 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-workload-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:10.386969 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.386901 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istiod-ca-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:10.387215 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.387184 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "25acf52e-c320-4df2-8b32-ce8f51c5a8a7" (UID: "25acf52e-c320-4df2-8b32-ce8f51c5a8a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:16:10.387443 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.387411 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "25acf52e-c320-4df2-8b32-ce8f51c5a8a7" (UID: "25acf52e-c320-4df2-8b32-ce8f51c5a8a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:16:10.388622 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.388602 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "25acf52e-c320-4df2-8b32-ce8f51c5a8a7" (UID: "25acf52e-c320-4df2-8b32-ce8f51c5a8a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:16:10.388790 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.388767 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "25acf52e-c320-4df2-8b32-ce8f51c5a8a7" (UID: "25acf52e-c320-4df2-8b32-ce8f51c5a8a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:16:10.389174 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.389152 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-kube-api-access-nsfwh" (OuterVolumeSpecName: "kube-api-access-nsfwh") pod "25acf52e-c320-4df2-8b32-ce8f51c5a8a7" (UID: "25acf52e-c320-4df2-8b32-ce8f51c5a8a7"). InnerVolumeSpecName "kube-api-access-nsfwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:16:10.389230 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.389154 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "25acf52e-c320-4df2-8b32-ce8f51c5a8a7" (UID: "25acf52e-c320-4df2-8b32-ce8f51c5a8a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 10:16:10.487686 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.487638 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-token\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:10.487686 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.487683 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsfwh\" (UniqueName: \"kubernetes.io/projected/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-kube-api-access-nsfwh\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:10.487686 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.487695 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-credential-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:10.487686 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.487704 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-podinfo\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:10.488017 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.487713 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-data\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:10.488017 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:10.487721 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25acf52e-c320-4df2-8b32-ce8f51c5a8a7-istio-envoy\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:11.026854 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:11.026803 2577 generic.go:356] "Generic (PLEG): container finished" podID="25acf52e-c320-4df2-8b32-ce8f51c5a8a7" containerID="cc3ad3cce7dc22383edfd6a6f418682edf733555562974429f7591d6c2853edc" exitCode=0 Jul 20 10:16:11.027044 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:11.026878 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" Jul 20 10:16:11.027044 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:11.026886 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" event={"ID":"25acf52e-c320-4df2-8b32-ce8f51c5a8a7","Type":"ContainerDied","Data":"cc3ad3cce7dc22383edfd6a6f418682edf733555562974429f7591d6c2853edc"} Jul 20 10:16:11.027044 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:11.026947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b" event={"ID":"25acf52e-c320-4df2-8b32-ce8f51c5a8a7","Type":"ContainerDied","Data":"127b5f316f870df38ee31b06dc9633cbc1b0e5f5337a3b3f23d207f1436918a7"} Jul 20 10:16:11.027044 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:11.026977 2577 scope.go:117] "RemoveContainer" containerID="cc3ad3cce7dc22383edfd6a6f418682edf733555562974429f7591d6c2853edc" Jul 20 10:16:11.044839 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:11.044814 2577 scope.go:117] "RemoveContainer" containerID="d3d56cdc1c15d7e1c39c84a15c1fc73344c560a7fd569067f993702789123c02" Jul 20 10:16:11.054042 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:11.053996 2577 scope.go:117] "RemoveContainer" containerID="cc3ad3cce7dc22383edfd6a6f418682edf733555562974429f7591d6c2853edc" Jul 20 10:16:11.054397 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:16:11.054373 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc3ad3cce7dc22383edfd6a6f418682edf733555562974429f7591d6c2853edc\": container with ID starting with cc3ad3cce7dc22383edfd6a6f418682edf733555562974429f7591d6c2853edc not found: ID does not exist" containerID="cc3ad3cce7dc22383edfd6a6f418682edf733555562974429f7591d6c2853edc" Jul 20 10:16:11.054463 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:11.054406 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3ad3cce7dc22383edfd6a6f418682edf733555562974429f7591d6c2853edc"} err="failed to get container status \"cc3ad3cce7dc22383edfd6a6f418682edf733555562974429f7591d6c2853edc\": rpc error: code = NotFound desc = could not find container \"cc3ad3cce7dc22383edfd6a6f418682edf733555562974429f7591d6c2853edc\": container with ID starting with cc3ad3cce7dc22383edfd6a6f418682edf733555562974429f7591d6c2853edc not found: ID does not exist" Jul 20 10:16:11.054463 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:11.054425 2577 scope.go:117] "RemoveContainer" containerID="d3d56cdc1c15d7e1c39c84a15c1fc73344c560a7fd569067f993702789123c02" Jul 20 10:16:11.054658 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:16:11.054639 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3d56cdc1c15d7e1c39c84a15c1fc73344c560a7fd569067f993702789123c02\": container with ID starting with d3d56cdc1c15d7e1c39c84a15c1fc73344c560a7fd569067f993702789123c02 not found: ID does not exist" containerID="d3d56cdc1c15d7e1c39c84a15c1fc73344c560a7fd569067f993702789123c02" Jul 20 10:16:11.054702 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:11.054664 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d56cdc1c15d7e1c39c84a15c1fc73344c560a7fd569067f993702789123c02"} err="failed to get container status \"d3d56cdc1c15d7e1c39c84a15c1fc73344c560a7fd569067f993702789123c02\": rpc error: code = NotFound desc = could not find container \"d3d56cdc1c15d7e1c39c84a15c1fc73344c560a7fd569067f993702789123c02\": container with ID starting with d3d56cdc1c15d7e1c39c84a15c1fc73344c560a7fd569067f993702789123c02 not found: ID does not exist" Jul 20 10:16:11.056944 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:11.056922 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b"] Jul 20 10:16:11.063065 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:11.063040 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-11ee60-openshift-default-5c9df89577-z9p9b"] Jul 20 10:16:13.024487 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:13.024443 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25acf52e-c320-4df2-8b32-ce8f51c5a8a7" path="/var/lib/kubelet/pods/25acf52e-c320-4df2-8b32-ce8f51c5a8a7/volumes" Jul 20 10:16:26.874431 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:26.874392 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6"] Jul 20 10:16:26.875002 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:26.874691 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" podUID="4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" containerName="istio-proxy" containerID="cri-o://2381bb77b3dd8eaa74a7d25c2b6287e08d77bbe947b0d44ae0fd2e1fb8287f94" gracePeriod=30 Jul 20 10:16:27.842730 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.842695 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb"] Jul 20 10:16:27.843158 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.843139 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25acf52e-c320-4df2-8b32-ce8f51c5a8a7" containerName="istio-proxy" Jul 20 10:16:27.843261 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.843161 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="25acf52e-c320-4df2-8b32-ce8f51c5a8a7" containerName="istio-proxy" Jul 20 10:16:27.843261 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.843199 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25acf52e-c320-4df2-8b32-ce8f51c5a8a7" containerName="istio-proxy" Jul 20 10:16:27.843261 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.843210 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="25acf52e-c320-4df2-8b32-ce8f51c5a8a7" containerName="istio-proxy" Jul 20 10:16:27.843492 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.843330 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="25acf52e-c320-4df2-8b32-ce8f51c5a8a7" containerName="istio-proxy" Jul 20 10:16:27.846544 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.846522 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:27.848736 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.848717 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-817a64-openshift-default-dockercfg-nsbfm\"" Jul 20 10:16:27.857294 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.857264 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb"] Jul 20 10:16:27.949740 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.949696 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-credential-socket\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:27.950447 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.950418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-workload-certs\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:27.950630 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.950613 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-envoy\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:27.950776 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.950760 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-workload-socket\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:27.950928 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.950912 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kln8q\" (UniqueName: \"kubernetes.io/projected/8288e29f-9a7a-4b08-b403-bf73138d6b71-kube-api-access-kln8q\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:27.951086 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.951072 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-data\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:27.951238 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.951224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-podinfo\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:27.951367 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.951353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-token\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:27.951507 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:27.951492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8288e29f-9a7a-4b08-b403-bf73138d6b71-istiod-ca-cert\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.052670 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.052638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-podinfo\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.052670 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.052673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-token\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.052959 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.052701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8288e29f-9a7a-4b08-b403-bf73138d6b71-istiod-ca-cert\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.052959 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.052741 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-credential-socket\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.052959 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.052789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-workload-certs\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.052959 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.052809 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-envoy\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.052959 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.052835 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-workload-socket\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.052959 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.052882 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kln8q\" (UniqueName: \"kubernetes.io/projected/8288e29f-9a7a-4b08-b403-bf73138d6b71-kube-api-access-kln8q\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.052959 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.052913 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-data\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.053346 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.053320 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-workload-certs\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.053426 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.053404 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-data\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.053574 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.053516 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8288e29f-9a7a-4b08-b403-bf73138d6b71-istiod-ca-cert\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.053692 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.053574 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-workload-socket\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.053692 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.053646 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-credential-socket\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.055412 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.055389 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-envoy\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.055592 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.055571 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-podinfo\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.060999 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.060974 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-token\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.061175 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.061155 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kln8q\" (UniqueName: \"kubernetes.io/projected/8288e29f-9a7a-4b08-b403-bf73138d6b71-kube-api-access-kln8q\") pod \"e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.157686 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.157586 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:28.301880 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.301835 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb"] Jul 20 10:16:28.302455 ip-10-0-142-133 kubenswrapper[2577]: W0720 10:16:28.302431 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8288e29f_9a7a_4b08_b403_bf73138d6b71.slice/crio-bec382ac58ccf9c7228a0c41f47a6e38469a0da4ecfd24c0db748e77bf62baa7 WatchSource:0}: Error finding container bec382ac58ccf9c7228a0c41f47a6e38469a0da4ecfd24c0db748e77bf62baa7: Status 404 returned error can't find the container with id bec382ac58ccf9c7228a0c41f47a6e38469a0da4ecfd24c0db748e77bf62baa7 Jul 20 10:16:28.304697 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.304665 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:16:28.304756 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.304730 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:16:28.304792 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:28.304759 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:16:29.125384 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:29.125347 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" event={"ID":"8288e29f-9a7a-4b08-b403-bf73138d6b71","Type":"ContainerStarted","Data":"0d6d66ac3803e137126eb99763d822b11c1da9ef4b4196107514c3eb2fb0fdea"} Jul 20 10:16:29.125791 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:29.125412 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" event={"ID":"8288e29f-9a7a-4b08-b403-bf73138d6b71","Type":"ContainerStarted","Data":"bec382ac58ccf9c7228a0c41f47a6e38469a0da4ecfd24c0db748e77bf62baa7"} Jul 20 10:16:29.146635 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:29.146575 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" podStartSLOduration=2.146556066 podStartE2EDuration="2.146556066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:16:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:16:29.142886724 +0000 UTC m=+2268.616987752" watchObservedRunningTime="2026-07-20 10:16:29.146556066 +0000 UTC m=+2268.620657097" Jul 20 10:16:29.158517 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:29.158481 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:29.163654 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:29.163627 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:30.131305 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:30.131271 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:30.132239 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:30.132217 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:32.143788 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.143705 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:16:32.145383 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.145355 2577 generic.go:356] "Generic (PLEG): container finished" podID="4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" containerID="2381bb77b3dd8eaa74a7d25c2b6287e08d77bbe947b0d44ae0fd2e1fb8287f94" exitCode=0 Jul 20 10:16:32.145523 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.145439 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" event={"ID":"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5","Type":"ContainerDied","Data":"2381bb77b3dd8eaa74a7d25c2b6287e08d77bbe947b0d44ae0fd2e1fb8287f94"} Jul 20 10:16:32.145591 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.145543 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" event={"ID":"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5","Type":"ContainerDied","Data":"35dfcc1becdce264956c631c32c3cb6fa41ccc32f2aedc7c3057fc3c62194561"} Jul 20 10:16:32.145644 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.145581 2577 scope.go:117] "RemoveContainer" containerID="2381bb77b3dd8eaa74a7d25c2b6287e08d77bbe947b0d44ae0fd2e1fb8287f94" Jul 20 10:16:32.155225 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.155202 2577 scope.go:117] "RemoveContainer" containerID="de2502f3ceaf41158efca29d67154ea2afc8217985a697bbe7ea8e19f840787b" Jul 20 10:16:32.163942 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.163922 2577 scope.go:117] "RemoveContainer" containerID="2381bb77b3dd8eaa74a7d25c2b6287e08d77bbe947b0d44ae0fd2e1fb8287f94" Jul 20 10:16:32.164225 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:16:32.164204 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2381bb77b3dd8eaa74a7d25c2b6287e08d77bbe947b0d44ae0fd2e1fb8287f94\": container with ID starting with 2381bb77b3dd8eaa74a7d25c2b6287e08d77bbe947b0d44ae0fd2e1fb8287f94 not found: ID does not exist" containerID="2381bb77b3dd8eaa74a7d25c2b6287e08d77bbe947b0d44ae0fd2e1fb8287f94" Jul 20 10:16:32.164273 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.164237 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2381bb77b3dd8eaa74a7d25c2b6287e08d77bbe947b0d44ae0fd2e1fb8287f94"} err="failed to get container status \"2381bb77b3dd8eaa74a7d25c2b6287e08d77bbe947b0d44ae0fd2e1fb8287f94\": rpc error: code = NotFound desc = could not find container \"2381bb77b3dd8eaa74a7d25c2b6287e08d77bbe947b0d44ae0fd2e1fb8287f94\": container with ID starting with 2381bb77b3dd8eaa74a7d25c2b6287e08d77bbe947b0d44ae0fd2e1fb8287f94 not found: ID does not exist" Jul 20 10:16:32.164273 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.164257 2577 scope.go:117] "RemoveContainer" containerID="de2502f3ceaf41158efca29d67154ea2afc8217985a697bbe7ea8e19f840787b" Jul 20 10:16:32.164534 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:16:32.164511 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de2502f3ceaf41158efca29d67154ea2afc8217985a697bbe7ea8e19f840787b\": container with ID starting with de2502f3ceaf41158efca29d67154ea2afc8217985a697bbe7ea8e19f840787b not found: ID does not exist" containerID="de2502f3ceaf41158efca29d67154ea2afc8217985a697bbe7ea8e19f840787b" Jul 20 10:16:32.164610 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.164543 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2502f3ceaf41158efca29d67154ea2afc8217985a697bbe7ea8e19f840787b"} err="failed to get container status \"de2502f3ceaf41158efca29d67154ea2afc8217985a697bbe7ea8e19f840787b\": rpc error: code = NotFound desc = could not find container \"de2502f3ceaf41158efca29d67154ea2afc8217985a697bbe7ea8e19f840787b\": container with ID starting with de2502f3ceaf41158efca29d67154ea2afc8217985a697bbe7ea8e19f840787b not found: ID does not exist" Jul 20 10:16:32.297523 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.297487 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-envoy\") pod \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " Jul 20 10:16:32.297523 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.297521 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-data\") pod \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " Jul 20 10:16:32.297749 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.297566 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdrgh\" (UniqueName: \"kubernetes.io/projected/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-kube-api-access-vdrgh\") pod \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " Jul 20 10:16:32.297749 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.297594 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-podinfo\") pod \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " Jul 20 10:16:32.297749 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.297616 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-token\") pod \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " Jul 20 10:16:32.297749 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.297664 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istiod-ca-cert\") pod \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " Jul 20 10:16:32.297749 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.297678 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-workload-certs\") pod \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " Jul 20 10:16:32.297749 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.297717 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-workload-socket\") pod \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " Jul 20 10:16:32.298081 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.297792 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-credential-socket\") pod \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\" (UID: \"4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5\") " Jul 20 10:16:32.298688 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.298208 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" (UID: "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:16:32.298688 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.298301 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" (UID: "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:16:32.298688 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.298411 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" (UID: "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:16:32.298688 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.298579 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" (UID: "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:16:32.298688 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.298508 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-data" (OuterVolumeSpecName: "istio-data") pod "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" (UID: "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:16:32.300061 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.300033 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-token" (OuterVolumeSpecName: "istio-token") pod "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" (UID: "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:16:32.300144 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.300043 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" (UID: "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 10:16:32.300312 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.300293 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" (UID: "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:16:32.300372 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.300324 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-kube-api-access-vdrgh" (OuterVolumeSpecName: "kube-api-access-vdrgh") pod "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" (UID: "4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5"). InnerVolumeSpecName "kube-api-access-vdrgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:16:32.399133 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.399037 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-credential-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:32.399133 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.399082 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-envoy\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:32.399133 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.399096 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-data\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:32.399133 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.399108 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdrgh\" (UniqueName: \"kubernetes.io/projected/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-kube-api-access-vdrgh\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:32.399133 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.399122 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-podinfo\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:32.399133 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.399135 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istio-token\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:32.399440 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.399149 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-istiod-ca-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:32.399440 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.399162 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-workload-certs\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:32.399440 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:32.399175 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5-workload-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:16:33.152177 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:33.152145 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6" Jul 20 10:16:33.169576 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:33.169541 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6"] Jul 20 10:16:33.177086 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:33.177053 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-8a2a58-openshift-default-6d7f846449-k4sv6"] Jul 20 10:16:35.024978 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:35.024943 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" path="/var/lib/kubelet/pods/4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5/volumes" Jul 20 10:16:36.455305 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.455268 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw"] Jul 20 10:16:36.455684 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.455636 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" containerName="istio-proxy" Jul 20 10:16:36.455684 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.455648 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" containerName="istio-proxy" Jul 20 10:16:36.455764 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.455716 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="25acf52e-c320-4df2-8b32-ce8f51c5a8a7" containerName="istio-proxy" Jul 20 10:16:36.455764 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.455730 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" containerName="istio-proxy" Jul 20 10:16:36.455764 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.455736 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" containerName="istio-proxy" Jul 20 10:16:36.460652 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.460630 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.474053 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.464135 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-39467e-openshift-default-dockercfg-fcw85\"" Jul 20 10:16:36.474916 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.474885 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw"] Jul 20 10:16:36.635968 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.635925 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c433992a-72aa-4123-8eb2-f0505513aee1-istio-podinfo\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.636156 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.635987 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c433992a-72aa-4123-8eb2-f0505513aee1-istiod-ca-cert\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.636156 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.636062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-workload-certs\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.636156 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.636102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-workload-socket\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.636156 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.636119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-istio-data\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.636301 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.636185 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-istio-envoy\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.636301 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.636236 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c433992a-72aa-4123-8eb2-f0505513aee1-istio-token\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.636301 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.636264 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfqdz\" (UniqueName: \"kubernetes.io/projected/c433992a-72aa-4123-8eb2-f0505513aee1-kube-api-access-kfqdz\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.636301 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.636285 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-credential-socket\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.737335 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.737223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c433992a-72aa-4123-8eb2-f0505513aee1-istio-token\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.737335 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.737275 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfqdz\" (UniqueName: \"kubernetes.io/projected/c433992a-72aa-4123-8eb2-f0505513aee1-kube-api-access-kfqdz\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.737335 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.737310 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-credential-socket\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.737646 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.737353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c433992a-72aa-4123-8eb2-f0505513aee1-istio-podinfo\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.737646 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.737401 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c433992a-72aa-4123-8eb2-f0505513aee1-istiod-ca-cert\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.737646 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.737450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-workload-certs\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.737646 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.737483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-workload-socket\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.737646 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.737503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-istio-data\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.737941 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.737715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-istio-envoy\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.737941 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.737779 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-credential-socket\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.737941 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.737909 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-workload-certs\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.738103 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.737963 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-workload-socket\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.738103 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.738052 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-istio-data\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.738228 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.738206 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c433992a-72aa-4123-8eb2-f0505513aee1-istiod-ca-cert\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.739905 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.739884 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-istio-envoy\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.739967 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.739926 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c433992a-72aa-4123-8eb2-f0505513aee1-istio-podinfo\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.744814 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.744789 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c433992a-72aa-4123-8eb2-f0505513aee1-istio-token\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.745146 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.745125 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfqdz\" (UniqueName: \"kubernetes.io/projected/c433992a-72aa-4123-8eb2-f0505513aee1-kube-api-access-kfqdz\") pod \"e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.777332 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.777296 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:36.931859 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.931816 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw"] Jul 20 10:16:36.932733 ip-10-0-142-133 kubenswrapper[2577]: W0720 10:16:36.932705 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc433992a_72aa_4123_8eb2_f0505513aee1.slice/crio-2330c615040b3a8318bf1cf587ee04a632cec139c6558ff5b94e23812cf6057a WatchSource:0}: Error finding container 2330c615040b3a8318bf1cf587ee04a632cec139c6558ff5b94e23812cf6057a: Status 404 returned error can't find the container with id 2330c615040b3a8318bf1cf587ee04a632cec139c6558ff5b94e23812cf6057a Jul 20 10:16:36.935006 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.934968 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:16:36.935095 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.935040 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:16:36.935095 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:36.935071 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:16:37.176362 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:37.176321 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" event={"ID":"c433992a-72aa-4123-8eb2-f0505513aee1","Type":"ContainerStarted","Data":"584005b6aef073f78f43335748eea867fc11360178294fd3648056785d058394"} Jul 20 10:16:37.176581 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:37.176388 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" event={"ID":"c433992a-72aa-4123-8eb2-f0505513aee1","Type":"ContainerStarted","Data":"2330c615040b3a8318bf1cf587ee04a632cec139c6558ff5b94e23812cf6057a"} Jul 20 10:16:37.196042 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:37.195988 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" podStartSLOduration=1.195969358 podStartE2EDuration="1.195969358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:16:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:16:37.1933567 +0000 UTC m=+2276.667457731" watchObservedRunningTime="2026-07-20 10:16:37.195969358 +0000 UTC m=+2276.670070388" Jul 20 10:16:37.777786 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:37.777747 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:37.782723 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:37.782690 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:38.182284 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:38.182249 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:38.183296 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:38.183276 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:45.133584 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:45.133542 2577 patch_prober.go:28] interesting pod/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 20 10:16:45.134057 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:45.133611 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" podUID="8288e29f-9a7a-4b08-b403-bf73138d6b71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 20 10:16:45.223878 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:45.223771 2577 generic.go:356] "Generic (PLEG): container finished" podID="8288e29f-9a7a-4b08-b403-bf73138d6b71" containerID="0d6d66ac3803e137126eb99763d822b11c1da9ef4b4196107514c3eb2fb0fdea" exitCode=0 Jul 20 10:16:45.223878 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:45.223854 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" event={"ID":"8288e29f-9a7a-4b08-b403-bf73138d6b71","Type":"ContainerDied","Data":"0d6d66ac3803e137126eb99763d822b11c1da9ef4b4196107514c3eb2fb0fdea"} Jul 20 10:16:45.224271 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:45.224256 2577 scope.go:117] "RemoveContainer" containerID="0d6d66ac3803e137126eb99763d822b11c1da9ef4b4196107514c3eb2fb0fdea" Jul 20 10:16:45.225303 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:45.225272 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:16:45.225430 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:45.225359 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:16:45.225430 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:45.225409 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:16:46.230815 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:46.230769 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" event={"ID":"8288e29f-9a7a-4b08-b403-bf73138d6b71","Type":"ContainerStarted","Data":"f809145d64f8221d32fca49a27ba3f41ffc6f9a84be7d3da9e00968344e5acfb"} Jul 20 10:16:47.158227 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:47.158180 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:47.158421 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:47.158396 2577 patch_prober.go:28] interesting pod/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 20 10:16:47.158466 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:47.158447 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" podUID="8288e29f-9a7a-4b08-b403-bf73138d6b71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 20 10:16:48.159085 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:48.159043 2577 patch_prober.go:28] interesting pod/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 20 10:16:48.159498 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:48.159106 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" podUID="8288e29f-9a7a-4b08-b403-bf73138d6b71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 20 10:16:49.158374 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:49.158335 2577 patch_prober.go:28] interesting pod/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 20 10:16:49.158682 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:49.158647 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" podUID="8288e29f-9a7a-4b08-b403-bf73138d6b71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 20 10:16:50.158638 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:50.158595 2577 patch_prober.go:28] interesting pod/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 20 10:16:50.159718 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:50.159289 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" podUID="8288e29f-9a7a-4b08-b403-bf73138d6b71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 20 10:16:51.162423 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:51.162389 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:51.162838 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:51.162647 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:51.163500 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:51.163474 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:16:54.224116 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:54.224067 2577 patch_prober.go:28] interesting pod/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 20 10:16:54.224527 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:54.224145 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" podUID="c433992a-72aa-4123-8eb2-f0505513aee1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 20 10:16:56.302486 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:56.302449 2577 generic.go:356] "Generic (PLEG): container finished" podID="c433992a-72aa-4123-8eb2-f0505513aee1" containerID="584005b6aef073f78f43335748eea867fc11360178294fd3648056785d058394" exitCode=0 Jul 20 10:16:56.302952 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:56.302523 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" event={"ID":"c433992a-72aa-4123-8eb2-f0505513aee1","Type":"ContainerDied","Data":"584005b6aef073f78f43335748eea867fc11360178294fd3648056785d058394"} Jul 20 10:16:56.302952 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:56.302946 2577 scope.go:117] "RemoveContainer" containerID="584005b6aef073f78f43335748eea867fc11360178294fd3648056785d058394" Jul 20 10:16:56.303994 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:56.303965 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:16:56.304071 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:56.304037 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:16:56.304120 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:56.304070 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:16:57.310699 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:57.310661 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" event={"ID":"c433992a-72aa-4123-8eb2-f0505513aee1","Type":"ContainerStarted","Data":"c247030ed851bf64af06cf31dfaf048558bb0f635b12feff6b278b8e7bdee361"} Jul 20 10:16:57.778383 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:57.778344 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:16:57.778639 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:57.778505 2577 patch_prober.go:28] interesting pod/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 20 10:16:57.778639 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:57.778551 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" podUID="c433992a-72aa-4123-8eb2-f0505513aee1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 20 10:16:58.778576 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:58.778538 2577 patch_prober.go:28] interesting pod/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 20 10:16:58.778999 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:58.778615 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" podUID="c433992a-72aa-4123-8eb2-f0505513aee1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 20 10:16:59.777925 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:59.777884 2577 patch_prober.go:28] interesting pod/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 20 10:16:59.778109 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:16:59.777956 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" podUID="c433992a-72aa-4123-8eb2-f0505513aee1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 20 10:17:00.777771 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:00.777734 2577 patch_prober.go:28] interesting pod/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 20 10:17:00.778210 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:00.777786 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" podUID="c433992a-72aa-4123-8eb2-f0505513aee1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 20 10:17:01.781507 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:01.781476 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:17:01.781928 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:01.781737 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:17:01.782315 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:01.782296 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:17:18.472018 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:18.471985 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb"] Jul 20 10:17:18.472506 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:18.472304 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" podUID="8288e29f-9a7a-4b08-b403-bf73138d6b71" containerName="istio-proxy" containerID="cri-o://f809145d64f8221d32fca49a27ba3f41ffc6f9a84be7d3da9e00968344e5acfb" gracePeriod=30 Jul 20 10:17:21.165560 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:21.165514 2577 patch_prober.go:28] interesting pod/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 10:17:21.165977 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:21.165598 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" podUID="8288e29f-9a7a-4b08-b403-bf73138d6b71" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 10:17:23.737079 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.737017 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:17:23.882149 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882111 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-workload-certs\") pod \"8288e29f-9a7a-4b08-b403-bf73138d6b71\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " Jul 20 10:17:23.882149 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882151 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-workload-socket\") pod \"8288e29f-9a7a-4b08-b403-bf73138d6b71\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " Jul 20 10:17:23.882376 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882172 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8288e29f-9a7a-4b08-b403-bf73138d6b71-istiod-ca-cert\") pod \"8288e29f-9a7a-4b08-b403-bf73138d6b71\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " Jul 20 10:17:23.882376 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882242 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kln8q\" (UniqueName: \"kubernetes.io/projected/8288e29f-9a7a-4b08-b403-bf73138d6b71-kube-api-access-kln8q\") pod \"8288e29f-9a7a-4b08-b403-bf73138d6b71\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " Jul 20 10:17:23.882376 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882265 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-credential-socket\") pod \"8288e29f-9a7a-4b08-b403-bf73138d6b71\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " Jul 20 10:17:23.882376 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882296 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-envoy\") pod \"8288e29f-9a7a-4b08-b403-bf73138d6b71\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " Jul 20 10:17:23.882376 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882319 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-data\") pod \"8288e29f-9a7a-4b08-b403-bf73138d6b71\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " Jul 20 10:17:23.882376 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882361 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-token\") pod \"8288e29f-9a7a-4b08-b403-bf73138d6b71\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " Jul 20 10:17:23.882704 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882456 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-podinfo\") pod \"8288e29f-9a7a-4b08-b403-bf73138d6b71\" (UID: \"8288e29f-9a7a-4b08-b403-bf73138d6b71\") " Jul 20 10:17:23.882704 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882449 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8288e29f-9a7a-4b08-b403-bf73138d6b71" (UID: "8288e29f-9a7a-4b08-b403-bf73138d6b71"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:17:23.882704 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882476 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8288e29f-9a7a-4b08-b403-bf73138d6b71" (UID: "8288e29f-9a7a-4b08-b403-bf73138d6b71"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:17:23.882704 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882623 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8288e29f-9a7a-4b08-b403-bf73138d6b71" (UID: "8288e29f-9a7a-4b08-b403-bf73138d6b71"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:17:23.882964 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882700 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8288e29f-9a7a-4b08-b403-bf73138d6b71-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8288e29f-9a7a-4b08-b403-bf73138d6b71" (UID: "8288e29f-9a7a-4b08-b403-bf73138d6b71"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:17:23.882964 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882938 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-workload-certs\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:23.882964 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882957 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-workload-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:23.882964 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882966 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8288e29f-9a7a-4b08-b403-bf73138d6b71-istiod-ca-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:23.883163 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.882977 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-credential-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:23.883550 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.883526 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-data" (OuterVolumeSpecName: "istio-data") pod "8288e29f-9a7a-4b08-b403-bf73138d6b71" (UID: "8288e29f-9a7a-4b08-b403-bf73138d6b71"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:17:23.885144 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.885111 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8288e29f-9a7a-4b08-b403-bf73138d6b71-kube-api-access-kln8q" (OuterVolumeSpecName: "kube-api-access-kln8q") pod "8288e29f-9a7a-4b08-b403-bf73138d6b71" (UID: "8288e29f-9a7a-4b08-b403-bf73138d6b71"). InnerVolumeSpecName "kube-api-access-kln8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:17:23.885144 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.885136 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8288e29f-9a7a-4b08-b403-bf73138d6b71" (UID: "8288e29f-9a7a-4b08-b403-bf73138d6b71"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 10:17:23.885289 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.885142 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8288e29f-9a7a-4b08-b403-bf73138d6b71" (UID: "8288e29f-9a7a-4b08-b403-bf73138d6b71"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:17:23.885289 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.885141 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-token" (OuterVolumeSpecName: "istio-token") pod "8288e29f-9a7a-4b08-b403-bf73138d6b71" (UID: "8288e29f-9a7a-4b08-b403-bf73138d6b71"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:17:23.984502 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.984463 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kln8q\" (UniqueName: \"kubernetes.io/projected/8288e29f-9a7a-4b08-b403-bf73138d6b71-kube-api-access-kln8q\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:23.984502 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.984497 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-envoy\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:23.984502 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.984506 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-data\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:23.984502 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.984514 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-token\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:23.984783 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:23.984522 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8288e29f-9a7a-4b08-b403-bf73138d6b71-istio-podinfo\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:24.457525 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:24.457487 2577 generic.go:356] "Generic (PLEG): container finished" podID="8288e29f-9a7a-4b08-b403-bf73138d6b71" containerID="f809145d64f8221d32fca49a27ba3f41ffc6f9a84be7d3da9e00968344e5acfb" exitCode=0 Jul 20 10:17:24.457724 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:24.457542 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" Jul 20 10:17:24.457724 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:24.457547 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" event={"ID":"8288e29f-9a7a-4b08-b403-bf73138d6b71","Type":"ContainerDied","Data":"f809145d64f8221d32fca49a27ba3f41ffc6f9a84be7d3da9e00968344e5acfb"} Jul 20 10:17:24.457724 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:24.457664 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb" event={"ID":"8288e29f-9a7a-4b08-b403-bf73138d6b71","Type":"ContainerDied","Data":"bec382ac58ccf9c7228a0c41f47a6e38469a0da4ecfd24c0db748e77bf62baa7"} Jul 20 10:17:24.457724 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:24.457695 2577 scope.go:117] "RemoveContainer" containerID="f809145d64f8221d32fca49a27ba3f41ffc6f9a84be7d3da9e00968344e5acfb" Jul 20 10:17:24.467646 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:24.467625 2577 scope.go:117] "RemoveContainer" containerID="0d6d66ac3803e137126eb99763d822b11c1da9ef4b4196107514c3eb2fb0fdea" Jul 20 10:17:24.479066 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:24.479044 2577 scope.go:117] "RemoveContainer" containerID="f809145d64f8221d32fca49a27ba3f41ffc6f9a84be7d3da9e00968344e5acfb" Jul 20 10:17:24.479389 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:17:24.479372 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f809145d64f8221d32fca49a27ba3f41ffc6f9a84be7d3da9e00968344e5acfb\": container with ID starting with f809145d64f8221d32fca49a27ba3f41ffc6f9a84be7d3da9e00968344e5acfb not found: ID does not exist" containerID="f809145d64f8221d32fca49a27ba3f41ffc6f9a84be7d3da9e00968344e5acfb" Jul 20 10:17:24.479437 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:24.479399 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f809145d64f8221d32fca49a27ba3f41ffc6f9a84be7d3da9e00968344e5acfb"} err="failed to get container status \"f809145d64f8221d32fca49a27ba3f41ffc6f9a84be7d3da9e00968344e5acfb\": rpc error: code = NotFound desc = could not find container \"f809145d64f8221d32fca49a27ba3f41ffc6f9a84be7d3da9e00968344e5acfb\": container with ID starting with f809145d64f8221d32fca49a27ba3f41ffc6f9a84be7d3da9e00968344e5acfb not found: ID does not exist" Jul 20 10:17:24.479437 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:24.479420 2577 scope.go:117] "RemoveContainer" containerID="0d6d66ac3803e137126eb99763d822b11c1da9ef4b4196107514c3eb2fb0fdea" Jul 20 10:17:24.479685 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:17:24.479666 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d6d66ac3803e137126eb99763d822b11c1da9ef4b4196107514c3eb2fb0fdea\": container with ID starting with 0d6d66ac3803e137126eb99763d822b11c1da9ef4b4196107514c3eb2fb0fdea not found: ID does not exist" containerID="0d6d66ac3803e137126eb99763d822b11c1da9ef4b4196107514c3eb2fb0fdea" Jul 20 10:17:24.479733 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:24.479689 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6d66ac3803e137126eb99763d822b11c1da9ef4b4196107514c3eb2fb0fdea"} err="failed to get container status \"0d6d66ac3803e137126eb99763d822b11c1da9ef4b4196107514c3eb2fb0fdea\": rpc error: code = NotFound desc = could not find container \"0d6d66ac3803e137126eb99763d822b11c1da9ef4b4196107514c3eb2fb0fdea\": container with ID starting with 0d6d66ac3803e137126eb99763d822b11c1da9ef4b4196107514c3eb2fb0fdea not found: ID does not exist" Jul 20 10:17:24.482082 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:24.482054 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb"] Jul 20 10:17:24.491148 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:24.486746 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-817a64-openshift-default-7c9c9d589c-vttlb"] Jul 20 10:17:25.025077 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:25.025042 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8288e29f-9a7a-4b08-b403-bf73138d6b71" path="/var/lib/kubelet/pods/8288e29f-9a7a-4b08-b403-bf73138d6b71/volumes" Jul 20 10:17:45.423386 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:45.423344 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw"] Jul 20 10:17:45.424287 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:45.424228 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" podUID="c433992a-72aa-4123-8eb2-f0505513aee1" containerName="istio-proxy" containerID="cri-o://c247030ed851bf64af06cf31dfaf048558bb0f635b12feff6b278b8e7bdee361" gracePeriod=30 Jul 20 10:17:46.356778 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.356744 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw"] Jul 20 10:17:46.357127 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.357114 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8288e29f-9a7a-4b08-b403-bf73138d6b71" containerName="istio-proxy" Jul 20 10:17:46.357174 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.357129 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8288e29f-9a7a-4b08-b403-bf73138d6b71" containerName="istio-proxy" Jul 20 10:17:46.357174 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.357146 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" containerName="istio-proxy" Jul 20 10:17:46.357174 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.357152 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d3b1ea8-a0f0-47b1-bc11-e2e6caf7ace5" containerName="istio-proxy" Jul 20 10:17:46.357174 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.357168 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8288e29f-9a7a-4b08-b403-bf73138d6b71" containerName="istio-proxy" Jul 20 10:17:46.357174 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.357174 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8288e29f-9a7a-4b08-b403-bf73138d6b71" containerName="istio-proxy" Jul 20 10:17:46.357347 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.357227 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8288e29f-9a7a-4b08-b403-bf73138d6b71" containerName="istio-proxy" Jul 20 10:17:46.357347 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.357236 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8288e29f-9a7a-4b08-b403-bf73138d6b71" containerName="istio-proxy" Jul 20 10:17:46.362113 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.362085 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.364418 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.364396 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-b7ed4c-openshift-default-dockercfg-7lxc4\"" Jul 20 10:17:46.375163 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.375133 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw"] Jul 20 10:17:46.495743 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.495709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-754kx\" (UniqueName: \"kubernetes.io/projected/1649340a-df74-4df3-b703-2eb2cdf86981-kube-api-access-754kx\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.495743 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.495749 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-istio-envoy\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.496236 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.495781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-workload-certs\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.496236 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.495823 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1649340a-df74-4df3-b703-2eb2cdf86981-istio-token\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.496236 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.495906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-credential-socket\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.496236 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.495931 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-istio-data\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.496236 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.495996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-workload-socket\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.496236 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.496061 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1649340a-df74-4df3-b703-2eb2cdf86981-istiod-ca-cert\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.496236 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.496100 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1649340a-df74-4df3-b703-2eb2cdf86981-istio-podinfo\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.597342 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.597302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1649340a-df74-4df3-b703-2eb2cdf86981-istio-podinfo\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.597558 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.597356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-754kx\" (UniqueName: \"kubernetes.io/projected/1649340a-df74-4df3-b703-2eb2cdf86981-kube-api-access-754kx\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.597558 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.597378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-istio-envoy\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.597558 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.597402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-workload-certs\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.597558 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.597416 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1649340a-df74-4df3-b703-2eb2cdf86981-istio-token\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.597558 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.597452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-credential-socket\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.597558 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.597473 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-istio-data\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.597558 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.597495 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-workload-socket\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.597558 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.597539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1649340a-df74-4df3-b703-2eb2cdf86981-istiod-ca-cert\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.598018 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.597995 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-istio-data\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.598079 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.598048 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-credential-socket\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.598137 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.598083 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-workload-certs\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.598201 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.598129 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-workload-socket\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.598314 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.598294 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1649340a-df74-4df3-b703-2eb2cdf86981-istiod-ca-cert\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.599832 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.599806 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-istio-envoy\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.600064 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.600049 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1649340a-df74-4df3-b703-2eb2cdf86981-istio-podinfo\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.605647 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.605623 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1649340a-df74-4df3-b703-2eb2cdf86981-istio-token\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.605775 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.605754 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-754kx\" (UniqueName: \"kubernetes.io/projected/1649340a-df74-4df3-b703-2eb2cdf86981-kube-api-access-754kx\") pod \"e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.673670 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.673570 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:46.784253 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.784212 2577 patch_prober.go:28] interesting pod/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 10:17:46.784443 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.784297 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" podUID="c433992a-72aa-4123-8eb2-f0505513aee1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 10:17:46.821663 ip-10-0-142-133 kubenswrapper[2577]: W0720 10:17:46.821631 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1649340a_df74_4df3_b703_2eb2cdf86981.slice/crio-b1612dbbc06f4e9fed95d6a9c24cae82b1d6fb16b3b7d79eb5beee3ae153b8de WatchSource:0}: Error finding container b1612dbbc06f4e9fed95d6a9c24cae82b1d6fb16b3b7d79eb5beee3ae153b8de: Status 404 returned error can't find the container with id b1612dbbc06f4e9fed95d6a9c24cae82b1d6fb16b3b7d79eb5beee3ae153b8de Jul 20 10:17:46.821806 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.821768 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw"] Jul 20 10:17:46.824113 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.824069 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:17:46.824226 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.824160 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:17:46.824226 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:46.824205 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:17:47.582695 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:47.582658 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" event={"ID":"1649340a-df74-4df3-b703-2eb2cdf86981","Type":"ContainerStarted","Data":"de2e5b67b267d51cbbc3a13da8c3d08b386559f3347a216f101c138c0ca691a7"} Jul 20 10:17:47.583328 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:47.582718 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" event={"ID":"1649340a-df74-4df3-b703-2eb2cdf86981","Type":"ContainerStarted","Data":"b1612dbbc06f4e9fed95d6a9c24cae82b1d6fb16b3b7d79eb5beee3ae153b8de"} Jul 20 10:17:47.604841 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:47.604785 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" podStartSLOduration=1.604769034 podStartE2EDuration="1.604769034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:17:47.602027534 +0000 UTC m=+2347.076128589" watchObservedRunningTime="2026-07-20 10:17:47.604769034 +0000 UTC m=+2347.078870069" Jul 20 10:17:47.673943 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:47.673898 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:47.675620 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:47.675594 2577 patch_prober.go:28] interesting pod/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 10:17:47.675772 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:47.675643 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" podUID="1649340a-df74-4df3-b703-2eb2cdf86981" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 10:17:48.678297 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:48.678263 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:49.593805 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:49.593771 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:49.594787 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:49.594768 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:17:50.603953 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.603918 2577 generic.go:356] "Generic (PLEG): container finished" podID="c433992a-72aa-4123-8eb2-f0505513aee1" containerID="c247030ed851bf64af06cf31dfaf048558bb0f635b12feff6b278b8e7bdee361" exitCode=0 Jul 20 10:17:50.604464 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.604011 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" event={"ID":"c433992a-72aa-4123-8eb2-f0505513aee1","Type":"ContainerDied","Data":"c247030ed851bf64af06cf31dfaf048558bb0f635b12feff6b278b8e7bdee361"} Jul 20 10:17:50.604464 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.604096 2577 scope.go:117] "RemoveContainer" containerID="584005b6aef073f78f43335748eea867fc11360178294fd3648056785d058394" Jul 20 10:17:50.692712 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.692638 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:17:50.840307 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.840251 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c433992a-72aa-4123-8eb2-f0505513aee1-istiod-ca-cert\") pod \"c433992a-72aa-4123-8eb2-f0505513aee1\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " Jul 20 10:17:50.840307 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.840318 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfqdz\" (UniqueName: \"kubernetes.io/projected/c433992a-72aa-4123-8eb2-f0505513aee1-kube-api-access-kfqdz\") pod \"c433992a-72aa-4123-8eb2-f0505513aee1\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " Jul 20 10:17:50.840580 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.840356 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-workload-socket\") pod \"c433992a-72aa-4123-8eb2-f0505513aee1\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " Jul 20 10:17:50.840580 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.840423 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-istio-data\") pod \"c433992a-72aa-4123-8eb2-f0505513aee1\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " Jul 20 10:17:50.840580 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.840454 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-workload-certs\") pod \"c433992a-72aa-4123-8eb2-f0505513aee1\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " Jul 20 10:17:50.840580 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.840522 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-credential-socket\") pod \"c433992a-72aa-4123-8eb2-f0505513aee1\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " Jul 20 10:17:50.840580 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.840573 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-istio-envoy\") pod \"c433992a-72aa-4123-8eb2-f0505513aee1\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " Jul 20 10:17:50.840880 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.840608 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c433992a-72aa-4123-8eb2-f0505513aee1-istio-podinfo\") pod \"c433992a-72aa-4123-8eb2-f0505513aee1\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " Jul 20 10:17:50.840880 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.840634 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c433992a-72aa-4123-8eb2-f0505513aee1-istio-token\") pod \"c433992a-72aa-4123-8eb2-f0505513aee1\" (UID: \"c433992a-72aa-4123-8eb2-f0505513aee1\") " Jul 20 10:17:50.840880 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.840746 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c433992a-72aa-4123-8eb2-f0505513aee1" (UID: "c433992a-72aa-4123-8eb2-f0505513aee1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:17:50.840880 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.840807 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c433992a-72aa-4123-8eb2-f0505513aee1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c433992a-72aa-4123-8eb2-f0505513aee1" (UID: "c433992a-72aa-4123-8eb2-f0505513aee1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:17:50.841094 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.841027 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c433992a-72aa-4123-8eb2-f0505513aee1" (UID: "c433992a-72aa-4123-8eb2-f0505513aee1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:17:50.841094 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.841050 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c433992a-72aa-4123-8eb2-f0505513aee1-istiod-ca-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:50.841094 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.841073 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-workload-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:50.841263 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.841237 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c433992a-72aa-4123-8eb2-f0505513aee1" (UID: "c433992a-72aa-4123-8eb2-f0505513aee1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:17:50.841485 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.841445 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-istio-data" (OuterVolumeSpecName: "istio-data") pod "c433992a-72aa-4123-8eb2-f0505513aee1" (UID: "c433992a-72aa-4123-8eb2-f0505513aee1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:17:50.843125 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.843094 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c433992a-72aa-4123-8eb2-f0505513aee1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c433992a-72aa-4123-8eb2-f0505513aee1" (UID: "c433992a-72aa-4123-8eb2-f0505513aee1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 10:17:50.843245 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.843144 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c433992a-72aa-4123-8eb2-f0505513aee1-istio-token" (OuterVolumeSpecName: "istio-token") pod "c433992a-72aa-4123-8eb2-f0505513aee1" (UID: "c433992a-72aa-4123-8eb2-f0505513aee1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:17:50.843245 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.843187 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c433992a-72aa-4123-8eb2-f0505513aee1-kube-api-access-kfqdz" (OuterVolumeSpecName: "kube-api-access-kfqdz") pod "c433992a-72aa-4123-8eb2-f0505513aee1" (UID: "c433992a-72aa-4123-8eb2-f0505513aee1"). InnerVolumeSpecName "kube-api-access-kfqdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:17:50.843245 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.843214 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c433992a-72aa-4123-8eb2-f0505513aee1" (UID: "c433992a-72aa-4123-8eb2-f0505513aee1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:17:50.942051 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.941994 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c433992a-72aa-4123-8eb2-f0505513aee1-istio-podinfo\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:50.942051 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.942044 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c433992a-72aa-4123-8eb2-f0505513aee1-istio-token\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:50.942051 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.942054 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfqdz\" (UniqueName: \"kubernetes.io/projected/c433992a-72aa-4123-8eb2-f0505513aee1-kube-api-access-kfqdz\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:50.942051 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.942064 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-istio-data\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:50.942051 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.942074 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-workload-certs\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:50.942512 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.942082 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-credential-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:50.942512 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:50.942089 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c433992a-72aa-4123-8eb2-f0505513aee1-istio-envoy\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:17:51.610433 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:51.610401 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" Jul 20 10:17:51.610927 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:51.610438 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw" event={"ID":"c433992a-72aa-4123-8eb2-f0505513aee1","Type":"ContainerDied","Data":"2330c615040b3a8318bf1cf587ee04a632cec139c6558ff5b94e23812cf6057a"} Jul 20 10:17:51.610927 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:51.610498 2577 scope.go:117] "RemoveContainer" containerID="c247030ed851bf64af06cf31dfaf048558bb0f635b12feff6b278b8e7bdee361" Jul 20 10:17:51.628441 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:51.628406 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw"] Jul 20 10:17:51.631786 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:51.631754 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-39467e-openshift-default-67f4958bb5-4qxbw"] Jul 20 10:17:53.030289 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:53.030254 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c433992a-72aa-4123-8eb2-f0505513aee1" path="/var/lib/kubelet/pods/c433992a-72aa-4123-8eb2-f0505513aee1/volumes" Jul 20 10:17:54.733491 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.733454 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs"] Jul 20 10:17:54.733952 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.733882 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c433992a-72aa-4123-8eb2-f0505513aee1" containerName="istio-proxy" Jul 20 10:17:54.733952 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.733898 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c433992a-72aa-4123-8eb2-f0505513aee1" containerName="istio-proxy" Jul 20 10:17:54.733952 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.733909 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c433992a-72aa-4123-8eb2-f0505513aee1" containerName="istio-proxy" Jul 20 10:17:54.733952 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.733915 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c433992a-72aa-4123-8eb2-f0505513aee1" containerName="istio-proxy" Jul 20 10:17:54.734115 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.734004 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c433992a-72aa-4123-8eb2-f0505513aee1" containerName="istio-proxy" Jul 20 10:17:54.738528 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.738509 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.741080 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.741059 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-186a7e-openshift-default-dockercfg-l648d\"" Jul 20 10:17:54.749666 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.749643 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs"] Jul 20 10:17:54.876951 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.876909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-istio-envoy\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.877118 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.876965 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-workload-socket\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.877118 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.876990 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccfgg\" (UniqueName: \"kubernetes.io/projected/6920853b-b282-4347-b371-c257980ce18e-kube-api-access-ccfgg\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.877118 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.877078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-istio-data\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.877255 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.877142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-workload-certs\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.877255 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.877169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6920853b-b282-4347-b371-c257980ce18e-istiod-ca-cert\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.877255 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.877193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-credential-socket\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.877363 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.877258 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6920853b-b282-4347-b371-c257980ce18e-istio-token\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.877363 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.877291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6920853b-b282-4347-b371-c257980ce18e-istio-podinfo\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.978222 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.978185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6920853b-b282-4347-b371-c257980ce18e-istio-token\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.978222 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.978228 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6920853b-b282-4347-b371-c257980ce18e-istio-podinfo\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.978515 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.978266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-istio-envoy\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.978515 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.978311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-workload-socket\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.978515 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.978340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccfgg\" (UniqueName: \"kubernetes.io/projected/6920853b-b282-4347-b371-c257980ce18e-kube-api-access-ccfgg\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.978515 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.978419 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-istio-data\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.978515 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.978509 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-workload-certs\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.978779 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.978548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6920853b-b282-4347-b371-c257980ce18e-istiod-ca-cert\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.978779 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.978589 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-credential-socket\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.978926 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.978774 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-workload-socket\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.978987 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.978931 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-workload-certs\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.979044 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.979015 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-istio-data\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.979102 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.979024 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-credential-socket\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.979439 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.979405 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6920853b-b282-4347-b371-c257980ce18e-istiod-ca-cert\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.980708 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.980682 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-istio-envoy\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.980881 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.980865 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6920853b-b282-4347-b371-c257980ce18e-istio-podinfo\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.987083 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.987017 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6920853b-b282-4347-b371-c257980ce18e-istio-token\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:54.987205 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:54.987166 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccfgg\" (UniqueName: \"kubernetes.io/projected/6920853b-b282-4347-b371-c257980ce18e-kube-api-access-ccfgg\") pod \"e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:55.051213 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:55.051177 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:55.198434 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:55.198407 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs"] Jul 20 10:17:55.199642 ip-10-0-142-133 kubenswrapper[2577]: W0720 10:17:55.199617 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6920853b_b282_4347_b371_c257980ce18e.slice/crio-355860b5aee3f38837fb292029fac5ef99b151a53392b8675eb4170545135d95 WatchSource:0}: Error finding container 355860b5aee3f38837fb292029fac5ef99b151a53392b8675eb4170545135d95: Status 404 returned error can't find the container with id 355860b5aee3f38837fb292029fac5ef99b151a53392b8675eb4170545135d95 Jul 20 10:17:55.202262 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:55.202228 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:17:55.202380 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:55.202315 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:17:55.202380 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:55.202363 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:17:55.637298 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:55.637252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" event={"ID":"6920853b-b282-4347-b371-c257980ce18e","Type":"ContainerStarted","Data":"956a9a9d3508be411230b2880853da705ebad45ac648c0b2648461e5b515dd2d"} Jul 20 10:17:55.637493 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:55.637313 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" event={"ID":"6920853b-b282-4347-b371-c257980ce18e","Type":"ContainerStarted","Data":"355860b5aee3f38837fb292029fac5ef99b151a53392b8675eb4170545135d95"} Jul 20 10:17:55.654708 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:55.654641 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" podStartSLOduration=1.6546170359999999 podStartE2EDuration="1.654617036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:17:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:17:55.654091201 +0000 UTC m=+2355.128192233" watchObservedRunningTime="2026-07-20 10:17:55.654617036 +0000 UTC m=+2355.128718072" Jul 20 10:17:56.052297 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:56.052197 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:56.057184 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:56.057156 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:56.649602 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:56.649560 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:17:56.654545 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:17:56.654503 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:18:04.595206 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:04.595170 2577 patch_prober.go:28] interesting pod/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 10:18:04.595642 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:04.595224 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" podUID="1649340a-df74-4df3-b703-2eb2cdf86981" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 10:18:04.696527 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:04.696490 2577 generic.go:356] "Generic (PLEG): container finished" podID="1649340a-df74-4df3-b703-2eb2cdf86981" containerID="de2e5b67b267d51cbbc3a13da8c3d08b386559f3347a216f101c138c0ca691a7" exitCode=0 Jul 20 10:18:04.696709 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:04.696564 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" event={"ID":"1649340a-df74-4df3-b703-2eb2cdf86981","Type":"ContainerDied","Data":"de2e5b67b267d51cbbc3a13da8c3d08b386559f3347a216f101c138c0ca691a7"} Jul 20 10:18:04.697006 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:04.696992 2577 scope.go:117] "RemoveContainer" containerID="de2e5b67b267d51cbbc3a13da8c3d08b386559f3347a216f101c138c0ca691a7" Jul 20 10:18:04.701141 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:04.701097 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:18:04.701280 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:04.701196 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:18:04.701280 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:04.701245 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:18:05.705464 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:05.705431 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" event={"ID":"1649340a-df74-4df3-b703-2eb2cdf86981","Type":"ContainerStarted","Data":"bdb2db8c4e8454869f3dce411d34e7c44c08b987413b5896184a95f8b305ceb3"} Jul 20 10:18:06.673960 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:06.673911 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:18:06.674216 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:06.674192 2577 patch_prober.go:28] interesting pod/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 10:18:06.674284 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:06.674263 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" podUID="1649340a-df74-4df3-b703-2eb2cdf86981" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 10:18:07.674415 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:07.674373 2577 patch_prober.go:28] interesting pod/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 10:18:07.674924 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:07.674454 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" podUID="1649340a-df74-4df3-b703-2eb2cdf86981" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 10:18:08.674551 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:08.674523 2577 patch_prober.go:28] interesting pod/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 10:18:08.674939 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:08.674593 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" podUID="1649340a-df74-4df3-b703-2eb2cdf86981" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 10:18:08.724953 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:08.724922 2577 generic.go:356] "Generic (PLEG): container finished" podID="6920853b-b282-4347-b371-c257980ce18e" containerID="956a9a9d3508be411230b2880853da705ebad45ac648c0b2648461e5b515dd2d" exitCode=0 Jul 20 10:18:08.725132 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:08.724997 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" event={"ID":"6920853b-b282-4347-b371-c257980ce18e","Type":"ContainerDied","Data":"956a9a9d3508be411230b2880853da705ebad45ac648c0b2648461e5b515dd2d"} Jul 20 10:18:08.725467 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:08.725449 2577 scope.go:117] "RemoveContainer" containerID="956a9a9d3508be411230b2880853da705ebad45ac648c0b2648461e5b515dd2d" Jul 20 10:18:08.726524 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:08.726495 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:18:08.726585 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:08.726564 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:18:08.726628 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:08.726597 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 10:18:09.678610 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:09.678576 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:18:09.679042 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:09.678903 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:18:09.679498 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:09.679480 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:18:09.736685 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:09.736643 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" event={"ID":"6920853b-b282-4347-b371-c257980ce18e","Type":"ContainerStarted","Data":"bbb1df5df0972022ade27a2cde27663fc3ee049e38d28cf0699249d2d641ae46"} Jul 20 10:18:10.052972 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:10.052869 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:18:10.053392 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:10.053359 2577 patch_prober.go:28] interesting pod/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 10:18:10.053617 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:10.053591 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" podUID="6920853b-b282-4347-b371-c257980ce18e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 10:18:11.052181 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:11.052133 2577 patch_prober.go:28] interesting pod/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 10:18:11.052724 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:11.052207 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" podUID="6920853b-b282-4347-b371-c257980ce18e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 10:18:11.649658 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:11.649613 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:18:12.052334 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:12.051794 2577 patch_prober.go:28] interesting pod/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 10:18:12.052334 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:12.051884 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" podUID="6920853b-b282-4347-b371-c257980ce18e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 10:18:13.051817 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:13.051767 2577 patch_prober.go:28] interesting pod/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 10:18:13.052151 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:13.051881 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" podUID="6920853b-b282-4347-b371-c257980ce18e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 10:18:14.055452 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:14.055421 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:18:14.056378 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:14.056362 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:18:41.177832 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:41.177803 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 10:18:41.193454 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:18:41.193422 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 10:23:41.216644 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:23:41.216564 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 10:23:41.234580 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:23:41.234556 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 10:25:40.136417 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:40.136379 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw"] Jul 20 10:25:40.136994 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:40.136654 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" podUID="1649340a-df74-4df3-b703-2eb2cdf86981" containerName="istio-proxy" containerID="cri-o://bdb2db8c4e8454869f3dce411d34e7c44c08b987413b5896184a95f8b305ceb3" gracePeriod=30 Jul 20 10:25:45.391615 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.391588 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:25:45.479476 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.479381 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-credential-socket\") pod \"1649340a-df74-4df3-b703-2eb2cdf86981\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " Jul 20 10:25:45.479476 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.479437 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-istio-envoy\") pod \"1649340a-df74-4df3-b703-2eb2cdf86981\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " Jul 20 10:25:45.479476 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.479470 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1649340a-df74-4df3-b703-2eb2cdf86981-istio-podinfo\") pod \"1649340a-df74-4df3-b703-2eb2cdf86981\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " Jul 20 10:25:45.479739 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.479512 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-754kx\" (UniqueName: \"kubernetes.io/projected/1649340a-df74-4df3-b703-2eb2cdf86981-kube-api-access-754kx\") pod \"1649340a-df74-4df3-b703-2eb2cdf86981\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " Jul 20 10:25:45.479739 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.479535 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-workload-certs\") pod \"1649340a-df74-4df3-b703-2eb2cdf86981\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " Jul 20 10:25:45.479739 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.479565 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1649340a-df74-4df3-b703-2eb2cdf86981-istio-token\") pod \"1649340a-df74-4df3-b703-2eb2cdf86981\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " Jul 20 10:25:45.479739 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.479610 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1649340a-df74-4df3-b703-2eb2cdf86981-istiod-ca-cert\") pod \"1649340a-df74-4df3-b703-2eb2cdf86981\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " Jul 20 10:25:45.479739 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.479659 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-istio-data\") pod \"1649340a-df74-4df3-b703-2eb2cdf86981\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " Jul 20 10:25:45.479739 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.479729 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-workload-socket\") pod \"1649340a-df74-4df3-b703-2eb2cdf86981\" (UID: \"1649340a-df74-4df3-b703-2eb2cdf86981\") " Jul 20 10:25:45.480087 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.479746 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1649340a-df74-4df3-b703-2eb2cdf86981" (UID: "1649340a-df74-4df3-b703-2eb2cdf86981"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:25:45.480087 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.480063 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-credential-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:25:45.480202 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.480075 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1649340a-df74-4df3-b703-2eb2cdf86981" (UID: "1649340a-df74-4df3-b703-2eb2cdf86981"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:25:45.480202 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.480120 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1649340a-df74-4df3-b703-2eb2cdf86981-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1649340a-df74-4df3-b703-2eb2cdf86981" (UID: "1649340a-df74-4df3-b703-2eb2cdf86981"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:25:45.480316 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.480256 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1649340a-df74-4df3-b703-2eb2cdf86981" (UID: "1649340a-df74-4df3-b703-2eb2cdf86981"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:25:45.480617 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.480596 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-istio-data" (OuterVolumeSpecName: "istio-data") pod "1649340a-df74-4df3-b703-2eb2cdf86981" (UID: "1649340a-df74-4df3-b703-2eb2cdf86981"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:25:45.481828 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.481802 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1649340a-df74-4df3-b703-2eb2cdf86981-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1649340a-df74-4df3-b703-2eb2cdf86981" (UID: "1649340a-df74-4df3-b703-2eb2cdf86981"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 10:25:45.481961 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.481937 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1649340a-df74-4df3-b703-2eb2cdf86981-istio-token" (OuterVolumeSpecName: "istio-token") pod "1649340a-df74-4df3-b703-2eb2cdf86981" (UID: "1649340a-df74-4df3-b703-2eb2cdf86981"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:25:45.482246 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.482228 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1649340a-df74-4df3-b703-2eb2cdf86981-kube-api-access-754kx" (OuterVolumeSpecName: "kube-api-access-754kx") pod "1649340a-df74-4df3-b703-2eb2cdf86981" (UID: "1649340a-df74-4df3-b703-2eb2cdf86981"). InnerVolumeSpecName "kube-api-access-754kx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:25:45.482246 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.482233 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1649340a-df74-4df3-b703-2eb2cdf86981" (UID: "1649340a-df74-4df3-b703-2eb2cdf86981"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:25:45.580830 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.580791 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1649340a-df74-4df3-b703-2eb2cdf86981-istio-token\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:25:45.580830 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.580823 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1649340a-df74-4df3-b703-2eb2cdf86981-istiod-ca-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:25:45.580830 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.580835 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-istio-data\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:25:45.581098 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.580872 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-workload-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:25:45.581098 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.580884 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-istio-envoy\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:25:45.581098 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.580897 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1649340a-df74-4df3-b703-2eb2cdf86981-istio-podinfo\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:25:45.581098 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.580908 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-754kx\" (UniqueName: \"kubernetes.io/projected/1649340a-df74-4df3-b703-2eb2cdf86981-kube-api-access-754kx\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:25:45.581098 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:45.580920 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1649340a-df74-4df3-b703-2eb2cdf86981-workload-certs\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:25:46.228337 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:46.228302 2577 generic.go:356] "Generic (PLEG): container finished" podID="1649340a-df74-4df3-b703-2eb2cdf86981" containerID="bdb2db8c4e8454869f3dce411d34e7c44c08b987413b5896184a95f8b305ceb3" exitCode=0 Jul 20 10:25:46.228524 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:46.228350 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" Jul 20 10:25:46.228524 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:46.228383 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" event={"ID":"1649340a-df74-4df3-b703-2eb2cdf86981","Type":"ContainerDied","Data":"bdb2db8c4e8454869f3dce411d34e7c44c08b987413b5896184a95f8b305ceb3"} Jul 20 10:25:46.228524 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:46.228443 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw" event={"ID":"1649340a-df74-4df3-b703-2eb2cdf86981","Type":"ContainerDied","Data":"b1612dbbc06f4e9fed95d6a9c24cae82b1d6fb16b3b7d79eb5beee3ae153b8de"} Jul 20 10:25:46.228524 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:46.228467 2577 scope.go:117] "RemoveContainer" containerID="bdb2db8c4e8454869f3dce411d34e7c44c08b987413b5896184a95f8b305ceb3" Jul 20 10:25:46.239132 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:46.239114 2577 scope.go:117] "RemoveContainer" containerID="de2e5b67b267d51cbbc3a13da8c3d08b386559f3347a216f101c138c0ca691a7" Jul 20 10:25:46.247351 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:46.247331 2577 scope.go:117] "RemoveContainer" containerID="bdb2db8c4e8454869f3dce411d34e7c44c08b987413b5896184a95f8b305ceb3" Jul 20 10:25:46.247617 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:25:46.247597 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdb2db8c4e8454869f3dce411d34e7c44c08b987413b5896184a95f8b305ceb3\": container with ID starting with bdb2db8c4e8454869f3dce411d34e7c44c08b987413b5896184a95f8b305ceb3 not found: ID does not exist" containerID="bdb2db8c4e8454869f3dce411d34e7c44c08b987413b5896184a95f8b305ceb3" Jul 20 10:25:46.247711 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:46.247631 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb2db8c4e8454869f3dce411d34e7c44c08b987413b5896184a95f8b305ceb3"} err="failed to get container status \"bdb2db8c4e8454869f3dce411d34e7c44c08b987413b5896184a95f8b305ceb3\": rpc error: code = NotFound desc = could not find container \"bdb2db8c4e8454869f3dce411d34e7c44c08b987413b5896184a95f8b305ceb3\": container with ID starting with bdb2db8c4e8454869f3dce411d34e7c44c08b987413b5896184a95f8b305ceb3 not found: ID does not exist" Jul 20 10:25:46.247711 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:46.247661 2577 scope.go:117] "RemoveContainer" containerID="de2e5b67b267d51cbbc3a13da8c3d08b386559f3347a216f101c138c0ca691a7" Jul 20 10:25:46.247949 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:25:46.247927 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de2e5b67b267d51cbbc3a13da8c3d08b386559f3347a216f101c138c0ca691a7\": container with ID starting with de2e5b67b267d51cbbc3a13da8c3d08b386559f3347a216f101c138c0ca691a7 not found: ID does not exist" containerID="de2e5b67b267d51cbbc3a13da8c3d08b386559f3347a216f101c138c0ca691a7" Jul 20 10:25:46.248000 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:46.247956 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2e5b67b267d51cbbc3a13da8c3d08b386559f3347a216f101c138c0ca691a7"} err="failed to get container status \"de2e5b67b267d51cbbc3a13da8c3d08b386559f3347a216f101c138c0ca691a7\": rpc error: code = NotFound desc = could not find container \"de2e5b67b267d51cbbc3a13da8c3d08b386559f3347a216f101c138c0ca691a7\": container with ID starting with de2e5b67b267d51cbbc3a13da8c3d08b386559f3347a216f101c138c0ca691a7 not found: ID does not exist" Jul 20 10:25:46.253730 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:46.253694 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw"] Jul 20 10:25:46.266431 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:46.266397 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-b7ed4c-openshift-default-564675849f-h2kdw"] Jul 20 10:25:47.024869 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:25:47.024810 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1649340a-df74-4df3-b703-2eb2cdf86981" path="/var/lib/kubelet/pods/1649340a-df74-4df3-b703-2eb2cdf86981/volumes" Jul 20 10:26:02.262049 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:02.262000 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs"] Jul 20 10:26:02.262497 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:02.262294 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" podUID="6920853b-b282-4347-b371-c257980ce18e" containerName="istio-proxy" containerID="cri-o://bbb1df5df0972022ade27a2cde27663fc3ee049e38d28cf0699249d2d641ae46" gracePeriod=30 Jul 20 10:26:07.517821 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.517793 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:26:07.691648 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.691609 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-istio-envoy\") pod \"6920853b-b282-4347-b371-c257980ce18e\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " Jul 20 10:26:07.691903 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.691674 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-workload-socket\") pod \"6920853b-b282-4347-b371-c257980ce18e\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " Jul 20 10:26:07.691903 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.691731 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-credential-socket\") pod \"6920853b-b282-4347-b371-c257980ce18e\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " Jul 20 10:26:07.691903 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.691780 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccfgg\" (UniqueName: \"kubernetes.io/projected/6920853b-b282-4347-b371-c257980ce18e-kube-api-access-ccfgg\") pod \"6920853b-b282-4347-b371-c257980ce18e\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " Jul 20 10:26:07.691903 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.691805 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6920853b-b282-4347-b371-c257980ce18e-istio-podinfo\") pod \"6920853b-b282-4347-b371-c257980ce18e\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " Jul 20 10:26:07.691903 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.691835 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-workload-certs\") pod \"6920853b-b282-4347-b371-c257980ce18e\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " Jul 20 10:26:07.692177 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.691935 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-istio-data\") pod \"6920853b-b282-4347-b371-c257980ce18e\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " Jul 20 10:26:07.692177 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.691963 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6920853b-b282-4347-b371-c257980ce18e-istiod-ca-cert\") pod \"6920853b-b282-4347-b371-c257980ce18e\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " Jul 20 10:26:07.692177 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.691991 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6920853b-b282-4347-b371-c257980ce18e-istio-token\") pod \"6920853b-b282-4347-b371-c257980ce18e\" (UID: \"6920853b-b282-4347-b371-c257980ce18e\") " Jul 20 10:26:07.692177 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.692034 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6920853b-b282-4347-b371-c257980ce18e" (UID: "6920853b-b282-4347-b371-c257980ce18e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:26:07.692366 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.692323 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-workload-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:26:07.692485 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.692384 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6920853b-b282-4347-b371-c257980ce18e" (UID: "6920853b-b282-4347-b371-c257980ce18e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:26:07.692485 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.692415 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6920853b-b282-4347-b371-c257980ce18e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6920853b-b282-4347-b371-c257980ce18e" (UID: "6920853b-b282-4347-b371-c257980ce18e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:26:07.692597 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.692517 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6920853b-b282-4347-b371-c257980ce18e" (UID: "6920853b-b282-4347-b371-c257980ce18e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:26:07.692999 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.692966 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-istio-data" (OuterVolumeSpecName: "istio-data") pod "6920853b-b282-4347-b371-c257980ce18e" (UID: "6920853b-b282-4347-b371-c257980ce18e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:26:07.694090 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.694064 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6920853b-b282-4347-b371-c257980ce18e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6920853b-b282-4347-b371-c257980ce18e" (UID: "6920853b-b282-4347-b371-c257980ce18e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 10:26:07.694261 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.694240 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6920853b-b282-4347-b371-c257980ce18e-istio-token" (OuterVolumeSpecName: "istio-token") pod "6920853b-b282-4347-b371-c257980ce18e" (UID: "6920853b-b282-4347-b371-c257980ce18e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:26:07.694381 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.694355 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6920853b-b282-4347-b371-c257980ce18e-kube-api-access-ccfgg" (OuterVolumeSpecName: "kube-api-access-ccfgg") pod "6920853b-b282-4347-b371-c257980ce18e" (UID: "6920853b-b282-4347-b371-c257980ce18e"). InnerVolumeSpecName "kube-api-access-ccfgg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:26:07.694381 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.694366 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6920853b-b282-4347-b371-c257980ce18e" (UID: "6920853b-b282-4347-b371-c257980ce18e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:26:07.793684 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.793650 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-istio-data\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:26:07.793684 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.793679 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6920853b-b282-4347-b371-c257980ce18e-istiod-ca-cert\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:26:07.793684 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.793689 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6920853b-b282-4347-b371-c257980ce18e-istio-token\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:26:07.793684 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.793696 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-istio-envoy\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:26:07.793991 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.793704 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-credential-socket\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:26:07.793991 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.793713 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccfgg\" (UniqueName: \"kubernetes.io/projected/6920853b-b282-4347-b371-c257980ce18e-kube-api-access-ccfgg\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:26:07.793991 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.793721 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6920853b-b282-4347-b371-c257980ce18e-istio-podinfo\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:26:07.793991 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:07.793729 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6920853b-b282-4347-b371-c257980ce18e-workload-certs\") on node \"ip-10-0-142-133.ec2.internal\" DevicePath \"\"" Jul 20 10:26:08.349994 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:08.349959 2577 generic.go:356] "Generic (PLEG): container finished" podID="6920853b-b282-4347-b371-c257980ce18e" containerID="bbb1df5df0972022ade27a2cde27663fc3ee049e38d28cf0699249d2d641ae46" exitCode=0 Jul 20 10:26:08.350173 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:08.350006 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" Jul 20 10:26:08.350173 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:08.350037 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" event={"ID":"6920853b-b282-4347-b371-c257980ce18e","Type":"ContainerDied","Data":"bbb1df5df0972022ade27a2cde27663fc3ee049e38d28cf0699249d2d641ae46"} Jul 20 10:26:08.350173 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:08.350090 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs" event={"ID":"6920853b-b282-4347-b371-c257980ce18e","Type":"ContainerDied","Data":"355860b5aee3f38837fb292029fac5ef99b151a53392b8675eb4170545135d95"} Jul 20 10:26:08.350173 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:08.350112 2577 scope.go:117] "RemoveContainer" containerID="bbb1df5df0972022ade27a2cde27663fc3ee049e38d28cf0699249d2d641ae46" Jul 20 10:26:08.360244 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:08.360224 2577 scope.go:117] "RemoveContainer" containerID="956a9a9d3508be411230b2880853da705ebad45ac648c0b2648461e5b515dd2d" Jul 20 10:26:08.368701 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:08.368680 2577 scope.go:117] "RemoveContainer" containerID="bbb1df5df0972022ade27a2cde27663fc3ee049e38d28cf0699249d2d641ae46" Jul 20 10:26:08.369029 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:26:08.369007 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbb1df5df0972022ade27a2cde27663fc3ee049e38d28cf0699249d2d641ae46\": container with ID starting with bbb1df5df0972022ade27a2cde27663fc3ee049e38d28cf0699249d2d641ae46 not found: ID does not exist" containerID="bbb1df5df0972022ade27a2cde27663fc3ee049e38d28cf0699249d2d641ae46" Jul 20 10:26:08.369154 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:08.369042 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbb1df5df0972022ade27a2cde27663fc3ee049e38d28cf0699249d2d641ae46"} err="failed to get container status \"bbb1df5df0972022ade27a2cde27663fc3ee049e38d28cf0699249d2d641ae46\": rpc error: code = NotFound desc = could not find container \"bbb1df5df0972022ade27a2cde27663fc3ee049e38d28cf0699249d2d641ae46\": container with ID starting with bbb1df5df0972022ade27a2cde27663fc3ee049e38d28cf0699249d2d641ae46 not found: ID does not exist" Jul 20 10:26:08.369154 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:08.369067 2577 scope.go:117] "RemoveContainer" containerID="956a9a9d3508be411230b2880853da705ebad45ac648c0b2648461e5b515dd2d" Jul 20 10:26:08.369396 ip-10-0-142-133 kubenswrapper[2577]: E0720 10:26:08.369326 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"956a9a9d3508be411230b2880853da705ebad45ac648c0b2648461e5b515dd2d\": container with ID starting with 956a9a9d3508be411230b2880853da705ebad45ac648c0b2648461e5b515dd2d not found: ID does not exist" containerID="956a9a9d3508be411230b2880853da705ebad45ac648c0b2648461e5b515dd2d" Jul 20 10:26:08.369507 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:08.369413 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"956a9a9d3508be411230b2880853da705ebad45ac648c0b2648461e5b515dd2d"} err="failed to get container status \"956a9a9d3508be411230b2880853da705ebad45ac648c0b2648461e5b515dd2d\": rpc error: code = NotFound desc = could not find container \"956a9a9d3508be411230b2880853da705ebad45ac648c0b2648461e5b515dd2d\": container with ID starting with 956a9a9d3508be411230b2880853da705ebad45ac648c0b2648461e5b515dd2d not found: ID does not exist" Jul 20 10:26:08.372683 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:08.372654 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs"] Jul 20 10:26:08.377063 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:08.377039 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-186a7e-openshift-default-5cdd9dcd79-r75rs"] Jul 20 10:26:09.024569 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:09.024534 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6920853b-b282-4347-b371-c257980ce18e" path="/var/lib/kubelet/pods/6920853b-b282-4347-b371-c257980ce18e/volumes" Jul 20 10:26:10.713206 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:10.713178 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj_1b34fe17-e9b2-452f-aa2f-bdcfe968a21e/copy-manifests/0.log" Jul 20 10:26:10.721325 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:10.721295 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj_1b34fe17-e9b2-452f-aa2f-bdcfe968a21e/manager/0.log" Jul 20 10:26:12.268136 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:12.268107 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25_fa723aba-83e1-4a7a-986c-e9eff546922d/util/0.log" Jul 20 10:26:12.274526 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:12.274492 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25_fa723aba-83e1-4a7a-986c-e9eff546922d/pull/0.log" Jul 20 10:26:12.280509 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:12.280482 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25_fa723aba-83e1-4a7a-986c-e9eff546922d/extract/0.log" Jul 20 10:26:12.397149 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:12.397117 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86_03fc3694-f582-4e91-87c2-63fbc41d839f/util/0.log" Jul 20 10:26:12.403484 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:12.403457 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86_03fc3694-f582-4e91-87c2-63fbc41d839f/pull/0.log" Jul 20 10:26:12.408985 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:12.408960 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86_03fc3694-f582-4e91-87c2-63fbc41d839f/extract/0.log" Jul 20 10:26:12.531505 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:12.531425 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8_f542e940-b3dc-447f-84c4-9593932c5dcc/util/0.log" Jul 20 10:26:12.537950 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:12.537919 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8_f542e940-b3dc-447f-84c4-9593932c5dcc/pull/0.log" Jul 20 10:26:12.544206 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:12.544175 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8_f542e940-b3dc-447f-84c4-9593932c5dcc/extract/0.log" Jul 20 10:26:12.666725 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:12.666695 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx_b160ad9c-1db8-4b3b-afcb-91697bf4c24f/util/0.log" Jul 20 10:26:12.672918 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:12.672894 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx_b160ad9c-1db8-4b3b-afcb-91697bf4c24f/pull/0.log" Jul 20 10:26:12.678488 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:12.678457 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx_b160ad9c-1db8-4b3b-afcb-91697bf4c24f/extract/0.log" Jul 20 10:26:14.068323 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:14.068290 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mpr6t_5a18c88b-396a-4e97-b010-1151901faa2b/istio-proxy/0.log" Jul 20 10:26:14.198887 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:14.198832 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tf6k4_1f08a686-fc59-4907-8208-7f3cabb5da3c/discovery/0.log" Jul 20 10:26:14.639717 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:14.639684 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vwsqj_0b3c2629-1615-41f9-9696-306a7f65ffc9/istio-proxy/1.log" Jul 20 10:26:15.063643 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:15.063615 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7548f77d8d-9v8zw_b6832d68-310b-4ceb-aed2-ed26b866970b/router/0.log" Jul 20 10:26:15.704297 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:15.704266 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rshbz_0ce460b3-6ecb-4951-9ef1-b469e28ef554/main/0.log" Jul 20 10:26:15.827238 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:15.827203 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f65d4p_56d0d28b-2ba2-4557-9625-21d8da930e97/main/0.log" Jul 20 10:26:24.547262 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:24.547229 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jqgr4_6b3179ca-a114-4b20-8411-0b3638da7500/global-pull-secret-syncer/0.log" Jul 20 10:26:24.696049 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:24.696012 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b7qq8_60837e18-5538-4452-b5f1-bf6167fd7fb3/konnectivity-agent/0.log" Jul 20 10:26:24.809971 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:24.809877 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-133.ec2.internal_537e8aec3c3624c3b67c0e0e826a6719/haproxy/0.log" Jul 20 10:26:29.418663 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:29.418631 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25_fa723aba-83e1-4a7a-986c-e9eff546922d/extract/0.log" Jul 20 10:26:29.464863 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:29.464814 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25_fa723aba-83e1-4a7a-986c-e9eff546922d/util/0.log" Jul 20 10:26:29.485336 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:29.485301 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czh25_fa723aba-83e1-4a7a-986c-e9eff546922d/pull/0.log" Jul 20 10:26:29.509659 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:29.509628 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86_03fc3694-f582-4e91-87c2-63fbc41d839f/extract/0.log" Jul 20 10:26:29.528290 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:29.528260 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86_03fc3694-f582-4e91-87c2-63fbc41d839f/util/0.log" Jul 20 10:26:29.552492 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:29.552463 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06kv86_03fc3694-f582-4e91-87c2-63fbc41d839f/pull/0.log" Jul 20 10:26:29.582756 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:29.582720 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8_f542e940-b3dc-447f-84c4-9593932c5dcc/extract/0.log" Jul 20 10:26:29.599579 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:29.599548 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8_f542e940-b3dc-447f-84c4-9593932c5dcc/util/0.log" Jul 20 10:26:29.622162 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:29.622134 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73srtw8_f542e940-b3dc-447f-84c4-9593932c5dcc/pull/0.log" Jul 20 10:26:29.663663 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:29.663635 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx_b160ad9c-1db8-4b3b-afcb-91697bf4c24f/extract/0.log" Jul 20 10:26:29.685053 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:29.684971 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx_b160ad9c-1db8-4b3b-afcb-91697bf4c24f/util/0.log" Jul 20 10:26:29.706349 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:29.706315 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjzdx_b160ad9c-1db8-4b3b-afcb-91697bf4c24f/pull/0.log" Jul 20 10:26:32.752710 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:32.752676 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-7ctq2_23f8474e-2d4a-4a50-b981-d506c0607319/cluster-monitoring-operator/0.log" Jul 20 10:26:33.038618 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:33.038515 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wdjhp_8de9617a-4cff-431e-be2f-2e0446f562e8/node-exporter/0.log" Jul 20 10:26:33.056267 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:33.056234 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wdjhp_8de9617a-4cff-431e-be2f-2e0446f562e8/kube-rbac-proxy/0.log" Jul 20 10:26:33.074230 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:33.074203 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wdjhp_8de9617a-4cff-431e-be2f-2e0446f562e8/init-textfile/0.log" Jul 20 10:26:33.485684 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:33.485602 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-7sj99_af578b8b-b8b2-49fe-8703-e7ecd6b81d7a/prometheus-operator-admission-webhook/0.log" Jul 20 10:26:34.915520 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:34.915488 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-4tp8b_647a9d32-b9cd-44d3-b8ae-727d42d6b2a7/networking-console-plugin/0.log" Jul 20 10:26:35.430785 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:35.430753 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/1.log" Jul 20 10:26:35.440276 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:35.440249 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-d9hzk_4454b868-0082-422b-98d7-9973c0fc725a/console-operator/2.log" Jul 20 10:26:35.869725 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:35.869700 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65945f4c8-27dfr_78da6324-da08-4966-a019-6ca1aaf6aacf/console/0.log" Jul 20 10:26:35.909697 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:35.909661 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-nwpjn_2e089a0e-7a4d-4dc9-8d02-15e85cec5b62/download-server/0.log" Jul 20 10:26:36.461398 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.461361 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-kkz9d_61c86824-41e2-4d04-87c5-b07bfeb653d2/volume-data-source-validator/0.log" Jul 20 10:26:36.530526 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.530491 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c"] Jul 20 10:26:36.530860 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.530832 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1649340a-df74-4df3-b703-2eb2cdf86981" containerName="istio-proxy" Jul 20 10:26:36.530860 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.530861 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1649340a-df74-4df3-b703-2eb2cdf86981" containerName="istio-proxy" Jul 20 10:26:36.530946 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.530877 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6920853b-b282-4347-b371-c257980ce18e" containerName="istio-proxy" Jul 20 10:26:36.530946 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.530883 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6920853b-b282-4347-b371-c257980ce18e" containerName="istio-proxy" Jul 20 10:26:36.530946 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.530890 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6920853b-b282-4347-b371-c257980ce18e" containerName="istio-proxy" Jul 20 10:26:36.530946 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.530898 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6920853b-b282-4347-b371-c257980ce18e" containerName="istio-proxy" Jul 20 10:26:36.530946 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.530905 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1649340a-df74-4df3-b703-2eb2cdf86981" containerName="istio-proxy" Jul 20 10:26:36.530946 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.530911 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1649340a-df74-4df3-b703-2eb2cdf86981" containerName="istio-proxy" Jul 20 10:26:36.531141 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.530978 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1649340a-df74-4df3-b703-2eb2cdf86981" containerName="istio-proxy" Jul 20 10:26:36.531141 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.530985 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1649340a-df74-4df3-b703-2eb2cdf86981" containerName="istio-proxy" Jul 20 10:26:36.531141 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.530991 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6920853b-b282-4347-b371-c257980ce18e" containerName="istio-proxy" Jul 20 10:26:36.531141 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.530999 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c433992a-72aa-4123-8eb2-f0505513aee1" containerName="istio-proxy" Jul 20 10:26:36.531141 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.531005 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6920853b-b282-4347-b371-c257980ce18e" containerName="istio-proxy" Jul 20 10:26:36.534003 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.533986 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.535961 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.535934 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6zgv\"/\"openshift-service-ca.crt\"" Jul 20 10:26:36.536581 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.536568 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t6zgv\"/\"default-dockercfg-5qqbj\"" Jul 20 10:26:36.536632 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.536601 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6zgv\"/\"kube-root-ca.crt\"" Jul 20 10:26:36.542880 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.542833 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c"] Jul 20 10:26:36.654433 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.654391 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0f3abed1-6539-4cc3-81b1-2425755c41f9-proc\") pod \"perf-node-gather-daemonset-pmp9c\" (UID: \"0f3abed1-6539-4cc3-81b1-2425755c41f9\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.654617 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.654456 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f3abed1-6539-4cc3-81b1-2425755c41f9-lib-modules\") pod \"perf-node-gather-daemonset-pmp9c\" (UID: \"0f3abed1-6539-4cc3-81b1-2425755c41f9\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.654617 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.654499 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f3abed1-6539-4cc3-81b1-2425755c41f9-sys\") pod \"perf-node-gather-daemonset-pmp9c\" (UID: \"0f3abed1-6539-4cc3-81b1-2425755c41f9\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.654617 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.654519 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0f3abed1-6539-4cc3-81b1-2425755c41f9-podres\") pod \"perf-node-gather-daemonset-pmp9c\" (UID: \"0f3abed1-6539-4cc3-81b1-2425755c41f9\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.654728 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.654610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hrch\" (UniqueName: \"kubernetes.io/projected/0f3abed1-6539-4cc3-81b1-2425755c41f9-kube-api-access-8hrch\") pod \"perf-node-gather-daemonset-pmp9c\" (UID: \"0f3abed1-6539-4cc3-81b1-2425755c41f9\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.755992 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.755903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f3abed1-6539-4cc3-81b1-2425755c41f9-lib-modules\") pod \"perf-node-gather-daemonset-pmp9c\" (UID: \"0f3abed1-6539-4cc3-81b1-2425755c41f9\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.755992 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.755950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f3abed1-6539-4cc3-81b1-2425755c41f9-sys\") pod \"perf-node-gather-daemonset-pmp9c\" (UID: \"0f3abed1-6539-4cc3-81b1-2425755c41f9\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.755992 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.755972 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0f3abed1-6539-4cc3-81b1-2425755c41f9-podres\") pod \"perf-node-gather-daemonset-pmp9c\" (UID: \"0f3abed1-6539-4cc3-81b1-2425755c41f9\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.756221 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.756040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hrch\" (UniqueName: \"kubernetes.io/projected/0f3abed1-6539-4cc3-81b1-2425755c41f9-kube-api-access-8hrch\") pod \"perf-node-gather-daemonset-pmp9c\" (UID: \"0f3abed1-6539-4cc3-81b1-2425755c41f9\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.756221 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.756061 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f3abed1-6539-4cc3-81b1-2425755c41f9-lib-modules\") pod \"perf-node-gather-daemonset-pmp9c\" (UID: \"0f3abed1-6539-4cc3-81b1-2425755c41f9\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.756221 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.756082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0f3abed1-6539-4cc3-81b1-2425755c41f9-proc\") pod \"perf-node-gather-daemonset-pmp9c\" (UID: \"0f3abed1-6539-4cc3-81b1-2425755c41f9\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.756221 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.756071 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f3abed1-6539-4cc3-81b1-2425755c41f9-sys\") pod \"perf-node-gather-daemonset-pmp9c\" (UID: \"0f3abed1-6539-4cc3-81b1-2425755c41f9\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.756221 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.756157 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0f3abed1-6539-4cc3-81b1-2425755c41f9-proc\") pod \"perf-node-gather-daemonset-pmp9c\" (UID: \"0f3abed1-6539-4cc3-81b1-2425755c41f9\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.756221 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.756157 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0f3abed1-6539-4cc3-81b1-2425755c41f9-podres\") pod \"perf-node-gather-daemonset-pmp9c\" (UID: \"0f3abed1-6539-4cc3-81b1-2425755c41f9\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.763254 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.763222 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hrch\" (UniqueName: \"kubernetes.io/projected/0f3abed1-6539-4cc3-81b1-2425755c41f9-kube-api-access-8hrch\") pod \"perf-node-gather-daemonset-pmp9c\" (UID: \"0f3abed1-6539-4cc3-81b1-2425755c41f9\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.845263 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.845226 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:36.981554 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:36.981520 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c"] Jul 20 10:26:36.983473 ip-10-0-142-133 kubenswrapper[2577]: W0720 10:26:36.983441 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0f3abed1_6539_4cc3_81b1_2425755c41f9.slice/crio-6ce12c808e5d9d95fa85a3bfaf4ae66267dae20d0e9da5c43f7e26b4b763bc99 WatchSource:0}: Error finding container 6ce12c808e5d9d95fa85a3bfaf4ae66267dae20d0e9da5c43f7e26b4b763bc99: Status 404 returned error can't find the container with id 6ce12c808e5d9d95fa85a3bfaf4ae66267dae20d0e9da5c43f7e26b4b763bc99 Jul 20 10:26:37.490407 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:37.490376 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6587d_3c55b1c9-2e18-45dc-8886-f0b24f629991/dns/0.log" Jul 20 10:26:37.508656 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:37.508608 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" event={"ID":"0f3abed1-6539-4cc3-81b1-2425755c41f9","Type":"ContainerStarted","Data":"9ac7cddb66566b99f26a820d76d7ae15f65da27b9fcdd195bbc472ed534ad0ad"} Jul 20 10:26:37.508828 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:37.508669 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" event={"ID":"0f3abed1-6539-4cc3-81b1-2425755c41f9","Type":"ContainerStarted","Data":"6ce12c808e5d9d95fa85a3bfaf4ae66267dae20d0e9da5c43f7e26b4b763bc99"} Jul 20 10:26:37.508828 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:37.508816 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:37.509058 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:37.509034 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6587d_3c55b1c9-2e18-45dc-8886-f0b24f629991/kube-rbac-proxy/0.log" Jul 20 10:26:37.524157 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:37.524108 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" podStartSLOduration=1.52409079 podStartE2EDuration="1.52409079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 10:26:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:26:37.522089434 +0000 UTC m=+2876.996190464" watchObservedRunningTime="2026-07-20 10:26:37.52409079 +0000 UTC m=+2876.998191874" Jul 20 10:26:37.627743 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:37.627710 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ctds5_cfe9d359-ec2b-4b35-95d3-185fcdc3c5ed/dns-node-resolver/0.log" Jul 20 10:26:38.276627 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:38.276595 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nsxxs_208beea5-1d93-485f-9171-6e37de3aa513/node-ca/0.log" Jul 20 10:26:39.127363 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:39.127327 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mpr6t_5a18c88b-396a-4e97-b010-1151901faa2b/istio-proxy/0.log" Jul 20 10:26:39.353418 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:39.353383 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tf6k4_1f08a686-fc59-4907-8208-7f3cabb5da3c/discovery/0.log" Jul 20 10:26:39.426296 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:39.426179 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vwsqj_0b3c2629-1615-41f9-9696-306a7f65ffc9/istio-proxy/0.log" Jul 20 10:26:39.477561 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:39.477526 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vwsqj_0b3c2629-1615-41f9-9696-306a7f65ffc9/istio-proxy/1.log" Jul 20 10:26:39.577251 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:39.577221 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7548f77d8d-9v8zw_b6832d68-310b-4ceb-aed2-ed26b866970b/router/0.log" Jul 20 10:26:40.223202 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:40.223173 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-72mbq_a3bb3b46-397c-4531-b7eb-9c8980f07224/serve-healthcheck-canary/0.log" Jul 20 10:26:40.711289 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:40.711241 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-gckq6_94e41dbb-04af-4580-a433-b828787892e7/insights-operator/0.log" Jul 20 10:26:40.712410 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:40.712383 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-gckq6_94e41dbb-04af-4580-a433-b828787892e7/insights-operator/1.log" Jul 20 10:26:40.869334 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:40.869295 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbbxd_9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad/kube-rbac-proxy/0.log" Jul 20 10:26:40.890614 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:40.890577 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbbxd_9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad/exporter/0.log" Jul 20 10:26:40.910998 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:40.910970 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbbxd_9e75a4f6-c13c-4b17-944e-a2a4eb60d7ad/extractor/0.log" Jul 20 10:26:43.529226 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:43.529198 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-pmp9c" Jul 20 10:26:44.072295 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:44.072262 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mpr6t_5a18c88b-396a-4e97-b010-1151901faa2b/istio-proxy/0.log" Jul 20 10:26:44.092868 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:44.092818 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj_1b34fe17-e9b2-452f-aa2f-bdcfe968a21e/manager/0.log" Jul 20 10:26:44.112508 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:44.112480 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc4dbfcf4-qxdlj_1b34fe17-e9b2-452f-aa2f-bdcfe968a21e/copy-manifests/0.log" Jul 20 10:26:44.292319 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:44.292281 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tf6k4_1f08a686-fc59-4907-8208-7f3cabb5da3c/discovery/0.log" Jul 20 10:26:44.334904 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:44.334773 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vwsqj_0b3c2629-1615-41f9-9696-306a7f65ffc9/istio-proxy/0.log" Jul 20 10:26:44.386383 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:44.386353 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vwsqj_0b3c2629-1615-41f9-9696-306a7f65ffc9/istio-proxy/1.log" Jul 20 10:26:44.460150 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:44.460114 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7548f77d8d-9v8zw_b6832d68-310b-4ceb-aed2-ed26b866970b/router/0.log" Jul 20 10:26:45.386884 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:45.386783 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d9fcc6574-7wmjd_63beeb79-553a-473b-82ad-6a7f62b2b65a/manager/0.log" Jul 20 10:26:45.439287 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:45.439248 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-z5jnq_2b2d75ae-a8ab-4770-9532-69d99f19d65e/openshift-lws-operator/0.log" Jul 20 10:26:45.771677 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:45.771641 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mpr6t_5a18c88b-396a-4e97-b010-1151901faa2b/istio-proxy/0.log" Jul 20 10:26:45.993776 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:45.993669 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tf6k4_1f08a686-fc59-4907-8208-7f3cabb5da3c/discovery/0.log" Jul 20 10:26:46.046798 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:46.046771 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vwsqj_0b3c2629-1615-41f9-9696-306a7f65ffc9/istio-proxy/0.log" Jul 20 10:26:46.098714 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:46.098674 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vwsqj_0b3c2629-1615-41f9-9696-306a7f65ffc9/istio-proxy/1.log" Jul 20 10:26:46.173648 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:46.173613 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7548f77d8d-9v8zw_b6832d68-310b-4ceb-aed2-ed26b866970b/router/0.log" Jul 20 10:26:50.268061 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:50.268015 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-s7s59_ec2fb240-0271-486e-8f2b-145963a692ce/migrator/0.log" Jul 20 10:26:50.292966 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:50.292932 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-s7s59_ec2fb240-0271-486e-8f2b-145963a692ce/graceful-termination/0.log" Jul 20 10:26:50.645280 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:50.645247 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-xj4vm_c7669f8c-e50b-4df2-82ac-69ed7998a965/kube-storage-version-migrator-operator/1.log" Jul 20 10:26:50.647127 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:50.647099 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-xj4vm_c7669f8c-e50b-4df2-82ac-69ed7998a965/kube-storage-version-migrator-operator/0.log" Jul 20 10:26:51.978975 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:51.978948 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvlqv_285cd32a-2da4-4818-9d9b-5e1bf8152dba/kube-multus-additional-cni-plugins/0.log" Jul 20 10:26:52.000836 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:52.000806 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvlqv_285cd32a-2da4-4818-9d9b-5e1bf8152dba/egress-router-binary-copy/0.log" Jul 20 10:26:52.019601 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:52.019562 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvlqv_285cd32a-2da4-4818-9d9b-5e1bf8152dba/cni-plugins/0.log" Jul 20 10:26:52.039379 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:52.039354 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvlqv_285cd32a-2da4-4818-9d9b-5e1bf8152dba/bond-cni-plugin/0.log" Jul 20 10:26:52.058227 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:52.058195 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvlqv_285cd32a-2da4-4818-9d9b-5e1bf8152dba/routeoverride-cni/0.log" Jul 20 10:26:52.077301 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:52.077274 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvlqv_285cd32a-2da4-4818-9d9b-5e1bf8152dba/whereabouts-cni-bincopy/0.log" Jul 20 10:26:52.095517 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:52.095492 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvlqv_285cd32a-2da4-4818-9d9b-5e1bf8152dba/whereabouts-cni/0.log" Jul 20 10:26:52.222271 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:52.222233 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v6qzc_bb703a13-b2ef-43d5-9cb8-219136053fd0/kube-multus/0.log" Jul 20 10:26:52.243546 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:52.243462 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4fbtw_2068181e-6e30-401a-89fc-af0528dc5aea/network-metrics-daemon/0.log" Jul 20 10:26:52.259068 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:52.259028 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4fbtw_2068181e-6e30-401a-89fc-af0528dc5aea/kube-rbac-proxy/0.log" Jul 20 10:26:53.129641 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:53.129611 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bvnv_c01153a9-d6d2-4e20-bc3a-fbe18daef4c2/ovn-controller/0.log" Jul 20 10:26:53.145109 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:53.145081 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bvnv_c01153a9-d6d2-4e20-bc3a-fbe18daef4c2/ovn-acl-logging/0.log" Jul 20 10:26:53.167626 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:53.167597 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bvnv_c01153a9-d6d2-4e20-bc3a-fbe18daef4c2/kube-rbac-proxy-node/0.log" Jul 20 10:26:53.187594 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:53.187539 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bvnv_c01153a9-d6d2-4e20-bc3a-fbe18daef4c2/kube-rbac-proxy-ovn-metrics/0.log" Jul 20 10:26:53.203393 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:53.203363 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bvnv_c01153a9-d6d2-4e20-bc3a-fbe18daef4c2/northd/0.log" Jul 20 10:26:53.225021 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:53.224993 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bvnv_c01153a9-d6d2-4e20-bc3a-fbe18daef4c2/nbdb/0.log" Jul 20 10:26:53.245522 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:53.245495 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bvnv_c01153a9-d6d2-4e20-bc3a-fbe18daef4c2/sbdb/0.log" Jul 20 10:26:53.335293 ip-10-0-142-133 kubenswrapper[2577]: I0720 10:26:53.335260 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bvnv_c01153a9-d6d2-4e20-bc3a-fbe18daef4c2/ovnkube-controller/0.log"