Jul 21 01:21:58.846923 ip-10-0-132-244 systemd[1]: Starting Kubernetes Kubelet... Jul 21 01:21:59.253319 ip-10-0-132-244 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 01:21:59.253319 ip-10-0-132-244 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 01:21:59.253319 ip-10-0-132-244 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 01:21:59.253319 ip-10-0-132-244 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 01:21:59.253319 ip-10-0-132-244 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 01:21:59.256209 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.256115 2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 01:21:59.264053 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264021 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 01:21:59.264053 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264045 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 01:21:59.264053 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264049 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 01:21:59.264053 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264054 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 01:21:59.264053 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264057 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 01:21:59.264053 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264060 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 01:21:59.264053 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264063 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264067 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264070 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264073 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264076 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264078 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264081 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264083 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264086 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264088 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264091 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264094 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264096 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264099 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264101 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264104 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264107 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264109 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264115 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264118 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 01:21:59.264322 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264120 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264124 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264128 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264131 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264134 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264137 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264139 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264142 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264146 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264150 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264152 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264155 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264158 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264161 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264164 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264167 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264170 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264173 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264176 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 01:21:59.264825 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264178 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264181 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264184 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264187 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264189 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264201 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264204 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264207 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264210 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264212 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264215 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264217 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264220 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264222 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264225 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264227 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264230 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264232 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264235 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264237 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 01:21:59.265336 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264242 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264245 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264247 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264250 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264252 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264255 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264257 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264260 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264263 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264265 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264268 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264271 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264273 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264276 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264278 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264281 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264283 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264286 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264289 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 01:21:59.265834 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264291 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264295 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264298 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264301 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264304 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264306 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264309 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264311 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264313 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264316 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264318 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264322 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264325 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264327 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.264330 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265068 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265077 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265081 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265084 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 01:21:59.266282 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265087 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265090 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265093 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265096 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265099 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265102 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265104 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265107 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265109 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265112 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265114 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265117 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265119 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265123 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265125 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265128 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265130 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265133 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265136 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 01:21:59.266750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265138 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265141 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265143 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265146 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265148 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265151 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265154 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265156 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265159 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265161 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265163 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265166 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265168 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265171 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265174 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265177 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265180 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265183 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265186 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265188 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 01:21:59.267319 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265190 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265193 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265196 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265199 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265201 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265204 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265206 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265209 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265211 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265214 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265217 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265219 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265222 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265224 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265226 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265229 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265231 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265234 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265236 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265239 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 01:21:59.267881 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265241 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265243 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265247 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265250 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265253 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265256 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265260 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265262 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265266 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265268 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265272 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265275 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265278 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265281 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265283 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265287 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265290 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265292 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265294 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 01:21:59.268365 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265297 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265300 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265302 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265305 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265308 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265310 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265313 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265315 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265318 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265320 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265323 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265325 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265327 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265330 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265333 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265335 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265338 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265727 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265732 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265736 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 01:21:59.268848 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265740 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265742 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265745 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265750 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265754 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265758 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265761 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265763 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265766 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265769 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265771 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265774 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265777 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265780 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265783 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265785 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265788 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265790 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265792 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 01:21:59.269346 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265795 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265798 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265801 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265803 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265806 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265809 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265811 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265814 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265816 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265819 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265821 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265825 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265831 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265834 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265837 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265839 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265842 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265845 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265849 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 01:21:59.269818 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265852 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265855 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265858 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265861 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265864 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265867 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265869 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265871 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265878 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265881 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265883 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265886 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265888 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265890 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265893 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265895 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265898 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265900 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265903 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265905 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 01:21:59.270278 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265908 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265910 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265913 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265915 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265918 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265922 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265925 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265927 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265931 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265933 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265936 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265938 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265941 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265943 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265946 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265948 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265951 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265953 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265955 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265958 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 01:21:59.270772 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265960 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265963 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265966 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265968 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265971 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265973 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265976 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265978 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265980 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265983 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265986 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265988 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265990 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265993 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265995 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.265997 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266000 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266004 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266076 2553 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266083 2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266089 2553 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 01:21:59.271243 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266094 2553 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266098 2553 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266101 2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266105 2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266114 2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266117 2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266120 2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266123 2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266127 2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266130 2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266132 2553 flags.go:64] FLAG: --cgroup-root="" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266135 2553 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266138 2553 flags.go:64] FLAG: --client-ca-file="" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266141 2553 flags.go:64] FLAG: --cloud-provider="external" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266144 2553 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266149 2553 flags.go:64] FLAG: --cluster-domain="" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266152 2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266155 2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266158 2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266163 2553 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266167 2553 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266170 2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266173 2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 01:21:59.271768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266176 2553 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266179 2553 flags.go:64] FLAG: --contention-profiling="false" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266182 2553 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266184 2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266188 2553 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266191 2553 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266196 2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266199 2553 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266202 2553 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266205 2553 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266207 2553 flags.go:64] FLAG: --enable-server="true" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266210 2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266214 2553 flags.go:64] FLAG: --event-burst="100" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266217 2553 flags.go:64] FLAG: --event-qps="50" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266220 2553 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266222 2553 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266226 2553 flags.go:64] FLAG: --eviction-hard="" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266229 2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266232 2553 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266235 2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266238 2553 flags.go:64] FLAG: --eviction-soft="" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266241 2553 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266244 2553 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266247 2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266250 2553 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 01:21:59.272331 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266253 2553 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266256 2553 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266258 2553 flags.go:64] FLAG: --feature-gates="" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266263 2553 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266266 2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266269 2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266272 2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266275 2553 flags.go:64] FLAG: --healthz-port="10248" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266277 2553 flags.go:64] FLAG: --help="false" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266280 2553 flags.go:64] FLAG: --hostname-override="ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266283 2553 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266286 2553 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266290 2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266293 2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266297 2553 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266300 2553 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266303 2553 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266305 2553 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266308 2553 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266311 2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266314 2553 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266317 2553 flags.go:64] FLAG: --kube-reserved="" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266320 2553 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266322 2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 01:21:59.273078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266325 2553 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266328 2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266330 2553 flags.go:64] FLAG: --lock-file="" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266333 2553 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266336 2553 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266339 2553 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266344 2553 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266347 2553 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266350 2553 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266353 2553 flags.go:64] FLAG: --logging-format="text" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266355 2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266360 2553 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266362 2553 flags.go:64] FLAG: --manifest-url="" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266365 2553 flags.go:64] FLAG: --manifest-url-header="" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266370 2553 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266372 2553 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266377 2553 flags.go:64] FLAG: --max-pods="110" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266379 2553 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266382 2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266385 2553 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266388 2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266391 2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266394 2553 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266397 2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266404 2553 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 01:21:59.273724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266407 2553 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266410 2553 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266413 2553 flags.go:64] FLAG: --pod-cidr="" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266416 2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266421 2553 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266424 2553 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266426 2553 flags.go:64] FLAG: --pods-per-core="0" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266429 2553 flags.go:64] FLAG: --port="10250" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266432 2553 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266435 2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00716c45d8ec3fac1" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266438 2553 flags.go:64] FLAG: --qos-reserved="" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266441 2553 flags.go:64] FLAG: --read-only-port="10255" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266444 2553 flags.go:64] FLAG: --register-node="true" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266446 2553 flags.go:64] FLAG: --register-with-taints="" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266450 2553 flags.go:64] FLAG: --registry-burst="10" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266454 2553 flags.go:64] FLAG: --registry-qps="5" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266457 2553 flags.go:64] FLAG: --reserved-cpus="" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266459 2553 flags.go:64] FLAG: --reserved-memory="" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266463 2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266468 2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266471 2553 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266474 2553 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266477 2553 flags.go:64] FLAG: --runonce="false" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266479 2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266482 2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 01:21:59.274327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266485 2553 flags.go:64] FLAG: --seccomp-default="false" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266489 2553 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266491 2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266494 2553 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266497 2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266500 2553 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266502 2553 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266505 2553 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266508 2553 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266511 2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266514 2553 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266516 2553 flags.go:64] FLAG: --system-cgroups="" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266519 2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266524 2553 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266526 2553 flags.go:64] FLAG: --tls-cert-file="" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266529 2553 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266533 2553 flags.go:64] FLAG: --tls-min-version="" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266536 2553 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266539 2553 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266542 2553 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266544 2553 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266547 2553 flags.go:64] FLAG: --v="2" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266551 2553 flags.go:64] FLAG: --version="false" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266555 2553 flags.go:64] FLAG: --vmodule="" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266559 2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 01:21:59.274935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266562 2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266695 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266700 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266703 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266705 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266708 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266710 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266713 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266716 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266720 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266723 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266726 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266729 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266733 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266737 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266741 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266744 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266747 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266749 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 01:21:59.275535 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266752 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266755 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266757 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266760 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266762 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266765 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266767 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266770 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266772 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266775 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266777 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266780 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266786 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266788 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266793 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266795 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266797 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266800 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266802 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266805 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 01:21:59.276022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266807 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266810 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266812 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266814 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266817 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266819 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266822 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266824 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266827 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266829 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266832 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266834 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266837 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266839 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266841 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266844 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266846 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266849 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266851 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 01:21:59.276514 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266853 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266856 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266858 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266860 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266863 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266865 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266870 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266875 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266877 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266880 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266882 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266884 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266887 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266889 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266892 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266894 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266897 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266899 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266902 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266904 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 01:21:59.277077 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266907 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266910 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266912 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266915 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266917 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266920 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266923 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266925 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266928 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266930 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266933 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266935 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266938 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266940 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266943 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266945 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266948 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266951 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266955 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 01:21:59.277582 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266960 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 01:21:59.278069 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266963 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 01:21:59.278069 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.266965 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 01:21:59.278069 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.266971 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 01:21:59.278069 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.273997 2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 01:21:59.278069 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.274013 2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 01:21:59.278069 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.274033 2553 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 01:21:59.278069 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.274039 2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 01:21:59.278069 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274097 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 01:21:59.278069 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274101 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 01:21:59.278069 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274105 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 01:21:59.278069 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274109 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 01:21:59.278069 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274112 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 01:21:59.278069 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274114 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 01:21:59.278069 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274117 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 01:21:59.278069 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274119 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274122 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274125 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274128 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274130 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274133 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274135 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274137 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274140 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274142 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274144 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274147 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274149 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274152 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274154 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274157 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274159 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274164 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274167 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 01:21:59.278453 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274170 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274172 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274175 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274178 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274181 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274184 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274187 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274189 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274192 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274194 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274196 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274199 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274201 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274204 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274206 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274209 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274211 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274214 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274216 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 01:21:59.278936 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274219 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274221 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274224 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274226 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274229 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274231 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274234 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274236 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274239 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274241 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274243 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274246 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274248 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274251 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274254 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274256 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274260 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274262 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274265 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274268 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 01:21:59.279406 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274270 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274273 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274275 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274278 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274281 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274283 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274285 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274288 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274290 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274292 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274295 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274299 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274302 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274305 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274308 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274311 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274314 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274316 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274319 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 01:21:59.279912 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274322 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 01:21:59.280372 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274324 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 01:21:59.280372 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274327 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 01:21:59.280372 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274329 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 01:21:59.280372 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274333 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 01:21:59.280372 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274336 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 01:21:59.280372 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274340 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 01:21:59.280372 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274343 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 01:21:59.280372 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274346 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 01:21:59.280372 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274349 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 01:21:59.280372 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274352 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 01:21:59.280372 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274354 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 01:21:59.280372 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274357 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 01:21:59.280372 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274359 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 01:21:59.280372 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274363 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 01:21:59.280372 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.274368 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274477 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274481 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274483 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274486 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274489 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274492 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274496 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274499 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274502 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274505 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274508 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274511 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274514 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274516 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274519 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274522 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274524 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274527 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274530 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 01:21:59.280854 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274533 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274535 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274538 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274541 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274544 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274546 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274549 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274553 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274557 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274559 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274562 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274564 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274566 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274569 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274572 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274574 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274577 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274579 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274582 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274584 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 01:21:59.281374 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274587 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274589 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274591 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274594 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274596 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274599 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274601 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274603 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274606 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274608 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274611 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274613 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274616 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274618 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274620 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274623 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274642 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274646 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274648 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274652 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 01:21:59.281867 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274654 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274657 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274659 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274662 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274664 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274667 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274670 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274672 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274675 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274677 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274680 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274682 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274684 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274687 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274690 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274692 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274694 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274697 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274699 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274702 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 01:21:59.282380 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274704 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274706 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274709 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274711 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274713 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274716 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274718 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274721 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274724 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274726 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274733 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274736 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274738 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274740 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274743 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274745 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274748 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274750 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274753 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 01:21:59.282931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:21:59.274759 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 01:21:59.283408 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.274764 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 01:21:59.283408 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.274874 2553 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 01:21:59.283408 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.276970 2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 01:21:59.283408 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.278458 2553 server.go:1019] "Starting client certificate rotation" Jul 21 01:21:59.283408 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.278555 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 01:21:59.283408 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.278615 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 01:21:59.283408 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.281445 2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 01:21:59.284941 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.284913 2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 01:21:59.304690 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.304655 2553 log.go:25] "Validated CRI v1 runtime API" Jul 21 01:21:59.310501 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.310482 2553 log.go:25] "Validated CRI v1 image API" Jul 21 01:21:59.311354 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.311335 2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 01:21:59.313908 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.313890 2553 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 be48894a-ba86-4952-b9c4-94ba38f54a71:/dev/nvme0n1p3 fb352ea0-0586-4f15-ba60-764e2d7ba62b:/dev/nvme0n1p4] Jul 21 01:21:59.313973 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.313908 2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 01:21:59.318938 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.318826 2553 manager.go:216] Machine: {Timestamp:2026-07-21 01:21:59.31754828 +0000 UTC m=+0.351367110 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099197 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec215236dcaa037eb35ef76dc18b041a SystemUUID:ec215236-dcaa-037e-b35e-f76dc18b041a BootID:89e7762f-a03d-4b34-aa8b-195444269507 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4e:2a:ea:ac:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4e:2a:ea:ac:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:06:cc:80:aa:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 01:21:59.318938 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.318930 2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 01:21:59.319066 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.319010 2553 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 01:21:59.322280 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.322255 2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 01:21:59.322443 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.322284 2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-244.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 01:21:59.323654 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.323641 2553 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 01:21:59.323725 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.323660 2553 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 01:21:59.323725 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.323670 2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 01:21:59.324255 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.324238 2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 01:21:59.325590 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.325577 2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 01:21:59.326584 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.326566 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 01:21:59.328766 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.328752 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 21 01:21:59.328898 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.328887 2553 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 01:21:59.328967 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.328934 2553 kubelet.go:486] "Attempting to sync node with API server" Jul 21 01:21:59.328967 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.328955 2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 01:21:59.329053 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.328973 2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 01:21:59.329053 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.328986 2553 kubelet.go:398] "Adding apiserver pod source" Jul 21 01:21:59.329053 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.328999 2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 01:21:59.329401 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.329389 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 01:21:59.329471 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.329460 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 01:21:59.331664 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.331647 2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 01:21:59.333382 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.333369 2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 01:21:59.333422 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.333400 2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 01:21:59.334391 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.334378 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 01:21:59.334450 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.334396 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 01:21:59.334450 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.334402 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 01:21:59.334450 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.334408 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 01:21:59.334450 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.334419 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 01:21:59.334450 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.334428 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 01:21:59.334450 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.334440 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 01:21:59.334450 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.334448 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 01:21:59.334685 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.334458 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 01:21:59.334685 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.334466 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 01:21:59.334685 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.334479 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 01:21:59.334685 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.334496 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 01:21:59.335261 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.335252 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 01:21:59.335293 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.335261 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 01:21:59.338741 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.338726 2553 server.go:1268] "Started kubelet" Jul 21 01:21:59.338849 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.338821 2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 01:21:59.338901 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.338837 2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 01:21:59.338901 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.338896 2553 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 01:21:59.339580 ip-10-0-132-244 systemd[1]: Started Kubernetes Kubelet. Jul 21 01:21:59.343014 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.342985 2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 01:21:59.343204 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.343175 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 01:21:59.343370 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.343345 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 01:21:59.343614 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.343577 2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-244.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 01:21:59.345077 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.345057 2553 server.go:310] "Adding debug handlers to kubelet server" Jul 21 01:21:59.346645 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.346599 2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 01:21:59.349477 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.348290 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-244.ec2.internal.18c4297164706dbc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-244.ec2.internal,UID:ip-10-0-132-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-244.ec2.internal,},FirstTimestamp:2026-07-21 01:21:59.338692028 +0000 UTC m=+0.372510857,LastTimestamp:2026-07-21 01:21:59.338692028 +0000 UTC m=+0.372510857,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-244.ec2.internal,}" Jul 21 01:21:59.351135 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.351118 2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 01:21:59.351208 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.351138 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 01:21:59.351410 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.351270 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:21:59.351682 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.351660 2553 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 01:21:59.351682 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.351679 2553 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 01:21:59.351779 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.351682 2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 01:21:59.351849 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.351836 2553 reconstruct.go:97] "Volume reconstruction finished" Jul 21 01:21:59.351904 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.351851 2553 reconciler.go:29] "Reconciler: start to sync state" Jul 21 01:21:59.351949 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.351930 2553 factory.go:55] Registering systemd factory Jul 21 01:21:59.351949 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.351946 2553 factory.go:223] Registration of the systemd container factory successfully Jul 21 01:21:59.352260 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.352243 2553 factory.go:153] Registering CRI-O factory Jul 21 01:21:59.352260 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.352262 2553 factory.go:223] Registration of the crio container factory successfully Jul 21 01:21:59.352403 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.352314 2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 01:21:59.352403 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.352340 2553 factory.go:103] Registering Raw factory Jul 21 01:21:59.352403 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.352353 2553 manager.go:1196] Started watching for new ooms in manager Jul 21 01:21:59.353065 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.353054 2553 manager.go:349] Starting recovery of all containers Jul 21 01:21:59.356533 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.356502 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 21 01:21:59.356659 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.356597 2553 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 21 01:21:59.364954 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.364773 2553 manager.go:354] Recovery completed Jul 21 01:21:59.368908 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.368894 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 01:21:59.370743 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.370719 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientMemory" Jul 21 01:21:59.370844 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.370755 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 01:21:59.370844 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.370765 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientPID" Jul 21 01:21:59.371275 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.371262 2553 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 01:21:59.371275 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.371274 2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 01:21:59.371360 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.371289 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 21 01:21:59.371401 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.371265 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 01:21:59.372086 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.372062 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rnrcp" Jul 21 01:21:59.372165 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.372097 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientMemory" Jul 21 01:21:59.372165 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.372126 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 01:21:59.372165 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.372136 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientPID" Jul 21 01:21:59.372767 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.372702 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-244.ec2.internal.18c4297166597d43 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-244.ec2.internal,UID:ip-10-0-132-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-244.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-244.ec2.internal,},FirstTimestamp:2026-07-21 01:21:59.370743107 +0000 UTC m=+0.404561937,LastTimestamp:2026-07-21 01:21:59.370743107 +0000 UTC m=+0.404561937,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-244.ec2.internal,}" Jul 21 01:21:59.372979 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.372954 2553 policy_none.go:49] "None policy: Start" Jul 21 01:21:59.373058 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.372984 2553 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 01:21:59.373058 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.372994 2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 01:21:59.374191 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.374180 2553 policy_none.go:47] "Start" Jul 21 01:21:59.380177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.380149 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rnrcp" Jul 21 01:21:59.381733 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.381494 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-244.ec2.internal.18c429716659c04b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-244.ec2.internal,UID:ip-10-0-132-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-244.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-244.ec2.internal,},FirstTimestamp:2026-07-21 01:21:59.370760267 +0000 UTC m=+0.404579098,LastTimestamp:2026-07-21 01:21:59.370760267 +0000 UTC m=+0.404579098,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-244.ec2.internal,}" Jul 21 01:21:59.383074 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.383002 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-244.ec2.internal.18c429716659e483 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-244.ec2.internal,UID:ip-10-0-132-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-244.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-244.ec2.internal,},FirstTimestamp:2026-07-21 01:21:59.370769539 +0000 UTC m=+0.404588369,LastTimestamp:2026-07-21 01:21:59.370769539 +0000 UTC m=+0.404588369,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-244.ec2.internal,}" Jul 21 01:21:59.418464 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.416229 2553 manager.go:337] "Starting Device Plugin manager" Jul 21 01:21:59.418464 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.416261 2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 01:21:59.418464 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.416271 2553 server.go:87] "Starting device plugin registration server" Jul 21 01:21:59.418464 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.416553 2553 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 01:21:59.418464 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.416567 2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 01:21:59.418464 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.416660 2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 01:21:59.418464 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.416730 2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 01:21:59.418464 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.416737 2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 01:21:59.418464 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.417366 2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 01:21:59.418464 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.417416 2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:21:59.480080 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.480038 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 01:21:59.481785 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.481760 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 01:21:59.481889 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.481811 2553 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 01:21:59.482130 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.481983 2553 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 01:21:59.482130 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.482050 2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 01:21:59.484420 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.484403 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 01:21:59.517466 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.517391 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 01:21:59.519768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.519750 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientMemory" Jul 21 01:21:59.519873 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.519782 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 01:21:59.519873 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.519795 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientPID" Jul 21 01:21:59.519873 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.519826 2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.529224 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.529206 2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.529296 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.529229 2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-244.ec2.internal\": node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:21:59.554070 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.554038 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:21:59.582786 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.582745 2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal"] Jul 21 01:21:59.582927 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.582824 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 01:21:59.583787 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.583771 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientMemory" Jul 21 01:21:59.583893 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.583798 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 01:21:59.583893 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.583807 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientPID" Jul 21 01:21:59.585334 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.585319 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 01:21:59.585498 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.585486 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.585534 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.585513 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 01:21:59.586059 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.586040 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientMemory" Jul 21 01:21:59.586158 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.586071 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 01:21:59.586158 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.586081 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientPID" Jul 21 01:21:59.586158 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.586037 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientMemory" Jul 21 01:21:59.586158 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.586138 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 01:21:59.586158 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.586149 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientPID" Jul 21 01:21:59.587796 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.587781 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.587885 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.587810 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 01:21:59.588454 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.588441 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientMemory" Jul 21 01:21:59.588519 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.588464 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 01:21:59.588519 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.588473 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientPID" Jul 21 01:21:59.606185 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.606162 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-244.ec2.internal\" not found" node="ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.609750 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.609734 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-244.ec2.internal\" not found" node="ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.653525 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.653495 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7965265fdb025606b6d4e2f8d5d6339f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal\" (UID: \"7965265fdb025606b6d4e2f8d5d6339f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.653525 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.653526 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7965265fdb025606b6d4e2f8d5d6339f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal\" (UID: \"7965265fdb025606b6d4e2f8d5d6339f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.653689 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.653542 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33bb07fd6488aabd85ee56d2bdf92fd8-config\") pod \"kube-apiserver-proxy-ip-10-0-132-244.ec2.internal\" (UID: \"33bb07fd6488aabd85ee56d2bdf92fd8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.654555 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.654527 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:21:59.754403 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.754374 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33bb07fd6488aabd85ee56d2bdf92fd8-config\") pod \"kube-apiserver-proxy-ip-10-0-132-244.ec2.internal\" (UID: \"33bb07fd6488aabd85ee56d2bdf92fd8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.754492 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.754406 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7965265fdb025606b6d4e2f8d5d6339f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal\" (UID: \"7965265fdb025606b6d4e2f8d5d6339f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.754492 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.754425 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7965265fdb025606b6d4e2f8d5d6339f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal\" (UID: \"7965265fdb025606b6d4e2f8d5d6339f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.754492 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.754489 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7965265fdb025606b6d4e2f8d5d6339f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal\" (UID: \"7965265fdb025606b6d4e2f8d5d6339f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.754580 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.754495 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33bb07fd6488aabd85ee56d2bdf92fd8-config\") pod \"kube-apiserver-proxy-ip-10-0-132-244.ec2.internal\" (UID: \"33bb07fd6488aabd85ee56d2bdf92fd8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.754580 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.754507 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7965265fdb025606b6d4e2f8d5d6339f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal\" (UID: \"7965265fdb025606b6d4e2f8d5d6339f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.755422 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.755408 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:21:59.856146 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.856079 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:21:59.910298 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.910271 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.912365 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:21:59.912346 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal" Jul 21 01:21:59.956893 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:21:59.956861 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:22:00.057370 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:00.057331 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:22:00.157946 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:00.157870 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:22:00.184824 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:00.184799 2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 01:22:00.258224 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:00.258192 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:22:00.277303 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:00.277275 2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 01:22:00.277441 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:00.277427 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 01:22:00.277481 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:00.277452 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 01:22:00.358687 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:00.358659 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:22:00.383928 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:00.383892 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 01:17:00 +0000 UTC" deadline="2028-02-14 08:14:15.61949579 +0000 UTC" Jul 21 01:22:00.383928 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:00.383919 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13758h52m15.235579766s" Jul 21 01:22:00.459539 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:00.459478 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:22:00.475635 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:00.475609 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 01:22:00.476877 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:00.476861 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientMemory" Jul 21 01:22:00.476984 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:00.476890 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 01:22:00.476984 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:00.476900 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientPID" Jul 21 01:22:00.559912 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:00.559877 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:22:00.584931 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:00.584891 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7965265fdb025606b6d4e2f8d5d6339f.slice/crio-915f503bdcd13eb99ffd0512a00ba72501dc7a43edeb71134be2e199132165fc WatchSource:0}: Error finding container 915f503bdcd13eb99ffd0512a00ba72501dc7a43edeb71134be2e199132165fc: Status 404 returned error can't find the container with id 915f503bdcd13eb99ffd0512a00ba72501dc7a43edeb71134be2e199132165fc Jul 21 01:22:00.585170 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:00.585131 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33bb07fd6488aabd85ee56d2bdf92fd8.slice/crio-79c5a1bdffdeaeacc442ee94b6086b537d76ba9a1a622293ca54641538c51e75 WatchSource:0}: Error finding container 79c5a1bdffdeaeacc442ee94b6086b537d76ba9a1a622293ca54641538c51e75: Status 404 returned error can't find the container with id 79c5a1bdffdeaeacc442ee94b6086b537d76ba9a1a622293ca54641538c51e75 Jul 21 01:22:00.589375 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:00.589359 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 01:22:00.660793 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:00.660758 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:22:00.761247 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:00.761176 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found" Jul 21 01:22:00.796298 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:00.796275 2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 01:22:02.199065 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.199043 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" Jul 21 01:22:02.212315 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.212294 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 01:22:02.213546 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.213533 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal" Jul 21 01:22:02.224998 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.224979 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 01:22:02.303185 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.303158 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 01:22:02.608299 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.608211 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 01:22:02.677178 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.677140 2553 apiserver.go:52] "Watching apiserver" Jul 21 01:22:02.687281 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.687249 2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 01:22:02.688395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.688366 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-kj8tf","openshift-ovn-kubernetes/ovnkube-node-jdsfw","kube-system/konnectivity-agent-xwk4v","openshift-cluster-node-tuning-operator/tuned-bz8rt","openshift-dns/node-resolver-dfxqd","openshift-image-registry/node-ca-t99s5","openshift-multus/multus-additional-cni-plugins-h5rs6","openshift-multus/network-metrics-daemon-zmvvl","openshift-network-diagnostics/network-check-target-jln5h","kube-system/global-pull-secret-syncer-gssj9","kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal","openshift-multus/multus-hbscb"] Jul 21 01:22:02.690223 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.690189 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:02.690354 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:02.690295 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:02.691330 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.691306 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.693044 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.692746 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xwk4v" Jul 21 01:22:02.696756 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.695731 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lfhqh\"" Jul 21 01:22:02.696756 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.696014 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 01:22:02.696756 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.696179 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 01:22:02.696756 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.696313 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 01:22:02.696756 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.696579 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 01:22:02.696756 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.696635 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6sn85\"" Jul 21 01:22:02.696756 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.696647 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 01:22:02.696756 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.696657 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 01:22:02.696756 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.696639 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 01:22:02.697217 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.696883 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 01:22:02.697217 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.697154 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.699499 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.699421 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 01:22:02.699643 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.699534 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 01:22:02.699761 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.699722 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nkpjj\"" Jul 21 01:22:02.699956 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.699938 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 01:22:02.700031 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.699965 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 01:22:02.700281 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.700267 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.701732 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.701708 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t99s5" Jul 21 01:22:02.702484 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.702460 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 01:22:02.702560 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.702528 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 01:22:02.702991 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.702973 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 01:22:02.703359 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.703190 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vs6nd\"" Jul 21 01:22:02.703734 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.703575 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 01:22:02.704008 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.703862 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 01:22:02.705249 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.704285 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6r5mg\"" Jul 21 01:22:02.705249 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.704471 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 01:22:02.705249 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.704632 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 01:22:02.705249 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.704901 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 01:22:02.706521 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.706243 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kj8tf" Jul 21 01:22:02.708393 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.708369 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:02.708474 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:02.708451 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:02.708906 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.708887 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 01:22:02.709068 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.709057 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 01:22:02.709221 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.709205 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vjtth\"" Jul 21 01:22:02.709401 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.709385 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 01:22:02.710045 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.710023 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 01:22:02.710506 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.710482 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dfxqd" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.712572 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-registration-dir\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.712616 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-system-cni-dir\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.712654 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-cni-bin\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.712691 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-os-release\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.712724 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-cni-binary-copy\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.712888 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-run-ovn\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.712952 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-systemd-units\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713002 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-var-lib-openvswitch\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713031 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-etc-openvswitch\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713049 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-run-openvswitch\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713079 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-run-ovn-kubernetes\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713142 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-cni-netd\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713172 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-device-dir\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713201 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j87hc\" (UniqueName: \"kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc\") pod \"network-check-target-jln5h\" (UID: \"aa4beaba-0f0c-4f29-ac98-24ab6a629f60\") " pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713229 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-slash\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.715388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713257 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-run-systemd\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713302 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b016df69-313e-4c83-9a41-db3e34730566-agent-certs\") pod \"konnectivity-agent-xwk4v\" (UID: \"b016df69-313e-4c83-9a41-db3e34730566\") " pod="kube-system/konnectivity-agent-xwk4v" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713328 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713377 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f259\" (UniqueName: \"kubernetes.io/projected/5d8d297d-728e-4198-8349-ffa4bbbf397e-kube-api-access-7f259\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713410 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46s2t\" (UniqueName: \"kubernetes.io/projected/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-kube-api-access-46s2t\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713498 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-run-netns\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713648 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-node-log\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713674 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-socket-dir\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713719 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-sys-fs\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713769 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713828 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-log-socket\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713877 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713913 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ddb4db9-32ba-4437-b3b0-e76756b9542d-env-overrides\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713940 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-cnibin\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.713978 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.714024 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ddb4db9-32ba-4437-b3b0-e76756b9542d-ovn-node-metrics-cert\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.716196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.714054 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-etc-selinux\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.717045 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.714106 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.717045 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.714141 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-kubelet\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.717045 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.714178 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ddb4db9-32ba-4437-b3b0-e76756b9542d-ovnkube-config\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.717045 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.714225 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ddb4db9-32ba-4437-b3b0-e76756b9542d-ovnkube-script-lib\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.717045 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.714264 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np4bn\" (UniqueName: \"kubernetes.io/projected/8ddb4db9-32ba-4437-b3b0-e76756b9542d-kube-api-access-np4bn\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.717045 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.714343 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b016df69-313e-4c83-9a41-db3e34730566-konnectivity-ca\") pod \"konnectivity-agent-xwk4v\" (UID: \"b016df69-313e-4c83-9a41-db3e34730566\") " pod="kube-system/konnectivity-agent-xwk4v" Jul 21 01:22:02.717045 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.714868 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7dllt\"" Jul 21 01:22:02.717045 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.715096 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 01:22:02.717045 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.715259 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 01:22:02.717045 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.716377 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:02.717045 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:02.716443 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:02.718841 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.718823 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.720317 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.720300 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.722735 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.721535 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 01:22:02.722735 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.721550 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-glftd\"" Jul 21 01:22:02.722735 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.721708 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 01:22:02.722735 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.722678 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 01:22:02.723126 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.722905 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qnsn2\"" Jul 21 01:22:02.730978 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.730955 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6crrt" Jul 21 01:22:02.743163 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.742775 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6crrt" Jul 21 01:22:02.800181 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.800153 2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 01:22:02.815304 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815266 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-cnibin\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.815462 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815320 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/47b65ca9-dc09-4748-a6db-6a40b0b156aa-dbus\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:02.815462 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815351 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-os-release\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.815462 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815381 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-run-k8s-cni-cncf-io\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.815462 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815406 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-var-lib-cni-bin\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.815462 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815438 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-multus-conf-dir\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.815670 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815464 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.815670 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815489 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ddb4db9-32ba-4437-b3b0-e76756b9542d-ovnkube-config\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.815670 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815510 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-run\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.815670 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815537 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgnk9\" (UniqueName: \"kubernetes.io/projected/17c331b3-5db1-4525-91d7-ad627baacec7-kube-api-access-lgnk9\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.815670 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815559 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/acc75cec-2891-45d1-bfad-4946a33005ef-cni-binary-copy\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.815670 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815582 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-cni-bin\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.815670 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815605 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmq6s\" (UniqueName: \"kubernetes.io/projected/832d95fc-ede2-4c3f-88df-2e819c834774-kube-api-access-bmq6s\") pod \"node-ca-t99s5\" (UID: \"832d95fc-ede2-4c3f-88df-2e819c834774\") " pod="openshift-image-registry/node-ca-t99s5" Jul 21 01:22:02.815670 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815629 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fbee072-3882-4927-832c-417b526001f8-hosts-file\") pod \"node-resolver-dfxqd\" (UID: \"8fbee072-3882-4927-832c-417b526001f8\") " pod="openshift-dns/node-resolver-dfxqd" Jul 21 01:22:02.815670 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815659 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-host\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.816206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815681 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-multus-socket-dir-parent\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.816206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815704 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-var-lib-cni-multus\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.816206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815734 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-os-release\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.816206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815758 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-cni-binary-copy\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.816206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815780 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-systemd-units\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.816206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815844 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-var-lib-openvswitch\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.816206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815885 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-run-openvswitch\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.816206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815918 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kkxm\" (UniqueName: \"kubernetes.io/projected/00543583-912d-4354-8810-fc0e9f4a54be-kube-api-access-7kkxm\") pod \"network-metrics-daemon-zmvvl\" (UID: \"00543583-912d-4354-8810-fc0e9f4a54be\") " pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:02.816206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815957 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-var-lib-kubelet\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.816206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.815986 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/acc75cec-2891-45d1-bfad-4946a33005ef-multus-daemon-config\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.816206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.816016 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-slash\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.816206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.816031 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-run-systemd\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.816206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.816046 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b016df69-313e-4c83-9a41-db3e34730566-agent-certs\") pod \"konnectivity-agent-xwk4v\" (UID: \"b016df69-313e-4c83-9a41-db3e34730566\") " pod="kube-system/konnectivity-agent-xwk4v" Jul 21 01:22:02.816206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.816204 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-cnibin\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.816949 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.816928 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.817500 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.817479 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ddb4db9-32ba-4437-b3b0-e76756b9542d-ovnkube-config\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.817601 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.817577 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-cni-bin\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.817772 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.817745 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-os-release\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.817891 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.817871 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-modprobe-d\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.817959 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.817909 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-sysconfig\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.817959 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.817944 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-multus-cni-dir\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.818050 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.817975 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.818050 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818002 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46s2t\" (UniqueName: \"kubernetes.io/projected/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-kube-api-access-46s2t\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.818050 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818029 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/967d29fd-ef2a-4f54-91da-ee47cb88d07c-iptables-alerter-script\") pod \"iptables-alerter-kj8tf\" (UID: \"967d29fd-ef2a-4f54-91da-ee47cb88d07c\") " pod="openshift-network-operator/iptables-alerter-kj8tf" Jul 21 01:22:02.818190 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818052 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-sysctl-conf\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.818190 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818075 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-run-netns\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.818190 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818098 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-socket-dir\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.818190 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818124 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-sys-fs\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.818190 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818147 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.818190 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818180 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ddb4db9-32ba-4437-b3b0-e76756b9542d-env-overrides\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.818435 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818210 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/832d95fc-ede2-4c3f-88df-2e819c834774-serviceca\") pod \"node-ca-t99s5\" (UID: \"832d95fc-ede2-4c3f-88df-2e819c834774\") " pod="openshift-image-registry/node-ca-t99s5" Jul 21 01:22:02.818435 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818237 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-hostroot\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.818435 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818248 2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 01:22:02.818435 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818252 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-cni-binary-copy\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.818435 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818348 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-run-openvswitch\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.818435 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818382 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-slash\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.818705 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818432 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-run-systemd\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.818705 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818490 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.818705 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818494 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-socket-dir\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.818705 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818538 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-sys-fs\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.819014 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818978 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.819260 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819238 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-systemd-units\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.819296 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819276 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-var-lib-openvswitch\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.819344 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.818259 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-run-multus-certs\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.819377 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819357 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ddb4db9-32ba-4437-b3b0-e76756b9542d-env-overrides\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.819377 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819363 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.819433 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819384 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ddb4db9-32ba-4437-b3b0-e76756b9542d-ovn-node-metrics-cert\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.819433 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819411 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9d59\" (UniqueName: \"kubernetes.io/projected/967d29fd-ef2a-4f54-91da-ee47cb88d07c-kube-api-access-g9d59\") pod \"iptables-alerter-kj8tf\" (UID: \"967d29fd-ef2a-4f54-91da-ee47cb88d07c\") " pod="openshift-network-operator/iptables-alerter-kj8tf" Jul 21 01:22:02.819433 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819428 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-sys\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.819521 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819445 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-etc-selinux\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.819521 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819481 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-kubelet\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.819521 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819485 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.819521 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819502 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ddb4db9-32ba-4437-b3b0-e76756b9542d-ovnkube-script-lib\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.819633 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819523 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np4bn\" (UniqueName: \"kubernetes.io/projected/8ddb4db9-32ba-4437-b3b0-e76756b9542d-kube-api-access-np4bn\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.819633 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819532 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-kubelet\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.819633 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819541 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b016df69-313e-4c83-9a41-db3e34730566-konnectivity-ca\") pod \"konnectivity-agent-xwk4v\" (UID: \"b016df69-313e-4c83-9a41-db3e34730566\") " pod="kube-system/konnectivity-agent-xwk4v" Jul 21 01:22:02.819633 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819567 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/47b65ca9-dc09-4748-a6db-6a40b0b156aa-kubelet-config\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:02.819633 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819577 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-etc-selinux\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.819633 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819591 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:02.819876 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819857 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-registration-dir\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.819925 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819893 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-system-cni-dir\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.819967 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819925 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs\") pod \"network-metrics-daemon-zmvvl\" (UID: \"00543583-912d-4354-8810-fc0e9f4a54be\") " pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:02.819967 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819954 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdmx6\" (UniqueName: \"kubernetes.io/projected/8fbee072-3882-4927-832c-417b526001f8-kube-api-access-zdmx6\") pod \"node-resolver-dfxqd\" (UID: \"8fbee072-3882-4927-832c-417b526001f8\") " pod="openshift-dns/node-resolver-dfxqd" Jul 21 01:22:02.820047 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819978 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/17c331b3-5db1-4525-91d7-ad627baacec7-etc-tuned\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.820047 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.819997 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ddb4db9-32ba-4437-b3b0-e76756b9542d-ovnkube-script-lib\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.820047 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820001 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17c331b3-5db1-4525-91d7-ad627baacec7-tmp\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.820166 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820055 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-registration-dir\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.820166 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820064 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-run-ovn\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.820166 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820103 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-systemd\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.820166 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820113 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-system-cni-dir\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.820166 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820132 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-var-lib-kubelet\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.820166 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820139 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b016df69-313e-4c83-9a41-db3e34730566-konnectivity-ca\") pod \"konnectivity-agent-xwk4v\" (UID: \"b016df69-313e-4c83-9a41-db3e34730566\") " pod="kube-system/konnectivity-agent-xwk4v" Jul 21 01:22:02.820166 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820157 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-etc-openvswitch\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.820654 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820182 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-run-ovn-kubernetes\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.820654 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820134 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-run-ovn\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.820654 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820246 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-run-ovn-kubernetes\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.820654 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820248 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-cni-netd\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.820654 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820207 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-cni-netd\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.820654 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820283 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-lib-modules\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.820654 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820307 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-device-dir\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.820654 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820331 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j87hc\" (UniqueName: \"kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc\") pod \"network-check-target-jln5h\" (UID: \"aa4beaba-0f0c-4f29-ac98-24ab6a629f60\") " pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:02.820654 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820353 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/832d95fc-ede2-4c3f-88df-2e819c834774-host\") pod \"node-ca-t99s5\" (UID: \"832d95fc-ede2-4c3f-88df-2e819c834774\") " pod="openshift-image-registry/node-ca-t99s5" Jul 21 01:22:02.820654 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820368 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-kubernetes\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.820654 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820555 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-etc-openvswitch\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.820654 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820588 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d8d297d-728e-4198-8349-ffa4bbbf397e-device-dir\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820754 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqzfx\" (UniqueName: \"kubernetes.io/projected/acc75cec-2891-45d1-bfad-4946a33005ef-kube-api-access-qqzfx\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820774 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f259\" (UniqueName: \"kubernetes.io/projected/5d8d297d-728e-4198-8349-ffa4bbbf397e-kube-api-access-7f259\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820790 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-run-netns\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820830 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-node-log\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820852 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fbee072-3882-4927-832c-417b526001f8-tmp-dir\") pod \"node-resolver-dfxqd\" (UID: \"8fbee072-3882-4927-832c-417b526001f8\") " pod="openshift-dns/node-resolver-dfxqd" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820875 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-system-cni-dir\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820898 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-cnibin\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820919 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-etc-kubernetes\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820942 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-log-socket\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820968 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.820992 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/967d29fd-ef2a-4f54-91da-ee47cb88d07c-host-slash\") pod \"iptables-alerter-kj8tf\" (UID: \"967d29fd-ef2a-4f54-91da-ee47cb88d07c\") " pod="openshift-network-operator/iptables-alerter-kj8tf" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.821035 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-run-netns\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.821063 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-log-socket\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.821068 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-sysctl-d\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.821091 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.821189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.821153 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ddb4db9-32ba-4437-b3b0-e76756b9542d-node-log\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.823529 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.823496 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b016df69-313e-4c83-9a41-db3e34730566-agent-certs\") pod \"konnectivity-agent-xwk4v\" (UID: \"b016df69-313e-4c83-9a41-db3e34730566\") " pod="kube-system/konnectivity-agent-xwk4v" Jul 21 01:22:02.823762 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.823740 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ddb4db9-32ba-4437-b3b0-e76756b9542d-ovn-node-metrics-cert\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.836931 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.834932 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46s2t\" (UniqueName: \"kubernetes.io/projected/cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236-kube-api-access-46s2t\") pod \"multus-additional-cni-plugins-h5rs6\" (UID: \"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236\") " pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:02.837139 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:02.837115 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 01:22:02.837202 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:02.837141 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 01:22:02.837202 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:02.837156 2553 projected.go:196] Error preparing data for projected volume kube-api-access-j87hc for pod openshift-network-diagnostics/network-check-target-jln5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 01:22:02.837291 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:02.837228 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc podName:aa4beaba-0f0c-4f29-ac98-24ab6a629f60 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:03.337206212 +0000 UTC m=+3.023854765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j87hc" (UniqueName: "kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc") pod "network-check-target-jln5h" (UID: "aa4beaba-0f0c-4f29-ac98-24ab6a629f60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 01:22:02.839522 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.837556 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" event={"ID":"7965265fdb025606b6d4e2f8d5d6339f","Type":"ContainerStarted","Data":"915f503bdcd13eb99ffd0512a00ba72501dc7a43edeb71134be2e199132165fc"} Jul 21 01:22:02.840206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.839953 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f259\" (UniqueName: \"kubernetes.io/projected/5d8d297d-728e-4198-8349-ffa4bbbf397e-kube-api-access-7f259\") pod \"aws-ebs-csi-driver-node-vgrmk\" (UID: \"5d8d297d-728e-4198-8349-ffa4bbbf397e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:02.840373 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.840323 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np4bn\" (UniqueName: \"kubernetes.io/projected/8ddb4db9-32ba-4437-b3b0-e76756b9542d-kube-api-access-np4bn\") pod \"ovnkube-node-jdsfw\" (UID: \"8ddb4db9-32ba-4437-b3b0-e76756b9542d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:02.841900 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.841841 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal" event={"ID":"33bb07fd6488aabd85ee56d2bdf92fd8","Type":"ContainerStarted","Data":"79c5a1bdffdeaeacc442ee94b6086b537d76ba9a1a622293ca54641538c51e75"} Jul 21 01:22:02.921916 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.921833 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-var-lib-kubelet\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.921916 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.921884 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/acc75cec-2891-45d1-bfad-4946a33005ef-multus-daemon-config\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.921916 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.921914 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-modprobe-d\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.922182 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.921934 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-sysconfig\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.922182 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.921959 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-multus-cni-dir\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.922182 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.921965 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-var-lib-kubelet\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.922182 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.921979 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/967d29fd-ef2a-4f54-91da-ee47cb88d07c-iptables-alerter-script\") pod \"iptables-alerter-kj8tf\" (UID: \"967d29fd-ef2a-4f54-91da-ee47cb88d07c\") " pod="openshift-network-operator/iptables-alerter-kj8tf" Jul 21 01:22:02.922182 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922029 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-sysctl-conf\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.922182 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922055 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-run-netns\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.922182 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922083 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/832d95fc-ede2-4c3f-88df-2e819c834774-serviceca\") pod \"node-ca-t99s5\" (UID: \"832d95fc-ede2-4c3f-88df-2e819c834774\") " pod="openshift-image-registry/node-ca-t99s5" Jul 21 01:22:02.922182 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922107 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-hostroot\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.922182 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922132 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-run-multus-certs\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.922182 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922161 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9d59\" (UniqueName: \"kubernetes.io/projected/967d29fd-ef2a-4f54-91da-ee47cb88d07c-kube-api-access-g9d59\") pod \"iptables-alerter-kj8tf\" (UID: \"967d29fd-ef2a-4f54-91da-ee47cb88d07c\") " pod="openshift-network-operator/iptables-alerter-kj8tf" Jul 21 01:22:02.922523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922187 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-sys\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.922523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922219 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/47b65ca9-dc09-4748-a6db-6a40b0b156aa-kubelet-config\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:02.922523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922242 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:02.922523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922270 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs\") pod \"network-metrics-daemon-zmvvl\" (UID: \"00543583-912d-4354-8810-fc0e9f4a54be\") " pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:02.922523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922293 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdmx6\" (UniqueName: \"kubernetes.io/projected/8fbee072-3882-4927-832c-417b526001f8-kube-api-access-zdmx6\") pod \"node-resolver-dfxqd\" (UID: \"8fbee072-3882-4927-832c-417b526001f8\") " pod="openshift-dns/node-resolver-dfxqd" Jul 21 01:22:02.922523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922315 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/17c331b3-5db1-4525-91d7-ad627baacec7-etc-tuned\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.922523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922337 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17c331b3-5db1-4525-91d7-ad627baacec7-tmp\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.922523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922361 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-systemd\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.922523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922392 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-var-lib-kubelet\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.922523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922396 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/967d29fd-ef2a-4f54-91da-ee47cb88d07c-iptables-alerter-script\") pod \"iptables-alerter-kj8tf\" (UID: \"967d29fd-ef2a-4f54-91da-ee47cb88d07c\") " pod="openshift-network-operator/iptables-alerter-kj8tf" Jul 21 01:22:02.922523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922419 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-lib-modules\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.922523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922467 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/832d95fc-ede2-4c3f-88df-2e819c834774-host\") pod \"node-ca-t99s5\" (UID: \"832d95fc-ede2-4c3f-88df-2e819c834774\") " pod="openshift-image-registry/node-ca-t99s5" Jul 21 01:22:02.922523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922489 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-kubernetes\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.922523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922512 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqzfx\" (UniqueName: \"kubernetes.io/projected/acc75cec-2891-45d1-bfad-4946a33005ef-kube-api-access-qqzfx\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922541 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fbee072-3882-4927-832c-417b526001f8-tmp-dir\") pod \"node-resolver-dfxqd\" (UID: \"8fbee072-3882-4927-832c-417b526001f8\") " pod="openshift-dns/node-resolver-dfxqd" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922563 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-system-cni-dir\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922585 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-cnibin\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922609 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-etc-kubernetes\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922627 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/967d29fd-ef2a-4f54-91da-ee47cb88d07c-host-slash\") pod \"iptables-alerter-kj8tf\" (UID: \"967d29fd-ef2a-4f54-91da-ee47cb88d07c\") " pod="openshift-network-operator/iptables-alerter-kj8tf" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922640 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-sysctl-d\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922654 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/47b65ca9-dc09-4748-a6db-6a40b0b156aa-dbus\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922671 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-os-release\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922685 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-run-k8s-cni-cncf-io\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922700 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-var-lib-cni-bin\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922717 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-multus-conf-dir\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922736 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-run\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922752 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgnk9\" (UniqueName: \"kubernetes.io/projected/17c331b3-5db1-4525-91d7-ad627baacec7-kube-api-access-lgnk9\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922768 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/acc75cec-2891-45d1-bfad-4946a33005ef-cni-binary-copy\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922771 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-sysconfig\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922783 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmq6s\" (UniqueName: \"kubernetes.io/projected/832d95fc-ede2-4c3f-88df-2e819c834774-kube-api-access-bmq6s\") pod \"node-ca-t99s5\" (UID: \"832d95fc-ede2-4c3f-88df-2e819c834774\") " pod="openshift-image-registry/node-ca-t99s5" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922815 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fbee072-3882-4927-832c-417b526001f8-hosts-file\") pod \"node-resolver-dfxqd\" (UID: \"8fbee072-3882-4927-832c-417b526001f8\") " pod="openshift-dns/node-resolver-dfxqd" Jul 21 01:22:02.922924 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922829 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-host\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922843 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-multus-socket-dir-parent\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922857 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-var-lib-cni-multus\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922879 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kkxm\" (UniqueName: \"kubernetes.io/projected/00543583-912d-4354-8810-fc0e9f4a54be-kube-api-access-7kkxm\") pod \"network-metrics-daemon-zmvvl\" (UID: \"00543583-912d-4354-8810-fc0e9f4a54be\") " pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922887 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-multus-cni-dir\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922934 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-run-netns\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922971 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-system-cni-dir\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.923001 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-cnibin\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.923029 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-etc-kubernetes\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.923051 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/967d29fd-ef2a-4f54-91da-ee47cb88d07c-host-slash\") pod \"iptables-alerter-kj8tf\" (UID: \"967d29fd-ef2a-4f54-91da-ee47cb88d07c\") " pod="openshift-network-operator/iptables-alerter-kj8tf" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.923137 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-sysctl-d\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.923144 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/832d95fc-ede2-4c3f-88df-2e819c834774-serviceca\") pod \"node-ca-t99s5\" (UID: \"832d95fc-ede2-4c3f-88df-2e819c834774\") " pod="openshift-image-registry/node-ca-t99s5" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.923202 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/47b65ca9-dc09-4748-a6db-6a40b0b156aa-dbus\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.923249 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-os-release\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.923273 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-run-k8s-cni-cncf-io\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.923304 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-var-lib-cni-bin\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.923327 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-multus-conf-dir\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.923353 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-run\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.923395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.922735 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/acc75cec-2891-45d1-bfad-4946a33005ef-multus-daemon-config\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.924021 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.923477 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-sysctl-conf\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.924021 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.923551 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-modprobe-d\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.924021 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.923584 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-hostroot\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.924021 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.923883 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fbee072-3882-4927-832c-417b526001f8-tmp-dir\") pod \"node-resolver-dfxqd\" (UID: \"8fbee072-3882-4927-832c-417b526001f8\") " pod="openshift-dns/node-resolver-dfxqd" Jul 21 01:22:02.924210 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.924046 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/acc75cec-2891-45d1-bfad-4946a33005ef-cni-binary-copy\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.924210 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.924053 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-run-multus-certs\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.924210 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.924118 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-sys\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.924210 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.924156 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/47b65ca9-dc09-4748-a6db-6a40b0b156aa-kubelet-config\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:02.924346 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:02.924219 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 01:22:02.924346 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.924280 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-host-var-lib-cni-multus\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.924346 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:02.924287 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret podName:47b65ca9-dc09-4748-a6db-6a40b0b156aa nodeName:}" failed. No retries permitted until 2026-07-21 01:22:03.424268883 +0000 UTC m=+3.110917436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret") pod "global-pull-secret-syncer-gssj9" (UID: "47b65ca9-dc09-4748-a6db-6a40b0b156aa") : object "kube-system"/"original-pull-secret" not registered Jul 21 01:22:02.924346 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.924327 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/acc75cec-2891-45d1-bfad-4946a33005ef-multus-socket-dir-parent\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.924489 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:02.924456 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 01:22:02.924520 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:02.924495 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs podName:00543583-912d-4354-8810-fc0e9f4a54be nodeName:}" failed. No retries permitted until 2026-07-21 01:22:03.424482581 +0000 UTC m=+3.111131129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs") pod "network-metrics-daemon-zmvvl" (UID: "00543583-912d-4354-8810-fc0e9f4a54be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 01:22:02.924588 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.924571 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-lib-modules\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.924632 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.924622 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-systemd\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.924676 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.924660 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-host\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.924921 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.924887 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/832d95fc-ede2-4c3f-88df-2e819c834774-host\") pod \"node-ca-t99s5\" (UID: \"832d95fc-ede2-4c3f-88df-2e819c834774\") " pod="openshift-image-registry/node-ca-t99s5" Jul 21 01:22:02.925000 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.924915 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-var-lib-kubelet\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.925000 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.924964 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fbee072-3882-4927-832c-417b526001f8-hosts-file\") pod \"node-resolver-dfxqd\" (UID: \"8fbee072-3882-4927-832c-417b526001f8\") " pod="openshift-dns/node-resolver-dfxqd" Jul 21 01:22:02.925107 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.925032 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17c331b3-5db1-4525-91d7-ad627baacec7-etc-kubernetes\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.925627 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.925609 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17c331b3-5db1-4525-91d7-ad627baacec7-tmp\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.927289 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.927233 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/17c331b3-5db1-4525-91d7-ad627baacec7-etc-tuned\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.933486 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.933461 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgnk9\" (UniqueName: \"kubernetes.io/projected/17c331b3-5db1-4525-91d7-ad627baacec7-kube-api-access-lgnk9\") pod \"tuned-bz8rt\" (UID: \"17c331b3-5db1-4525-91d7-ad627baacec7\") " pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:02.943123 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.943092 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqzfx\" (UniqueName: \"kubernetes.io/projected/acc75cec-2891-45d1-bfad-4946a33005ef-kube-api-access-qqzfx\") pod \"multus-hbscb\" (UID: \"acc75cec-2891-45d1-bfad-4946a33005ef\") " pod="openshift-multus/multus-hbscb" Jul 21 01:22:02.943296 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.943270 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdmx6\" (UniqueName: \"kubernetes.io/projected/8fbee072-3882-4927-832c-417b526001f8-kube-api-access-zdmx6\") pod \"node-resolver-dfxqd\" (UID: \"8fbee072-3882-4927-832c-417b526001f8\") " pod="openshift-dns/node-resolver-dfxqd" Jul 21 01:22:02.944191 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.944168 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9d59\" (UniqueName: \"kubernetes.io/projected/967d29fd-ef2a-4f54-91da-ee47cb88d07c-kube-api-access-g9d59\") pod \"iptables-alerter-kj8tf\" (UID: \"967d29fd-ef2a-4f54-91da-ee47cb88d07c\") " pod="openshift-network-operator/iptables-alerter-kj8tf" Jul 21 01:22:02.944918 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.944894 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmq6s\" (UniqueName: \"kubernetes.io/projected/832d95fc-ede2-4c3f-88df-2e819c834774-kube-api-access-bmq6s\") pod \"node-ca-t99s5\" (UID: \"832d95fc-ede2-4c3f-88df-2e819c834774\") " pod="openshift-image-registry/node-ca-t99s5" Jul 21 01:22:02.945015 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:02.944899 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kkxm\" (UniqueName: \"kubernetes.io/projected/00543583-912d-4354-8810-fc0e9f4a54be-kube-api-access-7kkxm\") pod \"network-metrics-daemon-zmvvl\" (UID: \"00543583-912d-4354-8810-fc0e9f4a54be\") " pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:03.006464 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.006430 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:03.014827 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:03.014769 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ddb4db9_32ba_4437_b3b0_e76756b9542d.slice/crio-3f1fea2db0c1d23b54bbcfb7442fa604407464f19a4949272d88811c06033306 WatchSource:0}: Error finding container 3f1fea2db0c1d23b54bbcfb7442fa604407464f19a4949272d88811c06033306: Status 404 returned error can't find the container with id 3f1fea2db0c1d23b54bbcfb7442fa604407464f19a4949272d88811c06033306 Jul 21 01:22:03.018946 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.018924 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xwk4v" Jul 21 01:22:03.026036 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:03.026014 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb016df69_313e_4c83_9a41_db3e34730566.slice/crio-a84a5b1a30eb9bc87878d70c1136593dee5c8d8c06f95cf96a764a80e4aec889 WatchSource:0}: Error finding container a84a5b1a30eb9bc87878d70c1136593dee5c8d8c06f95cf96a764a80e4aec889: Status 404 returned error can't find the container with id a84a5b1a30eb9bc87878d70c1136593dee5c8d8c06f95cf96a764a80e4aec889 Jul 21 01:22:03.028905 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.028883 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" Jul 21 01:22:03.037527 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.037508 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h5rs6" Jul 21 01:22:03.039712 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:03.039687 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d8d297d_728e_4198_8349_ffa4bbbf397e.slice/crio-9e41a893564f10d0f30b52e01a24780763059d6518c6c1675561af3c5d1511fa WatchSource:0}: Error finding container 9e41a893564f10d0f30b52e01a24780763059d6518c6c1675561af3c5d1511fa: Status 404 returned error can't find the container with id 9e41a893564f10d0f30b52e01a24780763059d6518c6c1675561af3c5d1511fa Jul 21 01:22:03.045452 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.045429 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t99s5" Jul 21 01:22:03.045672 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:03.045653 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd5c9d62_e3c5_4a09_ae14_a7c3b8cf1236.slice/crio-7df39412e7743b927a1dc7550dc185fd6e162ab6328d9eb07168c3805814b7c4 WatchSource:0}: Error finding container 7df39412e7743b927a1dc7550dc185fd6e162ab6328d9eb07168c3805814b7c4: Status 404 returned error can't find the container with id 7df39412e7743b927a1dc7550dc185fd6e162ab6328d9eb07168c3805814b7c4 Jul 21 01:22:03.053522 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:03.053499 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod832d95fc_ede2_4c3f_88df_2e819c834774.slice/crio-866b7cf3e06210ab6812a107b7b19b5e6997ef7a579171efd30b9fb37b511e23 WatchSource:0}: Error finding container 866b7cf3e06210ab6812a107b7b19b5e6997ef7a579171efd30b9fb37b511e23: Status 404 returned error can't find the container with id 866b7cf3e06210ab6812a107b7b19b5e6997ef7a579171efd30b9fb37b511e23 Jul 21 01:22:03.054620 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.054602 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kj8tf" Jul 21 01:22:03.061975 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.061957 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dfxqd" Jul 21 01:22:03.062243 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:03.062223 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967d29fd_ef2a_4f54_91da_ee47cb88d07c.slice/crio-5e5b18d859c4ec2c857a4914126cedea52ea73313851835bdb1db28b832d6c82 WatchSource:0}: Error finding container 5e5b18d859c4ec2c857a4914126cedea52ea73313851835bdb1db28b832d6c82: Status 404 returned error can't find the container with id 5e5b18d859c4ec2c857a4914126cedea52ea73313851835bdb1db28b832d6c82 Jul 21 01:22:03.069668 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.069650 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" Jul 21 01:22:03.070401 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:03.070381 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fbee072_3882_4927_832c_417b526001f8.slice/crio-7dea2a6894662942f8fe3845d99536146340b7c8acd5dc44578cd579171ea6b4 WatchSource:0}: Error finding container 7dea2a6894662942f8fe3845d99536146340b7c8acd5dc44578cd579171ea6b4: Status 404 returned error can't find the container with id 7dea2a6894662942f8fe3845d99536146340b7c8acd5dc44578cd579171ea6b4 Jul 21 01:22:03.075453 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.075433 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hbscb" Jul 21 01:22:03.078666 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:03.078639 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c331b3_5db1_4525_91d7_ad627baacec7.slice/crio-17cb572647a7ac39e3a44d2cf20306a21c61d05e7920a4ce33cf1626bdfaefd0 WatchSource:0}: Error finding container 17cb572647a7ac39e3a44d2cf20306a21c61d05e7920a4ce33cf1626bdfaefd0: Status 404 returned error can't find the container with id 17cb572647a7ac39e3a44d2cf20306a21c61d05e7920a4ce33cf1626bdfaefd0 Jul 21 01:22:03.086040 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:03.086015 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc75cec_2891_45d1_bfad_4946a33005ef.slice/crio-89d4a0609aa6ba3c98ee096dba196c2d34b05d8cd8a955e44207511d8cf9635b WatchSource:0}: Error finding container 89d4a0609aa6ba3c98ee096dba196c2d34b05d8cd8a955e44207511d8cf9635b: Status 404 returned error can't find the container with id 89d4a0609aa6ba3c98ee096dba196c2d34b05d8cd8a955e44207511d8cf9635b Jul 21 01:22:03.426316 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.426277 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:03.426498 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.426327 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs\") pod \"network-metrics-daemon-zmvvl\" (UID: \"00543583-912d-4354-8810-fc0e9f4a54be\") " pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:03.426498 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.426364 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j87hc\" (UniqueName: \"kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc\") pod \"network-check-target-jln5h\" (UID: \"aa4beaba-0f0c-4f29-ac98-24ab6a629f60\") " pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:03.426498 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:03.426445 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 01:22:03.426498 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:03.426467 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 01:22:03.426680 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:03.426511 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 01:22:03.426680 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:03.426523 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs podName:00543583-912d-4354-8810-fc0e9f4a54be nodeName:}" failed. No retries permitted until 2026-07-21 01:22:04.426504008 +0000 UTC m=+4.113152554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs") pod "network-metrics-daemon-zmvvl" (UID: "00543583-912d-4354-8810-fc0e9f4a54be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 01:22:03.426680 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:03.426530 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 01:22:03.426680 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:03.426540 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret podName:47b65ca9-dc09-4748-a6db-6a40b0b156aa nodeName:}" failed. No retries permitted until 2026-07-21 01:22:04.426531478 +0000 UTC m=+4.113180012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret") pod "global-pull-secret-syncer-gssj9" (UID: "47b65ca9-dc09-4748-a6db-6a40b0b156aa") : object "kube-system"/"original-pull-secret" not registered Jul 21 01:22:03.426680 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:03.426544 2553 projected.go:196] Error preparing data for projected volume kube-api-access-j87hc for pod openshift-network-diagnostics/network-check-target-jln5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 01:22:03.426680 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:03.426597 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc podName:aa4beaba-0f0c-4f29-ac98-24ab6a629f60 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:04.426578947 +0000 UTC m=+4.113227481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j87hc" (UniqueName: "kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc") pod "network-check-target-jln5h" (UID: "aa4beaba-0f0c-4f29-ac98-24ab6a629f60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 01:22:03.745605 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.745503 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 01:17:02 +0000 UTC" deadline="2028-02-21 14:49:13.072911373 +0000 UTC" Jul 21 01:22:03.745605 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.745539 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13933h27m9.32737627s" Jul 21 01:22:03.808715 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.808683 2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 01:22:03.829418 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.829390 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:03.829587 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.829431 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:03.829587 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.829391 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:03.829587 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:03.829530 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:03.829740 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:03.829595 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:03.829740 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:03.829642 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:03.845919 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.845886 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dfxqd" event={"ID":"8fbee072-3882-4927-832c-417b526001f8","Type":"ContainerStarted","Data":"7dea2a6894662942f8fe3845d99536146340b7c8acd5dc44578cd579171ea6b4"} Jul 21 01:22:03.848314 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.848287 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t99s5" event={"ID":"832d95fc-ede2-4c3f-88df-2e819c834774","Type":"ContainerStarted","Data":"866b7cf3e06210ab6812a107b7b19b5e6997ef7a579171efd30b9fb37b511e23"} Jul 21 01:22:03.849366 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.849327 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xwk4v" event={"ID":"b016df69-313e-4c83-9a41-db3e34730566","Type":"ContainerStarted","Data":"a84a5b1a30eb9bc87878d70c1136593dee5c8d8c06f95cf96a764a80e4aec889"} Jul 21 01:22:03.850364 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.850341 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hbscb" event={"ID":"acc75cec-2891-45d1-bfad-4946a33005ef","Type":"ContainerStarted","Data":"89d4a0609aa6ba3c98ee096dba196c2d34b05d8cd8a955e44207511d8cf9635b"} Jul 21 01:22:03.852327 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.852296 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kj8tf" event={"ID":"967d29fd-ef2a-4f54-91da-ee47cb88d07c","Type":"ContainerStarted","Data":"5e5b18d859c4ec2c857a4914126cedea52ea73313851835bdb1db28b832d6c82"} Jul 21 01:22:03.853280 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.853243 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5rs6" event={"ID":"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236","Type":"ContainerStarted","Data":"7df39412e7743b927a1dc7550dc185fd6e162ab6328d9eb07168c3805814b7c4"} Jul 21 01:22:03.854148 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.854130 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" event={"ID":"5d8d297d-728e-4198-8349-ffa4bbbf397e","Type":"ContainerStarted","Data":"9e41a893564f10d0f30b52e01a24780763059d6518c6c1675561af3c5d1511fa"} Jul 21 01:22:03.855307 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.855278 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" event={"ID":"8ddb4db9-32ba-4437-b3b0-e76756b9542d","Type":"ContainerStarted","Data":"3f1fea2db0c1d23b54bbcfb7442fa604407464f19a4949272d88811c06033306"} Jul 21 01:22:03.856345 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:03.856325 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" event={"ID":"17c331b3-5db1-4525-91d7-ad627baacec7","Type":"ContainerStarted","Data":"17cb572647a7ac39e3a44d2cf20306a21c61d05e7920a4ce33cf1626bdfaefd0"} Jul 21 01:22:04.433155 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:04.432817 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:04.433155 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:04.433109 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs\") pod \"network-metrics-daemon-zmvvl\" (UID: \"00543583-912d-4354-8810-fc0e9f4a54be\") " pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:04.433155 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:04.433145 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 01:22:04.433370 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:04.433225 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret podName:47b65ca9-dc09-4748-a6db-6a40b0b156aa nodeName:}" failed. No retries permitted until 2026-07-21 01:22:06.43320481 +0000 UTC m=+6.119853346 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret") pod "global-pull-secret-syncer-gssj9" (UID: "47b65ca9-dc09-4748-a6db-6a40b0b156aa") : object "kube-system"/"original-pull-secret" not registered Jul 21 01:22:04.433370 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:04.433264 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 01:22:04.433370 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:04.433283 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 01:22:04.433370 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:04.433296 2553 projected.go:196] Error preparing data for projected volume kube-api-access-j87hc for pod openshift-network-diagnostics/network-check-target-jln5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 01:22:04.433370 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:04.433346 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc podName:aa4beaba-0f0c-4f29-ac98-24ab6a629f60 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:06.433329908 +0000 UTC m=+6.119978464 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j87hc" (UniqueName: "kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc") pod "network-check-target-jln5h" (UID: "aa4beaba-0f0c-4f29-ac98-24ab6a629f60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 01:22:04.433612 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:04.433413 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 01:22:04.433612 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:04.433447 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs podName:00543583-912d-4354-8810-fc0e9f4a54be nodeName:}" failed. No retries permitted until 2026-07-21 01:22:06.433434709 +0000 UTC m=+6.120083258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs") pod "network-metrics-daemon-zmvvl" (UID: "00543583-912d-4354-8810-fc0e9f4a54be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 01:22:04.433612 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:04.433153 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j87hc\" (UniqueName: \"kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc\") pod \"network-check-target-jln5h\" (UID: \"aa4beaba-0f0c-4f29-ac98-24ab6a629f60\") " pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:04.746692 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:04.746578 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 01:17:02 +0000 UTC" deadline="2028-03-31 08:54:53.122675218 +0000 UTC" Jul 21 01:22:04.746692 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:04.746643 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14863h32m48.376036892s" Jul 21 01:22:04.866855 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:04.866286 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal" event={"ID":"33bb07fd6488aabd85ee56d2bdf92fd8","Type":"ContainerStarted","Data":"163281ac559efe95358618cac5a4204f167620ad8c635183a1d39e214bccc552"} Jul 21 01:22:04.878909 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:04.878877 2553 generic.go:356] "Generic (PLEG): container finished" podID="7965265fdb025606b6d4e2f8d5d6339f" containerID="0f22d9941c74c641dd568daf9bbfac6e5728299dd16f466fed17d960a943fba1" exitCode=0 Jul 21 01:22:04.879063 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:04.878926 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" event={"ID":"7965265fdb025606b6d4e2f8d5d6339f","Type":"ContainerDied","Data":"0f22d9941c74c641dd568daf9bbfac6e5728299dd16f466fed17d960a943fba1"} Jul 21 01:22:04.900125 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:04.900058 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal" podStartSLOduration=2.900035534 podStartE2EDuration="2.900035534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:04.883753312 +0000 UTC m=+4.570401868" watchObservedRunningTime="2026-07-21 01:22:04.900035534 +0000 UTC m=+4.586684090" Jul 21 01:22:05.831272 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:05.830396 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:05.831272 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:05.830525 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:05.831272 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:05.830947 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:05.831272 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:05.831060 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:05.831272 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:05.831120 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:05.831272 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:05.831188 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:05.887897 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:05.887862 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" event={"ID":"7965265fdb025606b6d4e2f8d5d6339f","Type":"ContainerStarted","Data":"7f05dbcd2c4902fc0555273b78f608834ca686d8efcc0b21aee1c8159955fc20"} Jul 21 01:22:06.447563 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:06.447518 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:06.447563 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:06.447566 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs\") pod \"network-metrics-daemon-zmvvl\" (UID: \"00543583-912d-4354-8810-fc0e9f4a54be\") " pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:06.447820 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:06.447598 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j87hc\" (UniqueName: \"kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc\") pod \"network-check-target-jln5h\" (UID: \"aa4beaba-0f0c-4f29-ac98-24ab6a629f60\") " pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:06.447820 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:06.447755 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 01:22:06.447820 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:06.447774 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 01:22:06.447820 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:06.447787 2553 projected.go:196] Error preparing data for projected volume kube-api-access-j87hc for pod openshift-network-diagnostics/network-check-target-jln5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 01:22:06.448010 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:06.447865 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc podName:aa4beaba-0f0c-4f29-ac98-24ab6a629f60 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:10.447845272 +0000 UTC m=+10.134493825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j87hc" (UniqueName: "kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc") pod "network-check-target-jln5h" (UID: "aa4beaba-0f0c-4f29-ac98-24ab6a629f60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 01:22:06.448281 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:06.448262 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 01:22:06.448379 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:06.448319 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret podName:47b65ca9-dc09-4748-a6db-6a40b0b156aa nodeName:}" failed. No retries permitted until 2026-07-21 01:22:10.448303867 +0000 UTC m=+10.134952415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret") pod "global-pull-secret-syncer-gssj9" (UID: "47b65ca9-dc09-4748-a6db-6a40b0b156aa") : object "kube-system"/"original-pull-secret" not registered Jul 21 01:22:06.448446 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:06.448402 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 01:22:06.448446 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:06.448442 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs podName:00543583-912d-4354-8810-fc0e9f4a54be nodeName:}" failed. No retries permitted until 2026-07-21 01:22:10.448426033 +0000 UTC m=+10.135074580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs") pod "network-metrics-daemon-zmvvl" (UID: "00543583-912d-4354-8810-fc0e9f4a54be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 01:22:07.829937 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:07.829898 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:07.830388 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:07.830026 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:07.830509 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:07.830470 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:07.830628 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:07.830558 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:07.830628 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:07.830612 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:07.830760 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:07.830670 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:09.830276 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:09.830186 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:09.830276 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:09.830228 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:09.830276 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:09.830232 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:09.830838 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:09.830340 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:09.830838 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:09.830718 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:09.830838 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:09.830776 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:10.481153 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:10.481121 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:10.481153 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:10.481158 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs\") pod \"network-metrics-daemon-zmvvl\" (UID: \"00543583-912d-4354-8810-fc0e9f4a54be\") " pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:10.481368 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:10.481188 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j87hc\" (UniqueName: \"kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc\") pod \"network-check-target-jln5h\" (UID: \"aa4beaba-0f0c-4f29-ac98-24ab6a629f60\") " pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:10.481368 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:10.481280 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 01:22:10.481368 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:10.481293 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 01:22:10.481368 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:10.481306 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 01:22:10.481368 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:10.481317 2553 projected.go:196] Error preparing data for projected volume kube-api-access-j87hc for pod openshift-network-diagnostics/network-check-target-jln5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 01:22:10.481368 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:10.481339 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret podName:47b65ca9-dc09-4748-a6db-6a40b0b156aa nodeName:}" failed. No retries permitted until 2026-07-21 01:22:18.481321909 +0000 UTC m=+18.167970442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret") pod "global-pull-secret-syncer-gssj9" (UID: "47b65ca9-dc09-4748-a6db-6a40b0b156aa") : object "kube-system"/"original-pull-secret" not registered Jul 21 01:22:10.481368 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:10.481340 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 01:22:10.481368 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:10.481355 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc podName:aa4beaba-0f0c-4f29-ac98-24ab6a629f60 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:18.481344594 +0000 UTC m=+18.167993147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j87hc" (UniqueName: "kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc") pod "network-check-target-jln5h" (UID: "aa4beaba-0f0c-4f29-ac98-24ab6a629f60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 01:22:10.481739 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:10.481406 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs podName:00543583-912d-4354-8810-fc0e9f4a54be nodeName:}" failed. No retries permitted until 2026-07-21 01:22:18.481386072 +0000 UTC m=+18.168034625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs") pod "network-metrics-daemon-zmvvl" (UID: "00543583-912d-4354-8810-fc0e9f4a54be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 01:22:11.830468 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:11.830432 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:11.830918 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:11.830562 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:11.830918 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:11.830908 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:11.831027 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:11.830930 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:11.831069 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:11.831027 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:11.831189 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:11.831145 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:13.829548 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:13.829330 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:13.829548 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:13.829461 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:13.829548 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:13.829491 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:13.830005 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:13.829559 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:13.830005 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:13.829595 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:13.830005 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:13.829655 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:13.907826 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:13.906602 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5rs6" event={"ID":"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236","Type":"ContainerStarted","Data":"8763095e3ed94518ef3fea0bbc937b02eeea5f9d7fc2fc2e02eb79ebcd33e9dd"} Jul 21 01:22:13.909106 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:13.908922 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" event={"ID":"5d8d297d-728e-4198-8349-ffa4bbbf397e","Type":"ContainerStarted","Data":"98d3061e1408bcfce4c21e0a4f9b7be6cab4156bcee297429a3f88a621ff9d7e"} Jul 21 01:22:13.911329 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:13.911299 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" event={"ID":"17c331b3-5db1-4525-91d7-ad627baacec7","Type":"ContainerStarted","Data":"fededcf8b50c904220a08ed49afea95716e681260610d9c8f1a370bac0d5b15e"} Jul 21 01:22:13.913536 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:13.913506 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dfxqd" event={"ID":"8fbee072-3882-4927-832c-417b526001f8","Type":"ContainerStarted","Data":"87f11c323a1eaf339792ad6a3fdeac89294db6bd2cc64c707d400508af7ad82e"} Jul 21 01:22:13.915321 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:13.915298 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t99s5" event={"ID":"832d95fc-ede2-4c3f-88df-2e819c834774","Type":"ContainerStarted","Data":"4eff52e224dfa6888e04b3580c23dbd918b39c854b989e5d0964a17d0cecd7a1"} Jul 21 01:22:13.917298 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:13.917274 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xwk4v" event={"ID":"b016df69-313e-4c83-9a41-db3e34730566","Type":"ContainerStarted","Data":"6c550f94a42de8da67df99661d8114e699f74e18f6a0e7f5dcadfa64c1676a4f"} Jul 21 01:22:13.932276 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:13.932216 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" podStartSLOduration=11.932198177 podStartE2EDuration="11.932198177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:05.904070304 +0000 UTC m=+5.590718861" watchObservedRunningTime="2026-07-21 01:22:13.932198177 +0000 UTC m=+13.618846733" Jul 21 01:22:13.967376 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:13.967325 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xwk4v" podStartSLOduration=3.342884411 podStartE2EDuration="13.967303376s" totalImagesPullingTime="10.624418965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:13.947737816 +0000 UTC m=+13.634386367" watchObservedRunningTime="2026-07-21 01:22:13.967303376 +0000 UTC m=+13.653951911" Jul 21 01:22:13.981883 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:13.981835 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bz8rt" podStartSLOduration=2.390800271 podStartE2EDuration="12.981819546s" totalImagesPullingTime="10.591019275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:13.967626623 +0000 UTC m=+13.654275181" watchObservedRunningTime="2026-07-21 01:22:13.981819546 +0000 UTC m=+13.668468091" Jul 21 01:22:13.982030 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:13.982009 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t99s5" podStartSLOduration=2.385462697 podStartE2EDuration="12.982001532s" totalImagesPullingTime="10.596538835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:13.981786945 +0000 UTC m=+13.668435500" watchObservedRunningTime="2026-07-21 01:22:13.982001532 +0000 UTC m=+13.668650088" Jul 21 01:22:14.008384 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:14.008322 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dfxqd" podStartSLOduration=2.426927408 podStartE2EDuration="13.008304679s" totalImagesPullingTime="10.581377271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:14.008095256 +0000 UTC m=+13.694743796" watchObservedRunningTime="2026-07-21 01:22:14.008304679 +0000 UTC m=+13.694953277" Jul 21 01:22:14.667355 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:14.667322 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xwk4v" Jul 21 01:22:14.921308 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:14.921276 2553 generic.go:356] "Generic (PLEG): container finished" podID="cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236" containerID="8763095e3ed94518ef3fea0bbc937b02eeea5f9d7fc2fc2e02eb79ebcd33e9dd" exitCode=0 Jul 21 01:22:14.922301 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:14.922272 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5rs6" event={"ID":"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236","Type":"ContainerDied","Data":"8763095e3ed94518ef3fea0bbc937b02eeea5f9d7fc2fc2e02eb79ebcd33e9dd"} Jul 21 01:22:15.022363 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:15.021791 2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 01:22:15.771355 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:15.771199 2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T01:22:15.021829574Z","UUID":"f85d4f28-a17b-48c3-b460-5e8f3ce5f839","Handler":null,"Name":"","Endpoint":""} Jul 21 01:22:15.773074 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:15.773046 2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 01:22:15.773202 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:15.773096 2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 01:22:15.829704 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:15.829672 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:15.829704 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:15.829698 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:15.829975 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:15.829705 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:15.829975 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:15.829825 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:15.829975 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:15.829897 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:15.829975 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:15.829958 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:15.926855 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:15.926817 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kj8tf" event={"ID":"967d29fd-ef2a-4f54-91da-ee47cb88d07c","Type":"ContainerStarted","Data":"8c6b7b4bc41d0a02b674be56315cff7708a3b9702c42245afdbabb09bf4d2364"} Jul 21 01:22:15.930216 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:15.930186 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" event={"ID":"5d8d297d-728e-4198-8349-ffa4bbbf397e","Type":"ContainerStarted","Data":"8771a16faeaf503a667eaeef4056c09b6c52562faaaf4de47c320d3670adab00"} Jul 21 01:22:15.943071 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:15.942712 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kj8tf" podStartSLOduration=4.354776779 podStartE2EDuration="14.942693234s" totalImagesPullingTime="10.587916455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:15.941653237 +0000 UTC m=+15.628301794" watchObservedRunningTime="2026-07-21 01:22:15.942693234 +0000 UTC m=+15.629341792" Jul 21 01:22:17.829823 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:17.829771 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:17.830434 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:17.829919 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:17.830434 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:17.830023 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:17.830434 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:17.830126 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:17.830434 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:17.830165 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:17.830434 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:17.830226 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:18.186609 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:18.186520 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xwk4v" Jul 21 01:22:18.187399 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:18.187369 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xwk4v" Jul 21 01:22:18.547002 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:18.546915 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs\") pod \"network-metrics-daemon-zmvvl\" (UID: \"00543583-912d-4354-8810-fc0e9f4a54be\") " pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:18.547002 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:18.546977 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j87hc\" (UniqueName: \"kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc\") pod \"network-check-target-jln5h\" (UID: \"aa4beaba-0f0c-4f29-ac98-24ab6a629f60\") " pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:18.547208 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:18.547051 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:18.547208 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:18.547158 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 01:22:18.547319 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:18.547218 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret podName:47b65ca9-dc09-4748-a6db-6a40b0b156aa nodeName:}" failed. No retries permitted until 2026-07-21 01:22:34.547198094 +0000 UTC m=+34.233846645 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret") pod "global-pull-secret-syncer-gssj9" (UID: "47b65ca9-dc09-4748-a6db-6a40b0b156aa") : object "kube-system"/"original-pull-secret" not registered Jul 21 01:22:18.547319 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:18.547271 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 01:22:18.547319 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:18.547303 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs podName:00543583-912d-4354-8810-fc0e9f4a54be nodeName:}" failed. No retries permitted until 2026-07-21 01:22:34.547292611 +0000 UTC m=+34.233941148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs") pod "network-metrics-daemon-zmvvl" (UID: "00543583-912d-4354-8810-fc0e9f4a54be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 01:22:18.547477 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:18.547374 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 01:22:18.547477 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:18.547391 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 01:22:18.547477 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:18.547403 2553 projected.go:196] Error preparing data for projected volume kube-api-access-j87hc for pod openshift-network-diagnostics/network-check-target-jln5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 01:22:18.547477 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:18.547440 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc podName:aa4beaba-0f0c-4f29-ac98-24ab6a629f60 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:34.54742726 +0000 UTC m=+34.234075799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j87hc" (UniqueName: "kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc") pod "network-check-target-jln5h" (UID: "aa4beaba-0f0c-4f29-ac98-24ab6a629f60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 01:22:18.939164 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:18.939080 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xwk4v" Jul 21 01:22:19.830247 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:19.830040 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:19.830443 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:19.830040 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:19.830443 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:19.830339 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:19.830443 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:19.830432 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:19.830618 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:19.830040 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:19.830618 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:19.830527 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:21.830240 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:21.830199 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:21.830240 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:21.830229 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:21.830814 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:21.830242 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:21.830814 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:21.830329 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:21.830814 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:21.830393 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:21.830814 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:21.830465 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:23.829970 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:23.829932 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:23.830568 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:23.829980 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:23.830568 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:23.830046 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:23.830568 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:23.830061 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:23.830568 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:23.830109 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:23.830568 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:23.830228 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:25.830388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:25.830350 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:25.830868 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:25.830405 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:25.830868 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:25.830350 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:25.830868 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:25.830488 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:25.830868 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:25.830570 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:25.830868 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:25.830658 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:26.959599 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:26.959448 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hbscb" event={"ID":"acc75cec-2891-45d1-bfad-4946a33005ef","Type":"ContainerStarted","Data":"997f0d6d0d2e3c5a12794f7c69c0420e6de1ff2103c91aeb31e31eccf542ce5f"} Jul 21 01:22:26.962139 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:26.962107 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" event={"ID":"5d8d297d-728e-4198-8349-ffa4bbbf397e","Type":"ContainerStarted","Data":"cbea41da2dc0c2d586f61b2292db1e968d23b42acbf86903c3362d93b391a35d"} Jul 21 01:22:26.963429 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:26.963403 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" event={"ID":"8ddb4db9-32ba-4437-b3b0-e76756b9542d","Type":"ContainerStarted","Data":"aff28e215ad6a93bb095775c7b3d93e515b126200543eb0b182fe357d6548b23"} Jul 21 01:22:26.996892 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:26.996839 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hbscb" podStartSLOduration=2.289944485 podStartE2EDuration="25.996824307s" totalImagesPullingTime="23.706879822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:26.996343958 +0000 UTC m=+26.682992512" watchObservedRunningTime="2026-07-21 01:22:26.996824307 +0000 UTC m=+26.683472863" Jul 21 01:22:27.013546 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:27.013486 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgrmk" podStartSLOduration=3.597712869 podStartE2EDuration="27.013466627s" totalImagesPullingTime="23.415753758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:27.013441108 +0000 UTC m=+26.700089664" watchObservedRunningTime="2026-07-21 01:22:27.013466627 +0000 UTC m=+26.700115183" Jul 21 01:22:27.829792 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:27.829603 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:27.829984 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:27.829603 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:27.829984 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:27.829896 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:27.829984 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:27.829603 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:27.829984 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:27.829972 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:27.830150 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:27.830008 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:27.967597 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:27.967564 2553 generic.go:356] "Generic (PLEG): container finished" podID="cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236" containerID="313171b1d3aacc535200bbeb56cfc8b7862c155a1d6585dbb7339ba2e4cc0f96" exitCode=0 Jul 21 01:22:27.968222 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:27.967656 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5rs6" event={"ID":"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236","Type":"ContainerDied","Data":"313171b1d3aacc535200bbeb56cfc8b7862c155a1d6585dbb7339ba2e4cc0f96"} Jul 21 01:22:27.972338 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:27.972320 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:22:27.972681 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:27.972662 2553 generic.go:356] "Generic (PLEG): container finished" podID="8ddb4db9-32ba-4437-b3b0-e76756b9542d" containerID="8594c7d323dd568ccc06b4429f3cbfa0cb44e730b0fb5871156dec313fbb636c" exitCode=1 Jul 21 01:22:27.972762 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:27.972727 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" event={"ID":"8ddb4db9-32ba-4437-b3b0-e76756b9542d","Type":"ContainerStarted","Data":"7d2117ba3da2cdac02fe9665ff9c651d413f4f6e161897543c94c1e802c1c824"} Jul 21 01:22:27.972940 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:27.972792 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" event={"ID":"8ddb4db9-32ba-4437-b3b0-e76756b9542d","Type":"ContainerStarted","Data":"1ab3364968e9ea5c254efd5b838ae5e109b4448c12eabfa534e668f3060ce86d"} Jul 21 01:22:27.972940 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:27.972845 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" event={"ID":"8ddb4db9-32ba-4437-b3b0-e76756b9542d","Type":"ContainerStarted","Data":"56b2e54c09ab624a5de00806b915874b095637bab80e43c9e1f7a8f5862e08de"} Jul 21 01:22:27.972940 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:27.972879 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" event={"ID":"8ddb4db9-32ba-4437-b3b0-e76756b9542d","Type":"ContainerStarted","Data":"1e0c8d58d60b8641d4ebb46fbc14fed5742ae5f12dd3cd5d7c57fbe290bc78ba"} Jul 21 01:22:27.972940 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:27.972919 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" event={"ID":"8ddb4db9-32ba-4437-b3b0-e76756b9542d","Type":"ContainerDied","Data":"8594c7d323dd568ccc06b4429f3cbfa0cb44e730b0fb5871156dec313fbb636c"} Jul 21 01:22:28.976503 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:28.976470 2553 generic.go:356] "Generic (PLEG): container finished" podID="cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236" containerID="bc1a200d7a341475f3b2c202418638aa763cc7c31995c59a68977437ae47c405" exitCode=0 Jul 21 01:22:28.976956 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:28.976540 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5rs6" event={"ID":"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236","Type":"ContainerDied","Data":"bc1a200d7a341475f3b2c202418638aa763cc7c31995c59a68977437ae47c405"} Jul 21 01:22:29.829618 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:29.829585 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:29.829822 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:29.829628 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:29.829822 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:29.829598 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:29.829822 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:29.829702 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:29.829822 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:29.829759 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:29.829978 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:29.829819 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:29.981242 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:29.981219 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:22:29.981649 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:29.981535 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" event={"ID":"8ddb4db9-32ba-4437-b3b0-e76756b9542d","Type":"ContainerStarted","Data":"36b0a9f373cb9ec1bb42721ac1be7a5e479abe5f9c85e065b01db12da74bb47f"} Jul 21 01:22:30.988724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:30.988689 2553 generic.go:356] "Generic (PLEG): container finished" podID="cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236" containerID="e4a2f5a25304af75d7dfa16c3915a0c625cdc6039c381cd7e0c809073b6d7735" exitCode=0 Jul 21 01:22:30.989199 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:30.988746 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5rs6" event={"ID":"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236","Type":"ContainerDied","Data":"e4a2f5a25304af75d7dfa16c3915a0c625cdc6039c381cd7e0c809073b6d7735"} Jul 21 01:22:31.830502 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:31.830298 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:31.830827 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:31.830298 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:31.830827 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:31.830589 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:31.830827 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:31.830333 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:31.830827 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:31.830650 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:31.830827 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:31.830744 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:31.996563 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:31.996537 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:22:31.997317 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:31.997179 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" event={"ID":"8ddb4db9-32ba-4437-b3b0-e76756b9542d","Type":"ContainerStarted","Data":"e80deb2551ff0f6f4555eb6d1500b0577fa5cd602b0f36bf3630fa25ccce3110"} Jul 21 01:22:31.997558 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:31.997474 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:31.997558 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:31.997541 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:31.997764 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:31.997678 2553 scope.go:117] "RemoveContainer" containerID="8594c7d323dd568ccc06b4429f3cbfa0cb44e730b0fb5871156dec313fbb636c" Jul 21 01:22:32.016906 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:32.016879 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:33.003964 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:33.003938 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:22:33.004443 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:33.004309 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" event={"ID":"8ddb4db9-32ba-4437-b3b0-e76756b9542d","Type":"ContainerStarted","Data":"163ec1fdc27017e471c5d251400214b7bd16777c8508376fdead024b64dba5ae"} Jul 21 01:22:33.004633 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:33.004605 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:33.022939 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:33.022913 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:22:33.033820 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:33.033761 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" podStartSLOduration=9.26673901 podStartE2EDuration="33.033747235s" totalImagesPullingTime="23.767008225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:33.033628406 +0000 UTC m=+32.720276960" watchObservedRunningTime="2026-07-21 01:22:33.033747235 +0000 UTC m=+32.720395840" Jul 21 01:22:33.544675 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:33.544637 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gssj9"] Jul 21 01:22:33.544868 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:33.544778 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:33.544933 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:33.544904 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:33.547954 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:33.547930 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jln5h"] Jul 21 01:22:33.548097 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:33.547983 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zmvvl"] Jul 21 01:22:33.548097 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:33.548079 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:33.548211 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:33.548181 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:33.548265 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:33.548248 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:33.548345 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:33.548322 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:34.557622 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:34.557579 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:34.558073 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:34.557640 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs\") pod \"network-metrics-daemon-zmvvl\" (UID: \"00543583-912d-4354-8810-fc0e9f4a54be\") " pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:34.558073 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:34.557669 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j87hc\" (UniqueName: \"kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc\") pod \"network-check-target-jln5h\" (UID: \"aa4beaba-0f0c-4f29-ac98-24ab6a629f60\") " pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:34.558073 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:34.557693 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 01:22:34.558073 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:34.557766 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret podName:47b65ca9-dc09-4748-a6db-6a40b0b156aa nodeName:}" failed. No retries permitted until 2026-07-21 01:23:06.557747429 +0000 UTC m=+66.244395963 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret") pod "global-pull-secret-syncer-gssj9" (UID: "47b65ca9-dc09-4748-a6db-6a40b0b156aa") : object "kube-system"/"original-pull-secret" not registered Jul 21 01:22:34.558073 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:34.557782 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 01:22:34.558073 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:34.557789 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 01:22:34.558073 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:34.557818 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 01:22:34.558073 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:34.557830 2553 projected.go:196] Error preparing data for projected volume kube-api-access-j87hc for pod openshift-network-diagnostics/network-check-target-jln5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 01:22:34.558073 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:34.557856 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs podName:00543583-912d-4354-8810-fc0e9f4a54be nodeName:}" failed. No retries permitted until 2026-07-21 01:23:06.557844123 +0000 UTC m=+66.244492656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs") pod "network-metrics-daemon-zmvvl" (UID: "00543583-912d-4354-8810-fc0e9f4a54be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 01:22:34.558073 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:34.557872 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc podName:aa4beaba-0f0c-4f29-ac98-24ab6a629f60 nodeName:}" failed. No retries permitted until 2026-07-21 01:23:06.557864418 +0000 UTC m=+66.244512950 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j87hc" (UniqueName: "kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc") pod "network-check-target-jln5h" (UID: "aa4beaba-0f0c-4f29-ac98-24ab6a629f60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 01:22:34.830328 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:34.830241 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:34.830328 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:34.830283 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:34.830531 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:34.830378 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:34.830531 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:34.830493 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:35.830151 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:35.830067 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:35.830574 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:35.830177 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:36.833051 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:36.832781 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:36.833468 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:36.832781 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:36.833468 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:36.833107 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:36.833468 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:36.833162 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:37.015112 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:37.015073 2553 generic.go:356] "Generic (PLEG): container finished" podID="cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236" containerID="3a457d9ebe2f2db7cd09c2d878b77c237f8da11a02bd0a0c087f7bff9b51fbbf" exitCode=0 Jul 21 01:22:37.015249 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:37.015138 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5rs6" event={"ID":"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236","Type":"ContainerDied","Data":"3a457d9ebe2f2db7cd09c2d878b77c237f8da11a02bd0a0c087f7bff9b51fbbf"} Jul 21 01:22:37.829542 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:37.829454 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:37.829692 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:37.829561 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jln5h" podUID="aa4beaba-0f0c-4f29-ac98-24ab6a629f60" Jul 21 01:22:38.019833 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:38.019779 2553 generic.go:356] "Generic (PLEG): container finished" podID="cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236" containerID="67719bb67b851f047ddfb57676fa7d8173118f19f218e9c1ac85858723d7c44a" exitCode=0 Jul 21 01:22:38.020371 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:38.019866 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5rs6" event={"ID":"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236","Type":"ContainerDied","Data":"67719bb67b851f047ddfb57676fa7d8173118f19f218e9c1ac85858723d7c44a"} Jul 21 01:22:38.832921 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:38.832888 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:38.833083 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:38.832933 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:38.833083 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:38.833028 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gssj9" podUID="47b65ca9-dc09-4748-a6db-6a40b0b156aa" Jul 21 01:22:38.833151 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:38.833129 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmvvl" podUID="00543583-912d-4354-8810-fc0e9f4a54be" Jul 21 01:22:39.025267 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.025232 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5rs6" event={"ID":"cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236","Type":"ContainerStarted","Data":"4c64f683931af91332d812f223e0a9ff5d03eb04577e18a0fb230f4c6b9f542e"} Jul 21 01:22:39.049389 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.049336 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h5rs6" podStartSLOduration=8.09813936 podStartE2EDuration="38.049320312s" totalImagesPullingTime="29.951180952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:39.049293772 +0000 UTC m=+38.735942326" watchObservedRunningTime="2026-07-21 01:22:39.049320312 +0000 UTC m=+38.735968857" Jul 21 01:22:39.676001 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.675914 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeReady" Jul 21 01:22:39.676201 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.676056 2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 01:22:39.710655 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.710622 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xfd6h"] Jul 21 01:22:39.731575 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.731488 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk"] Jul 21 01:22:39.732725 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.732510 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:39.736855 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.736833 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gfptg\"" Jul 21 01:22:39.737025 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.736835 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 21 01:22:39.737191 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.737171 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 21 01:22:39.737536 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.737516 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 01:22:39.737733 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.737554 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 01:22:39.748062 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.748034 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55"] Jul 21 01:22:39.748196 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.748086 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:22:39.754496 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.754470 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 21 01:22:39.754788 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.754768 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7tn6h\"" Jul 21 01:22:39.755318 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.755130 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 01:22:39.755615 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.755599 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 01:22:39.755756 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.755737 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 21 01:22:39.758396 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.758376 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 21 01:22:39.773477 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.773446 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p9cfq"] Jul 21 01:22:39.773581 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.773563 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" Jul 21 01:22:39.776155 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.776129 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 21 01:22:39.776258 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.776165 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 21 01:22:39.776258 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.776171 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-q6jlh\"" Jul 21 01:22:39.776258 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.776179 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 21 01:22:39.785429 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.785410 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6984fd67cf-xhr5k"] Jul 21 01:22:39.785530 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.785516 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p9cfq" Jul 21 01:22:39.787894 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.787868 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hvh79\"" Jul 21 01:22:39.788004 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.787990 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 21 01:22:39.788053 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.788001 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 21 01:22:39.806427 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.806400 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-6s4th"] Jul 21 01:22:39.806559 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.806518 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:39.809262 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.809241 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 21 01:22:39.809262 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.809251 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 21 01:22:39.809415 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.809281 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 21 01:22:39.809415 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.809281 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hmzxh\"" Jul 21 01:22:39.815647 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.815627 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 21 01:22:39.824764 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.824745 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7789f5dbd8-ppcw5"] Jul 21 01:22:39.824880 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.824793 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:39.827365 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.827348 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 21 01:22:39.827472 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.827427 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 21 01:22:39.827535 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.827517 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-g9h7v\"" Jul 21 01:22:39.827535 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.827532 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 21 01:22:39.828300 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.828233 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 21 01:22:39.833818 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.833776 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8"] Jul 21 01:22:39.833920 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.833894 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:39.836199 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.836180 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 21 01:22:39.836612 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.836595 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 21 01:22:39.836882 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.836866 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2qs48\"" Jul 21 01:22:39.836882 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.836874 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 21 01:22:39.837009 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.836917 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 21 01:22:39.837130 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.837110 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 21 01:22:39.837191 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.837129 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 21 01:22:39.837191 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.837142 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 21 01:22:39.850127 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.850105 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xfd6h"] Jul 21 01:22:39.850219 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.850137 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5"] Jul 21 01:22:39.850219 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.850167 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" Jul 21 01:22:39.850320 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.850167 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:22:39.853009 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.852992 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-t26bd\"" Jul 21 01:22:39.853194 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.853181 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 21 01:22:39.853256 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.853221 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-48mr4\"" Jul 21 01:22:39.853418 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.853406 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 21 01:22:39.853555 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.853537 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 01:22:39.853607 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.853571 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 21 01:22:39.853661 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.853611 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 01:22:39.853711 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.853681 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 21 01:22:39.860410 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.860394 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2"] Jul 21 01:22:39.860507 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.860494 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" Jul 21 01:22:39.863007 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.862983 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 21 01:22:39.863007 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.862996 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 21 01:22:39.863122 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.862992 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 21 01:22:39.863338 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.863323 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 21 01:22:39.863420 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.863406 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zzgx7\"" Jul 21 01:22:39.869137 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.869119 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-z4cnj"] Jul 21 01:22:39.869242 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.869228 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" Jul 21 01:22:39.871671 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.871656 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 21 01:22:39.871785 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.871771 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 21 01:22:39.871875 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.871863 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vm486\"" Jul 21 01:22:39.883207 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.883184 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk"] Jul 21 01:22:39.883299 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.883223 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p9cfq"] Jul 21 01:22:39.883299 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.883243 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55"] Jul 21 01:22:39.883299 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.883257 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-z4cnj" Jul 21 01:22:39.883299 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.883271 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-44fmn"] Jul 21 01:22:39.887469 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.887450 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7mdgv\"" Jul 21 01:22:39.895189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.895171 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6984fd67cf-xhr5k"] Jul 21 01:22:39.895295 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.895200 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7789f5dbd8-ppcw5"] Jul 21 01:22:39.895295 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.895215 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5"] Jul 21 01:22:39.895295 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.895230 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zdmk7"] Jul 21 01:22:39.895295 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.895229 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-44fmn" Jul 21 01:22:39.898007 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.897987 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gltw9\"" Jul 21 01:22:39.898007 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.898003 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 01:22:39.898171 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.898004 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 01:22:39.898171 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.898004 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 01:22:39.900433 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.900410 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8af6188a-42f9-4094-9176-2896eebb5955-image-registry-private-configuration\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:39.900515 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.900453 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-85b55\" (UID: \"a0c075c1-9809-4f62-a028-df0b723cfe23\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" Jul 21 01:22:39.900515 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.900478 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8bj5\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-kube-api-access-n8bj5\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:39.900607 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.900560 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq62k\" (UniqueName: \"kubernetes.io/projected/32b91753-c60e-4b08-badc-dc0773d8143b-kube-api-access-lq62k\") pod \"volume-data-source-validator-78cf4c6f6-p9cfq\" (UID: \"32b91753-c60e-4b08-badc-dc0773d8143b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p9cfq" Jul 21 01:22:39.900648 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.900618 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-tmp\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:39.900688 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.900645 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:39.900688 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.900673 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p59t\" (UniqueName: \"kubernetes.io/projected/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-kube-api-access-6p59t\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:39.900762 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.900719 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8af6188a-42f9-4094-9176-2896eebb5955-ca-trust-extracted\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:39.900762 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.900750 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8af6188a-42f9-4094-9176-2896eebb5955-registry-certificates\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:39.900884 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.900827 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-b7jkk\" (UID: \"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:22:39.900884 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.900859 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-snapshots\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:39.901167 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.900899 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-serving-cert\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:39.901167 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.900923 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djpq8\" (UniqueName: \"kubernetes.io/projected/a0c075c1-9809-4f62-a028-df0b723cfe23-kube-api-access-djpq8\") pod \"cluster-samples-operator-79b7c55f87-85b55\" (UID: \"a0c075c1-9809-4f62-a028-df0b723cfe23\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" Jul 21 01:22:39.901167 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.900945 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8af6188a-42f9-4094-9176-2896eebb5955-installation-pull-secrets\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:39.901167 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.900973 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b7jkk\" (UID: \"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:22:39.901167 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.901012 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:39.901416 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.901205 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dp8r\" (UniqueName: \"kubernetes.io/projected/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-kube-api-access-6dp8r\") pod \"cluster-monitoring-operator-76cf8966f8-b7jkk\" (UID: \"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:22:39.901416 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.901254 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8af6188a-42f9-4094-9176-2896eebb5955-trusted-ca\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:39.901416 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.901286 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-bound-sa-token\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:39.901416 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.901316 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-service-ca-bundle\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:39.909624 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.909599 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-6s4th"] Jul 21 01:22:39.909728 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.909658 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-44fmn"] Jul 21 01:22:39.909728 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.909681 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-z4cnj"] Jul 21 01:22:39.909728 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.909711 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8"] Jul 21 01:22:39.909884 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.909739 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2"] Jul 21 01:22:39.909884 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.909855 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zdmk7"] Jul 21 01:22:39.910097 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.910079 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:39.913418 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.913396 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 01:22:39.913501 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.913396 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 01:22:39.913501 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:39.913438 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wtqvb\"" Jul 21 01:22:40.002386 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.002358 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-service-ca-bundle\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:40.002556 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.002397 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d50086c-1067-4d0a-8c37-73f113f4161e-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-t66c8\" (UID: \"7d50086c-1067-4d0a-8c37-73f113f4161e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" Jul 21 01:22:40.002556 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.002426 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/73bb25b0-6876-4c1b-8fdd-fde15f47b714-trusted-ca\") pod \"console-operator-565b7b569d-6s4th\" (UID: \"73bb25b0-6876-4c1b-8fdd-fde15f47b714\") " pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:40.002556 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.002449 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:40.002556 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.002484 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d85b020-179c-45af-aa56-b2d590ec10b8-tmp-dir\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:40.002556 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.002518 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-85b55\" (UID: \"a0c075c1-9809-4f62-a028-df0b723cfe23\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" Jul 21 01:22:40.002722 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.002613 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:40.002722 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.002645 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl44n\" (UniqueName: \"kubernetes.io/projected/c5b6b6a0-c584-40dd-b282-138bac6eb9fb-kube-api-access-xl44n\") pod \"ingress-canary-44fmn\" (UID: \"c5b6b6a0-c584-40dd-b282-138bac6eb9fb\") " pod="openshift-ingress-canary/ingress-canary-44fmn" Jul 21 01:22:40.002722 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.002669 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8af6188a-42f9-4094-9176-2896eebb5955-ca-trust-extracted\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.002722 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.002620 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 01:22:40.002722 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.002698 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djpq8\" (UniqueName: \"kubernetes.io/projected/a0c075c1-9809-4f62-a028-df0b723cfe23-kube-api-access-djpq8\") pod \"cluster-samples-operator-79b7c55f87-85b55\" (UID: \"a0c075c1-9809-4f62-a028-df0b723cfe23\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" Jul 21 01:22:40.002958 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.002724 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8af6188a-42f9-4094-9176-2896eebb5955-installation-pull-secrets\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.002958 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.002762 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls podName:a0c075c1-9809-4f62-a028-df0b723cfe23 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:40.502738546 +0000 UTC m=+40.189387079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-85b55" (UID: "a0c075c1-9809-4f62-a028-df0b723cfe23") : secret "samples-operator-tls" not found Jul 21 01:22:40.002958 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.002783 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/73bb25b0-6876-4c1b-8fdd-fde15f47b714-serving-cert\") pod \"console-operator-565b7b569d-6s4th\" (UID: \"73bb25b0-6876-4c1b-8fdd-fde15f47b714\") " pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:40.002958 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.002948 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8eaec8a-3749-4230-be3b-735a598ef51c-serving-cert\") pod \"service-ca-operator-5bcbc94c78-pqpq5\" (UID: \"c8eaec8a-3749-4230-be3b-735a598ef51c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" Jul 21 01:22:40.003157 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003014 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8af6188a-42f9-4094-9176-2896eebb5955-trusted-ca\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.003157 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003060 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-service-ca-bundle\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:40.003157 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003063 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8af6188a-42f9-4094-9176-2896eebb5955-ca-trust-extracted\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.003157 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003068 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtxjz\" (UniqueName: \"kubernetes.io/projected/7d50086c-1067-4d0a-8c37-73f113f4161e-kube-api-access-rtxjz\") pod \"kube-storage-version-migrator-operator-7658d9b749-t66c8\" (UID: \"7d50086c-1067-4d0a-8c37-73f113f4161e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" Jul 21 01:22:40.003157 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003116 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-bound-sa-token\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.003157 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003135 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-9znl2\" (UID: \"a3871dc2-4b1d-48c5-9654-488e1c2eba0a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" Jul 21 01:22:40.003461 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003162 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62xc7\" (UniqueName: \"kubernetes.io/projected/c8eaec8a-3749-4230-be3b-735a598ef51c-kube-api-access-62xc7\") pod \"service-ca-operator-5bcbc94c78-pqpq5\" (UID: \"c8eaec8a-3749-4230-be3b-735a598ef51c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" Jul 21 01:22:40.003461 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003287 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9znl2\" (UID: \"a3871dc2-4b1d-48c5-9654-488e1c2eba0a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" Jul 21 01:22:40.003461 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003305 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lng6\" (UniqueName: \"kubernetes.io/projected/9255a818-3a1b-4d27-b06c-a668e13160fe-kube-api-access-6lng6\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:40.003461 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003335 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8af6188a-42f9-4094-9176-2896eebb5955-image-registry-private-configuration\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.003461 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003357 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8eaec8a-3749-4230-be3b-735a598ef51c-config\") pod \"service-ca-operator-5bcbc94c78-pqpq5\" (UID: \"c8eaec8a-3749-4230-be3b-735a598ef51c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" Jul 21 01:22:40.003716 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003462 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bj5\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-kube-api-access-n8bj5\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.003716 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003463 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:40.003716 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003521 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq62k\" (UniqueName: \"kubernetes.io/projected/32b91753-c60e-4b08-badc-dc0773d8143b-kube-api-access-lq62k\") pod \"volume-data-source-validator-78cf4c6f6-p9cfq\" (UID: \"32b91753-c60e-4b08-badc-dc0773d8143b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p9cfq" Jul 21 01:22:40.003716 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003577 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-tmp\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:40.003716 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003603 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p59t\" (UniqueName: \"kubernetes.io/projected/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-kube-api-access-6p59t\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:40.003716 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003635 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkjrb\" (UniqueName: \"kubernetes.io/projected/5d85b020-179c-45af-aa56-b2d590ec10b8-kube-api-access-kkjrb\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:40.003716 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003661 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73bb25b0-6876-4c1b-8fdd-fde15f47b714-config\") pod \"console-operator-565b7b569d-6s4th\" (UID: \"73bb25b0-6876-4c1b-8fdd-fde15f47b714\") " pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:40.003716 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003690 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-default-certificate\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:40.003716 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003714 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6qmd\" (UniqueName: \"kubernetes.io/projected/46779ea5-46c6-45e9-b5d0-b61a709c4fe2-kube-api-access-k6qmd\") pod \"network-check-source-7bc5b6bf85-z4cnj\" (UID: \"46779ea5-46c6-45e9-b5d0-b61a709c4fe2\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-z4cnj" Jul 21 01:22:40.004177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003746 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d50086c-1067-4d0a-8c37-73f113f4161e-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-t66c8\" (UID: \"7d50086c-1067-4d0a-8c37-73f113f4161e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" Jul 21 01:22:40.004177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003789 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-stats-auth\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:40.004177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003857 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8af6188a-42f9-4094-9176-2896eebb5955-registry-certificates\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.004177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003883 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5d85b020-179c-45af-aa56-b2d590ec10b8-config-volume\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:40.004177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003908 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5b6b6a0-c584-40dd-b282-138bac6eb9fb-cert\") pod \"ingress-canary-44fmn\" (UID: \"c5b6b6a0-c584-40dd-b282-138bac6eb9fb\") " pod="openshift-ingress-canary/ingress-canary-44fmn" Jul 21 01:22:40.004177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003927 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-tmp\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:40.004177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003939 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-b7jkk\" (UID: \"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:22:40.004177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003953 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8af6188a-42f9-4094-9176-2896eebb5955-trusted-ca\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.004177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.003972 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-snapshots\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:40.004177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.004001 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tvh2\" (UniqueName: \"kubernetes.io/projected/73bb25b0-6876-4c1b-8fdd-fde15f47b714-kube-api-access-9tvh2\") pod \"console-operator-565b7b569d-6s4th\" (UID: \"73bb25b0-6876-4c1b-8fdd-fde15f47b714\") " pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:40.004177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.004025 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-serving-cert\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:40.004177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.004047 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:40.004177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.004079 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:40.004177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.004108 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b7jkk\" (UID: \"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:22:40.004177 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.004188 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 01:22:40.004848 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.004241 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls podName:f1fd6a51-620f-4a81-83c1-1fdfc308cf6b nodeName:}" failed. No retries permitted until 2026-07-21 01:22:40.504226488 +0000 UTC m=+40.190875028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-b7jkk" (UID: "f1fd6a51-620f-4a81-83c1-1fdfc308cf6b") : secret "cluster-monitoring-operator-tls" not found Jul 21 01:22:40.004848 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.004265 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.004848 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.004290 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dp8r\" (UniqueName: \"kubernetes.io/projected/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-kube-api-access-6dp8r\") pod \"cluster-monitoring-operator-76cf8966f8-b7jkk\" (UID: \"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:22:40.004848 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.004332 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8af6188a-42f9-4094-9176-2896eebb5955-registry-certificates\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.004848 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.004408 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-snapshots\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:40.004848 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.004417 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 01:22:40.004848 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.004430 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6984fd67cf-xhr5k: secret "image-registry-tls" not found Jul 21 01:22:40.004848 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.004500 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls podName:8af6188a-42f9-4094-9176-2896eebb5955 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:40.50448565 +0000 UTC m=+40.191134187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls") pod "image-registry-6984fd67cf-xhr5k" (UID: "8af6188a-42f9-4094-9176-2896eebb5955") : secret "image-registry-tls" not found Jul 21 01:22:40.004848 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.004672 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-b7jkk\" (UID: \"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:22:40.007561 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.007536 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-serving-cert\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:40.007663 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.007599 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8af6188a-42f9-4094-9176-2896eebb5955-installation-pull-secrets\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.007663 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.007600 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8af6188a-42f9-4094-9176-2896eebb5955-image-registry-private-configuration\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.014498 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.014477 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djpq8\" (UniqueName: \"kubernetes.io/projected/a0c075c1-9809-4f62-a028-df0b723cfe23-kube-api-access-djpq8\") pod \"cluster-samples-operator-79b7c55f87-85b55\" (UID: \"a0c075c1-9809-4f62-a028-df0b723cfe23\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" Jul 21 01:22:40.016389 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.016367 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p59t\" (UniqueName: \"kubernetes.io/projected/b54a3b1b-9ca0-4912-9983-57ad08dafdd5-kube-api-access-6p59t\") pod \"insights-operator-555d9d7885-xfd6h\" (UID: \"b54a3b1b-9ca0-4912-9983-57ad08dafdd5\") " pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:40.017018 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.016995 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-bound-sa-token\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.017193 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.017173 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dp8r\" (UniqueName: \"kubernetes.io/projected/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-kube-api-access-6dp8r\") pod \"cluster-monitoring-operator-76cf8966f8-b7jkk\" (UID: \"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:22:40.017487 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.017468 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq62k\" (UniqueName: \"kubernetes.io/projected/32b91753-c60e-4b08-badc-dc0773d8143b-kube-api-access-lq62k\") pod \"volume-data-source-validator-78cf4c6f6-p9cfq\" (UID: \"32b91753-c60e-4b08-badc-dc0773d8143b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p9cfq" Jul 21 01:22:40.017526 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.017477 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8bj5\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-kube-api-access-n8bj5\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.045349 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.045319 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-xfd6h" Jul 21 01:22:40.092841 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.092812 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p9cfq" Jul 21 01:22:40.105551 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.105522 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d50086c-1067-4d0a-8c37-73f113f4161e-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-t66c8\" (UID: \"7d50086c-1067-4d0a-8c37-73f113f4161e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" Jul 21 01:22:40.105678 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.105571 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/73bb25b0-6876-4c1b-8fdd-fde15f47b714-trusted-ca\") pod \"console-operator-565b7b569d-6s4th\" (UID: \"73bb25b0-6876-4c1b-8fdd-fde15f47b714\") " pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:40.105678 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.105594 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:40.105678 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.105612 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d85b020-179c-45af-aa56-b2d590ec10b8-tmp-dir\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:40.105678 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.105660 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl44n\" (UniqueName: \"kubernetes.io/projected/c5b6b6a0-c584-40dd-b282-138bac6eb9fb-kube-api-access-xl44n\") pod \"ingress-canary-44fmn\" (UID: \"c5b6b6a0-c584-40dd-b282-138bac6eb9fb\") " pod="openshift-ingress-canary/ingress-canary-44fmn" Jul 21 01:22:40.105916 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.105690 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/73bb25b0-6876-4c1b-8fdd-fde15f47b714-serving-cert\") pod \"console-operator-565b7b569d-6s4th\" (UID: \"73bb25b0-6876-4c1b-8fdd-fde15f47b714\") " pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:40.105916 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.105725 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8eaec8a-3749-4230-be3b-735a598ef51c-serving-cert\") pod \"service-ca-operator-5bcbc94c78-pqpq5\" (UID: \"c8eaec8a-3749-4230-be3b-735a598ef51c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" Jul 21 01:22:40.105916 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.105757 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtxjz\" (UniqueName: \"kubernetes.io/projected/7d50086c-1067-4d0a-8c37-73f113f4161e-kube-api-access-rtxjz\") pod \"kube-storage-version-migrator-operator-7658d9b749-t66c8\" (UID: \"7d50086c-1067-4d0a-8c37-73f113f4161e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" Jul 21 01:22:40.105916 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.105907 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-9znl2\" (UID: \"a3871dc2-4b1d-48c5-9654-488e1c2eba0a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" Jul 21 01:22:40.106092 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.105934 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62xc7\" (UniqueName: \"kubernetes.io/projected/c8eaec8a-3749-4230-be3b-735a598ef51c-kube-api-access-62xc7\") pod \"service-ca-operator-5bcbc94c78-pqpq5\" (UID: \"c8eaec8a-3749-4230-be3b-735a598ef51c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" Jul 21 01:22:40.106092 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.105978 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9znl2\" (UID: \"a3871dc2-4b1d-48c5-9654-488e1c2eba0a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" Jul 21 01:22:40.106092 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.106005 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lng6\" (UniqueName: \"kubernetes.io/projected/9255a818-3a1b-4d27-b06c-a668e13160fe-kube-api-access-6lng6\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:40.106092 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.106038 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d85b020-179c-45af-aa56-b2d590ec10b8-tmp-dir\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:40.106092 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.106049 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8eaec8a-3749-4230-be3b-735a598ef51c-config\") pod \"service-ca-operator-5bcbc94c78-pqpq5\" (UID: \"c8eaec8a-3749-4230-be3b-735a598ef51c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" Jul 21 01:22:40.106972 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.106154 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 01:22:40.106972 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.106226 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls podName:5d85b020-179c-45af-aa56-b2d590ec10b8 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:40.606206563 +0000 UTC m=+40.292855096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls") pod "dns-default-zdmk7" (UID: "5d85b020-179c-45af-aa56-b2d590ec10b8") : secret "dns-default-metrics-tls" not found Jul 21 01:22:40.106972 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.106557 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/73bb25b0-6876-4c1b-8fdd-fde15f47b714-trusted-ca\") pod \"console-operator-565b7b569d-6s4th\" (UID: \"73bb25b0-6876-4c1b-8fdd-fde15f47b714\") " pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:40.106972 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.106592 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8eaec8a-3749-4230-be3b-735a598ef51c-config\") pod \"service-ca-operator-5bcbc94c78-pqpq5\" (UID: \"c8eaec8a-3749-4230-be3b-735a598ef51c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" Jul 21 01:22:40.106972 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.106668 2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 01:22:40.106972 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.106714 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert podName:a3871dc2-4b1d-48c5-9654-488e1c2eba0a nodeName:}" failed. No retries permitted until 2026-07-21 01:22:40.606698204 +0000 UTC m=+40.293346756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-9znl2" (UID: "a3871dc2-4b1d-48c5-9654-488e1c2eba0a") : secret "networking-console-plugin-cert" not found Jul 21 01:22:40.106972 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.106821 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkjrb\" (UniqueName: \"kubernetes.io/projected/5d85b020-179c-45af-aa56-b2d590ec10b8-kube-api-access-kkjrb\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:40.106972 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.106855 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73bb25b0-6876-4c1b-8fdd-fde15f47b714-config\") pod \"console-operator-565b7b569d-6s4th\" (UID: \"73bb25b0-6876-4c1b-8fdd-fde15f47b714\") " pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:40.106972 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.106884 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-default-certificate\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:40.106972 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.106910 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6qmd\" (UniqueName: \"kubernetes.io/projected/46779ea5-46c6-45e9-b5d0-b61a709c4fe2-kube-api-access-k6qmd\") pod \"network-check-source-7bc5b6bf85-z4cnj\" (UID: \"46779ea5-46c6-45e9-b5d0-b61a709c4fe2\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-z4cnj" Jul 21 01:22:40.106972 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.106939 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d50086c-1067-4d0a-8c37-73f113f4161e-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-t66c8\" (UID: \"7d50086c-1067-4d0a-8c37-73f113f4161e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" Jul 21 01:22:40.106972 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.106977 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-stats-auth\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:40.108650 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.107009 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5d85b020-179c-45af-aa56-b2d590ec10b8-config-volume\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:40.108650 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.107037 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5b6b6a0-c584-40dd-b282-138bac6eb9fb-cert\") pod \"ingress-canary-44fmn\" (UID: \"c5b6b6a0-c584-40dd-b282-138bac6eb9fb\") " pod="openshift-ingress-canary/ingress-canary-44fmn" Jul 21 01:22:40.108650 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.107067 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tvh2\" (UniqueName: \"kubernetes.io/projected/73bb25b0-6876-4c1b-8fdd-fde15f47b714-kube-api-access-9tvh2\") pod \"console-operator-565b7b569d-6s4th\" (UID: \"73bb25b0-6876-4c1b-8fdd-fde15f47b714\") " pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:40.108650 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.107097 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:40.108650 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.107121 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:40.108650 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.107268 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 01:22:40.108650 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.107318 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs podName:9255a818-3a1b-4d27-b06c-a668e13160fe nodeName:}" failed. No retries permitted until 2026-07-21 01:22:40.607302644 +0000 UTC m=+40.293951183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs") pod "router-default-7789f5dbd8-ppcw5" (UID: "9255a818-3a1b-4d27-b06c-a668e13160fe") : secret "router-metrics-certs-default" not found Jul 21 01:22:40.108650 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.107470 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73bb25b0-6876-4c1b-8fdd-fde15f47b714-config\") pod \"console-operator-565b7b569d-6s4th\" (UID: \"73bb25b0-6876-4c1b-8fdd-fde15f47b714\") " pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:40.108650 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.107603 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle podName:9255a818-3a1b-4d27-b06c-a668e13160fe nodeName:}" failed. No retries permitted until 2026-07-21 01:22:40.607584719 +0000 UTC m=+40.294233282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle") pod "router-default-7789f5dbd8-ppcw5" (UID: "9255a818-3a1b-4d27-b06c-a668e13160fe") : configmap references non-existent config key: service-ca.crt Jul 21 01:22:40.108650 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.107663 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d50086c-1067-4d0a-8c37-73f113f4161e-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-t66c8\" (UID: \"7d50086c-1067-4d0a-8c37-73f113f4161e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" Jul 21 01:22:40.108650 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.108028 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5d85b020-179c-45af-aa56-b2d590ec10b8-config-volume\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:40.108650 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.108343 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-9znl2\" (UID: \"a3871dc2-4b1d-48c5-9654-488e1c2eba0a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" Jul 21 01:22:40.108650 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.108631 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d50086c-1067-4d0a-8c37-73f113f4161e-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-t66c8\" (UID: \"7d50086c-1067-4d0a-8c37-73f113f4161e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" Jul 21 01:22:40.110670 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.110529 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/73bb25b0-6876-4c1b-8fdd-fde15f47b714-serving-cert\") pod \"console-operator-565b7b569d-6s4th\" (UID: \"73bb25b0-6876-4c1b-8fdd-fde15f47b714\") " pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:40.111231 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.111204 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8eaec8a-3749-4230-be3b-735a598ef51c-serving-cert\") pod \"service-ca-operator-5bcbc94c78-pqpq5\" (UID: \"c8eaec8a-3749-4230-be3b-735a598ef51c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" Jul 21 01:22:40.111527 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.111503 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-stats-auth\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:40.111527 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.111522 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5b6b6a0-c584-40dd-b282-138bac6eb9fb-cert\") pod \"ingress-canary-44fmn\" (UID: \"c5b6b6a0-c584-40dd-b282-138bac6eb9fb\") " pod="openshift-ingress-canary/ingress-canary-44fmn" Jul 21 01:22:40.111667 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.111559 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-default-certificate\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:40.116001 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.115972 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkjrb\" (UniqueName: \"kubernetes.io/projected/5d85b020-179c-45af-aa56-b2d590ec10b8-kube-api-access-kkjrb\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:40.116570 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.116549 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6qmd\" (UniqueName: \"kubernetes.io/projected/46779ea5-46c6-45e9-b5d0-b61a709c4fe2-kube-api-access-k6qmd\") pod \"network-check-source-7bc5b6bf85-z4cnj\" (UID: \"46779ea5-46c6-45e9-b5d0-b61a709c4fe2\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-z4cnj" Jul 21 01:22:40.116649 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.116605 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62xc7\" (UniqueName: \"kubernetes.io/projected/c8eaec8a-3749-4230-be3b-735a598ef51c-kube-api-access-62xc7\") pod \"service-ca-operator-5bcbc94c78-pqpq5\" (UID: \"c8eaec8a-3749-4230-be3b-735a598ef51c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" Jul 21 01:22:40.116737 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.116712 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtxjz\" (UniqueName: \"kubernetes.io/projected/7d50086c-1067-4d0a-8c37-73f113f4161e-kube-api-access-rtxjz\") pod \"kube-storage-version-migrator-operator-7658d9b749-t66c8\" (UID: \"7d50086c-1067-4d0a-8c37-73f113f4161e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" Jul 21 01:22:40.116910 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.116834 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl44n\" (UniqueName: \"kubernetes.io/projected/c5b6b6a0-c584-40dd-b282-138bac6eb9fb-kube-api-access-xl44n\") pod \"ingress-canary-44fmn\" (UID: \"c5b6b6a0-c584-40dd-b282-138bac6eb9fb\") " pod="openshift-ingress-canary/ingress-canary-44fmn" Jul 21 01:22:40.118059 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.118034 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lng6\" (UniqueName: \"kubernetes.io/projected/9255a818-3a1b-4d27-b06c-a668e13160fe-kube-api-access-6lng6\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:40.118185 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.118167 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tvh2\" (UniqueName: \"kubernetes.io/projected/73bb25b0-6876-4c1b-8fdd-fde15f47b714-kube-api-access-9tvh2\") pod \"console-operator-565b7b569d-6s4th\" (UID: \"73bb25b0-6876-4c1b-8fdd-fde15f47b714\") " pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:40.136323 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.136152 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:40.162292 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.162037 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" Jul 21 01:22:40.171081 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.171055 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" Jul 21 01:22:40.191822 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.191555 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-z4cnj" Jul 21 01:22:40.209881 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.209647 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-44fmn" Jul 21 01:22:40.251535 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.250968 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xfd6h"] Jul 21 01:22:40.274848 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.271889 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p9cfq"] Jul 21 01:22:40.276967 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:40.276461 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54a3b1b_9ca0_4912_9983_57ad08dafdd5.slice/crio-f288b9f399a6ec2cb40bdeba28ee08a5389129fb38cf36e9b4dea37698a08d07 WatchSource:0}: Error finding container f288b9f399a6ec2cb40bdeba28ee08a5389129fb38cf36e9b4dea37698a08d07: Status 404 returned error can't find the container with id f288b9f399a6ec2cb40bdeba28ee08a5389129fb38cf36e9b4dea37698a08d07 Jul 21 01:22:40.300252 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:40.299529 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b91753_c60e_4b08_badc_dc0773d8143b.slice/crio-a470e579b56f2400fb7a8001f07a4780abbcac5af0497bd94dbbe0c7b466d795 WatchSource:0}: Error finding container a470e579b56f2400fb7a8001f07a4780abbcac5af0497bd94dbbe0c7b466d795: Status 404 returned error can't find the container with id a470e579b56f2400fb7a8001f07a4780abbcac5af0497bd94dbbe0c7b466d795 Jul 21 01:22:40.354640 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.353105 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-6s4th"] Jul 21 01:22:40.355950 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:40.355903 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73bb25b0_6876_4c1b_8fdd_fde15f47b714.slice/crio-d993beeadbfd2c8eaf5be976c206dc7416abcaebd37a81ec6fd982c1c0b71adf WatchSource:0}: Error finding container d993beeadbfd2c8eaf5be976c206dc7416abcaebd37a81ec6fd982c1c0b71adf: Status 404 returned error can't find the container with id d993beeadbfd2c8eaf5be976c206dc7416abcaebd37a81ec6fd982c1c0b71adf Jul 21 01:22:40.384694 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.384613 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8"] Jul 21 01:22:40.389386 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:40.389348 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d50086c_1067_4d0a_8c37_73f113f4161e.slice/crio-d3d044c7e8cb8359cc6b874ad6082a64bf803bcdece4a02df91bd10b3876e0b5 WatchSource:0}: Error finding container d3d044c7e8cb8359cc6b874ad6082a64bf803bcdece4a02df91bd10b3876e0b5: Status 404 returned error can't find the container with id d3d044c7e8cb8359cc6b874ad6082a64bf803bcdece4a02df91bd10b3876e0b5 Jul 21 01:22:40.396580 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.396553 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5"] Jul 21 01:22:40.399706 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:40.399683 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8eaec8a_3749_4230_be3b_735a598ef51c.slice/crio-c5fc111a32350ccc949d93694674a9623201e6b685cd86cdadfd28268ba2be52 WatchSource:0}: Error finding container c5fc111a32350ccc949d93694674a9623201e6b685cd86cdadfd28268ba2be52: Status 404 returned error can't find the container with id c5fc111a32350ccc949d93694674a9623201e6b685cd86cdadfd28268ba2be52 Jul 21 01:22:40.407375 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.407352 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-z4cnj"] Jul 21 01:22:40.409759 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:40.409719 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46779ea5_46c6_45e9_b5d0_b61a709c4fe2.slice/crio-2b8f1a1f6ea41a09a4ca996c1e6d9c1dcadca860a5e0c5bcad148e4bda3c3572 WatchSource:0}: Error finding container 2b8f1a1f6ea41a09a4ca996c1e6d9c1dcadca860a5e0c5bcad148e4bda3c3572: Status 404 returned error can't find the container with id 2b8f1a1f6ea41a09a4ca996c1e6d9c1dcadca860a5e0c5bcad148e4bda3c3572 Jul 21 01:22:40.426186 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.426159 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-44fmn"] Jul 21 01:22:40.428958 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:22:40.428935 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5b6b6a0_c584_40dd_b282_138bac6eb9fb.slice/crio-c41380f471bdd7e08043efa40550b5b9604f2e72c761d3e9b74778b83f179427 WatchSource:0}: Error finding container c41380f471bdd7e08043efa40550b5b9604f2e72c761d3e9b74778b83f179427: Status 404 returned error can't find the container with id c41380f471bdd7e08043efa40550b5b9604f2e72c761d3e9b74778b83f179427 Jul 21 01:22:40.518889 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.518780 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b7jkk\" (UID: \"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:22:40.518889 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.518836 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:40.518889 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.518874 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-85b55\" (UID: \"a0c075c1-9809-4f62-a028-df0b723cfe23\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" Jul 21 01:22:40.519092 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.518936 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 01:22:40.519092 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.518991 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 01:22:40.519092 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.519000 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 01:22:40.519092 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.519009 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls podName:f1fd6a51-620f-4a81-83c1-1fdfc308cf6b nodeName:}" failed. No retries permitted until 2026-07-21 01:22:41.518987497 +0000 UTC m=+41.205636030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-b7jkk" (UID: "f1fd6a51-620f-4a81-83c1-1fdfc308cf6b") : secret "cluster-monitoring-operator-tls" not found Jul 21 01:22:40.519092 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.519011 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6984fd67cf-xhr5k: secret "image-registry-tls" not found Jul 21 01:22:40.519092 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.519043 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls podName:a0c075c1-9809-4f62-a028-df0b723cfe23 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:41.519032339 +0000 UTC m=+41.205680872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-85b55" (UID: "a0c075c1-9809-4f62-a028-df0b723cfe23") : secret "samples-operator-tls" not found Jul 21 01:22:40.519092 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.519056 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls podName:8af6188a-42f9-4094-9176-2896eebb5955 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:41.519049738 +0000 UTC m=+41.205698272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls") pod "image-registry-6984fd67cf-xhr5k" (UID: "8af6188a-42f9-4094-9176-2896eebb5955") : secret "image-registry-tls" not found Jul 21 01:22:40.620288 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.620256 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9znl2\" (UID: \"a3871dc2-4b1d-48c5-9654-488e1c2eba0a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" Jul 21 01:22:40.620484 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.620356 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:40.620484 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.620386 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:40.620484 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.620404 2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 01:22:40.620484 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.620441 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:40.620484 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.620468 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert podName:a3871dc2-4b1d-48c5-9654-488e1c2eba0a nodeName:}" failed. No retries permitted until 2026-07-21 01:22:41.620452834 +0000 UTC m=+41.307101369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-9znl2" (UID: "a3871dc2-4b1d-48c5-9654-488e1c2eba0a") : secret "networking-console-plugin-cert" not found Jul 21 01:22:40.620693 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.620503 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle podName:9255a818-3a1b-4d27-b06c-a668e13160fe nodeName:}" failed. No retries permitted until 2026-07-21 01:22:41.620488522 +0000 UTC m=+41.307137059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle") pod "router-default-7789f5dbd8-ppcw5" (UID: "9255a818-3a1b-4d27-b06c-a668e13160fe") : configmap references non-existent config key: service-ca.crt Jul 21 01:22:40.620693 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.620518 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 01:22:40.620693 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.620564 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 01:22:40.620693 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.620566 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls podName:5d85b020-179c-45af-aa56-b2d590ec10b8 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:41.620552901 +0000 UTC m=+41.307201439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls") pod "dns-default-zdmk7" (UID: "5d85b020-179c-45af-aa56-b2d590ec10b8") : secret "dns-default-metrics-tls" not found Jul 21 01:22:40.620693 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:40.620615 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs podName:9255a818-3a1b-4d27-b06c-a668e13160fe nodeName:}" failed. No retries permitted until 2026-07-21 01:22:41.620604461 +0000 UTC m=+41.307252994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs") pod "router-default-7789f5dbd8-ppcw5" (UID: "9255a818-3a1b-4d27-b06c-a668e13160fe") : secret "router-metrics-certs-default" not found Jul 21 01:22:40.831226 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.831141 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:22:40.831437 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.831330 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:22:40.834136 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.834114 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qrsnk\"" Jul 21 01:22:40.834664 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.834198 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 01:22:40.834848 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:40.834265 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 01:22:41.046058 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:41.045963 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-44fmn" event={"ID":"c5b6b6a0-c584-40dd-b282-138bac6eb9fb","Type":"ContainerStarted","Data":"c41380f471bdd7e08043efa40550b5b9604f2e72c761d3e9b74778b83f179427"} Jul 21 01:22:41.051268 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:41.051185 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-z4cnj" event={"ID":"46779ea5-46c6-45e9-b5d0-b61a709c4fe2","Type":"ContainerStarted","Data":"2b8f1a1f6ea41a09a4ca996c1e6d9c1dcadca860a5e0c5bcad148e4bda3c3572"} Jul 21 01:22:41.055544 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:41.055473 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" event={"ID":"c8eaec8a-3749-4230-be3b-735a598ef51c","Type":"ContainerStarted","Data":"c5fc111a32350ccc949d93694674a9623201e6b685cd86cdadfd28268ba2be52"} Jul 21 01:22:41.057345 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:41.057278 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" event={"ID":"7d50086c-1067-4d0a-8c37-73f113f4161e","Type":"ContainerStarted","Data":"d3d044c7e8cb8359cc6b874ad6082a64bf803bcdece4a02df91bd10b3876e0b5"} Jul 21 01:22:41.059042 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:41.058978 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p9cfq" event={"ID":"32b91753-c60e-4b08-badc-dc0773d8143b","Type":"ContainerStarted","Data":"a470e579b56f2400fb7a8001f07a4780abbcac5af0497bd94dbbe0c7b466d795"} Jul 21 01:22:41.064042 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:41.063968 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" event={"ID":"73bb25b0-6876-4c1b-8fdd-fde15f47b714","Type":"ContainerStarted","Data":"d993beeadbfd2c8eaf5be976c206dc7416abcaebd37a81ec6fd982c1c0b71adf"} Jul 21 01:22:41.065867 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:41.065787 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xfd6h" event={"ID":"b54a3b1b-9ca0-4912-9983-57ad08dafdd5","Type":"ContainerStarted","Data":"f288b9f399a6ec2cb40bdeba28ee08a5389129fb38cf36e9b4dea37698a08d07"} Jul 21 01:22:41.531351 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:41.530381 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b7jkk\" (UID: \"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:22:41.531351 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:41.530435 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:41.531351 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:41.530486 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-85b55\" (UID: \"a0c075c1-9809-4f62-a028-df0b723cfe23\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" Jul 21 01:22:41.531351 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:41.530611 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 01:22:41.531351 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:41.530678 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls podName:a0c075c1-9809-4f62-a028-df0b723cfe23 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:43.530658492 +0000 UTC m=+43.217307026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-85b55" (UID: "a0c075c1-9809-4f62-a028-df0b723cfe23") : secret "samples-operator-tls" not found Jul 21 01:22:41.531351 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:41.531144 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 01:22:41.531351 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:41.531200 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls podName:f1fd6a51-620f-4a81-83c1-1fdfc308cf6b nodeName:}" failed. No retries permitted until 2026-07-21 01:22:43.531183953 +0000 UTC m=+43.217832491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-b7jkk" (UID: "f1fd6a51-620f-4a81-83c1-1fdfc308cf6b") : secret "cluster-monitoring-operator-tls" not found Jul 21 01:22:41.531351 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:41.531267 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 01:22:41.531351 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:41.531278 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6984fd67cf-xhr5k: secret "image-registry-tls" not found Jul 21 01:22:41.531351 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:41.531310 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls podName:8af6188a-42f9-4094-9176-2896eebb5955 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:43.531299133 +0000 UTC m=+43.217947672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls") pod "image-registry-6984fd67cf-xhr5k" (UID: "8af6188a-42f9-4094-9176-2896eebb5955") : secret "image-registry-tls" not found Jul 21 01:22:41.633053 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:41.631920 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9znl2\" (UID: \"a3871dc2-4b1d-48c5-9654-488e1c2eba0a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" Jul 21 01:22:41.633053 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:41.632050 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:41.633053 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:41.632086 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:41.633053 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:41.632152 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:41.633053 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:41.632333 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 01:22:41.633053 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:41.632395 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls podName:5d85b020-179c-45af-aa56-b2d590ec10b8 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:43.63237703 +0000 UTC m=+43.319025748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls") pod "dns-default-zdmk7" (UID: "5d85b020-179c-45af-aa56-b2d590ec10b8") : secret "dns-default-metrics-tls" not found Jul 21 01:22:41.633053 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:41.632824 2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 01:22:41.633053 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:41.632875 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert podName:a3871dc2-4b1d-48c5-9654-488e1c2eba0a nodeName:}" failed. No retries permitted until 2026-07-21 01:22:43.632859835 +0000 UTC m=+43.319508371 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-9znl2" (UID: "a3871dc2-4b1d-48c5-9654-488e1c2eba0a") : secret "networking-console-plugin-cert" not found Jul 21 01:22:41.633053 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:41.632944 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle podName:9255a818-3a1b-4d27-b06c-a668e13160fe nodeName:}" failed. No retries permitted until 2026-07-21 01:22:43.632934833 +0000 UTC m=+43.319583381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle") pod "router-default-7789f5dbd8-ppcw5" (UID: "9255a818-3a1b-4d27-b06c-a668e13160fe") : configmap references non-existent config key: service-ca.crt Jul 21 01:22:41.633053 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:41.632999 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 01:22:41.633053 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:41.633028 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs podName:9255a818-3a1b-4d27-b06c-a668e13160fe nodeName:}" failed. No retries permitted until 2026-07-21 01:22:43.633018344 +0000 UTC m=+43.319666891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs") pod "router-default-7789f5dbd8-ppcw5" (UID: "9255a818-3a1b-4d27-b06c-a668e13160fe") : secret "router-metrics-certs-default" not found Jul 21 01:22:43.077549 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:43.077339 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p9cfq" event={"ID":"32b91753-c60e-4b08-badc-dc0773d8143b","Type":"ContainerStarted","Data":"3f8fa73733f1a0097df15d998f9a7e653dd90753e2f754df174c5cf816d50ba7"} Jul 21 01:22:43.094690 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:43.094629 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p9cfq" podStartSLOduration=39.416066234 podStartE2EDuration="41.094608499s" totalImagesPullingTime="1.678542265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:43.093754128 +0000 UTC m=+42.780402683" watchObservedRunningTime="2026-07-21 01:22:43.094608499 +0000 UTC m=+42.781257058" Jul 21 01:22:43.551304 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:43.551265 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b7jkk\" (UID: \"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:22:43.551304 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:43.551313 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:43.551563 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:43.551410 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-85b55\" (UID: \"a0c075c1-9809-4f62-a028-df0b723cfe23\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" Jul 21 01:22:43.551563 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:43.551431 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 01:22:43.551563 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:43.551481 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 01:22:43.551563 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:43.551495 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6984fd67cf-xhr5k: secret "image-registry-tls" not found Jul 21 01:22:43.551563 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:43.551539 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 01:22:43.551776 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:43.551541 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls podName:f1fd6a51-620f-4a81-83c1-1fdfc308cf6b nodeName:}" failed. No retries permitted until 2026-07-21 01:22:47.551522061 +0000 UTC m=+47.238170612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-b7jkk" (UID: "f1fd6a51-620f-4a81-83c1-1fdfc308cf6b") : secret "cluster-monitoring-operator-tls" not found Jul 21 01:22:43.551776 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:43.551589 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls podName:8af6188a-42f9-4094-9176-2896eebb5955 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:47.551578445 +0000 UTC m=+47.238226978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls") pod "image-registry-6984fd67cf-xhr5k" (UID: "8af6188a-42f9-4094-9176-2896eebb5955") : secret "image-registry-tls" not found Jul 21 01:22:43.551776 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:43.551602 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls podName:a0c075c1-9809-4f62-a028-df0b723cfe23 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:47.551594269 +0000 UTC m=+47.238242817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-85b55" (UID: "a0c075c1-9809-4f62-a028-df0b723cfe23") : secret "samples-operator-tls" not found Jul 21 01:22:43.652683 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:43.652648 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9znl2\" (UID: \"a3871dc2-4b1d-48c5-9654-488e1c2eba0a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" Jul 21 01:22:43.652887 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:43.652731 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:43.652887 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:43.652860 2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 01:22:43.653009 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:43.652863 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle podName:9255a818-3a1b-4d27-b06c-a668e13160fe nodeName:}" failed. No retries permitted until 2026-07-21 01:22:47.652846088 +0000 UTC m=+47.339494620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle") pod "router-default-7789f5dbd8-ppcw5" (UID: "9255a818-3a1b-4d27-b06c-a668e13160fe") : configmap references non-existent config key: service-ca.crt Jul 21 01:22:43.653009 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:43.652942 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:43.653116 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:43.653016 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:43.653116 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:43.653048 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 01:22:43.653116 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:43.653087 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert podName:a3871dc2-4b1d-48c5-9654-488e1c2eba0a nodeName:}" failed. No retries permitted until 2026-07-21 01:22:47.653053905 +0000 UTC m=+47.339702445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-9znl2" (UID: "a3871dc2-4b1d-48c5-9654-488e1c2eba0a") : secret "networking-console-plugin-cert" not found Jul 21 01:22:43.653116 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:43.653109 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs podName:9255a818-3a1b-4d27-b06c-a668e13160fe nodeName:}" failed. No retries permitted until 2026-07-21 01:22:47.653098726 +0000 UTC m=+47.339747299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs") pod "router-default-7789f5dbd8-ppcw5" (UID: "9255a818-3a1b-4d27-b06c-a668e13160fe") : secret "router-metrics-certs-default" not found Jul 21 01:22:43.653264 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:43.653131 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 01:22:43.653264 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:43.653170 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls podName:5d85b020-179c-45af-aa56-b2d590ec10b8 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:47.653160551 +0000 UTC m=+47.339809084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls") pod "dns-default-zdmk7" (UID: "5d85b020-179c-45af-aa56-b2d590ec10b8") : secret "dns-default-metrics-tls" not found Jul 21 01:22:47.594463 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:47.594211 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-85b55\" (UID: \"a0c075c1-9809-4f62-a028-df0b723cfe23\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" Jul 21 01:22:47.595033 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:47.594941 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b7jkk\" (UID: \"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:22:47.595033 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:47.594988 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:47.600854 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:47.597186 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 01:22:47.600854 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:47.597275 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls podName:a0c075c1-9809-4f62-a028-df0b723cfe23 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:55.597254585 +0000 UTC m=+55.283903121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-85b55" (UID: "a0c075c1-9809-4f62-a028-df0b723cfe23") : secret "samples-operator-tls" not found Jul 21 01:22:47.600854 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:47.597278 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 01:22:47.600854 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:47.597313 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6984fd67cf-xhr5k: secret "image-registry-tls" not found Jul 21 01:22:47.600854 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:47.597370 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls podName:8af6188a-42f9-4094-9176-2896eebb5955 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:55.597355972 +0000 UTC m=+55.284004509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls") pod "image-registry-6984fd67cf-xhr5k" (UID: "8af6188a-42f9-4094-9176-2896eebb5955") : secret "image-registry-tls" not found Jul 21 01:22:47.600854 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:47.597430 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 01:22:47.600854 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:47.597462 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls podName:f1fd6a51-620f-4a81-83c1-1fdfc308cf6b nodeName:}" failed. No retries permitted until 2026-07-21 01:22:55.597449979 +0000 UTC m=+55.284098512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-b7jkk" (UID: "f1fd6a51-620f-4a81-83c1-1fdfc308cf6b") : secret "cluster-monitoring-operator-tls" not found Jul 21 01:22:47.696116 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:47.696073 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:47.696116 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:47.696130 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:47.696375 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:47.696193 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:47.696375 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:47.696275 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9znl2\" (UID: \"a3871dc2-4b1d-48c5-9654-488e1c2eba0a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" Jul 21 01:22:47.696479 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:47.696440 2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 01:22:47.696530 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:47.696503 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert podName:a3871dc2-4b1d-48c5-9654-488e1c2eba0a nodeName:}" failed. No retries permitted until 2026-07-21 01:22:55.696485155 +0000 UTC m=+55.383133694 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-9znl2" (UID: "a3871dc2-4b1d-48c5-9654-488e1c2eba0a") : secret "networking-console-plugin-cert" not found Jul 21 01:22:47.696905 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:47.696720 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 01:22:47.696905 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:47.696787 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs podName:9255a818-3a1b-4d27-b06c-a668e13160fe nodeName:}" failed. No retries permitted until 2026-07-21 01:22:55.696768665 +0000 UTC m=+55.383417203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs") pod "router-default-7789f5dbd8-ppcw5" (UID: "9255a818-3a1b-4d27-b06c-a668e13160fe") : secret "router-metrics-certs-default" not found Jul 21 01:22:47.696905 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:47.696881 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle podName:9255a818-3a1b-4d27-b06c-a668e13160fe nodeName:}" failed. No retries permitted until 2026-07-21 01:22:55.696869902 +0000 UTC m=+55.383518438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle") pod "router-default-7789f5dbd8-ppcw5" (UID: "9255a818-3a1b-4d27-b06c-a668e13160fe") : configmap references non-existent config key: service-ca.crt Jul 21 01:22:47.697125 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:47.696930 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 01:22:47.697125 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:47.696969 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls podName:5d85b020-179c-45af-aa56-b2d590ec10b8 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:55.696956938 +0000 UTC m=+55.383605478 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls") pod "dns-default-zdmk7" (UID: "5d85b020-179c-45af-aa56-b2d590ec10b8") : secret "dns-default-metrics-tls" not found Jul 21 01:22:48.093289 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:48.093242 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-44fmn" event={"ID":"c5b6b6a0-c584-40dd-b282-138bac6eb9fb","Type":"ContainerStarted","Data":"62fa1fd540383cd71b6aca63606b72f279aa8a3a7bf9ef065f25c7115a2adbd7"} Jul 21 01:22:48.094916 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:48.094887 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-z4cnj" event={"ID":"46779ea5-46c6-45e9-b5d0-b61a709c4fe2","Type":"ContainerStarted","Data":"0ea5167dcf6a4b80b78f5715740e89ec8788fc97710466deddd67806b91dd44a"} Jul 21 01:22:48.096353 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:48.096329 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" event={"ID":"c8eaec8a-3749-4230-be3b-735a598ef51c","Type":"ContainerStarted","Data":"35f5cc4cb3e644ff7fe998c68f25353288a563c54deb0258d8f9e15dc1172d10"} Jul 21 01:22:48.098220 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:48.098174 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" event={"ID":"7d50086c-1067-4d0a-8c37-73f113f4161e","Type":"ContainerStarted","Data":"45f2c8c8d7a3f259ca794ac5cf7db0eb477d7ef7e0643b36af1ebe232ef20b2d"} Jul 21 01:22:48.100159 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:48.100142 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/0.log" Jul 21 01:22:48.100258 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:48.100174 2553 generic.go:356] "Generic (PLEG): container finished" podID="73bb25b0-6876-4c1b-8fdd-fde15f47b714" containerID="1a592c28a35f4a0f733982c6334a6785b7191dbdf4526421467cecfcea62317f" exitCode=255 Jul 21 01:22:48.100352 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:48.100332 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" event={"ID":"73bb25b0-6876-4c1b-8fdd-fde15f47b714","Type":"ContainerDied","Data":"1a592c28a35f4a0f733982c6334a6785b7191dbdf4526421467cecfcea62317f"} Jul 21 01:22:48.100469 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:48.100433 2553 scope.go:117] "RemoveContainer" containerID="1a592c28a35f4a0f733982c6334a6785b7191dbdf4526421467cecfcea62317f" Jul 21 01:22:48.102364 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:48.102345 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xfd6h" event={"ID":"b54a3b1b-9ca0-4912-9983-57ad08dafdd5","Type":"ContainerStarted","Data":"93203b5f32abdc33981b38e79ffd3934228564b9ae39c440f26fa6bb91a3f14a"} Jul 21 01:22:48.110112 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:48.110073 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-44fmn" podStartSLOduration=2.138737515 podStartE2EDuration="9.110061208s" totalImagesPullingTime="6.971323693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:48.109360052 +0000 UTC m=+47.796008608" watchObservedRunningTime="2026-07-21 01:22:48.110061208 +0000 UTC m=+47.796709762" Jul 21 01:22:48.133592 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:48.133396 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-xfd6h" podStartSLOduration=39.009109512 podStartE2EDuration="46.133380272s" totalImagesPullingTime="7.12427076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:48.132055088 +0000 UTC m=+47.818703645" watchObservedRunningTime="2026-07-21 01:22:48.133380272 +0000 UTC m=+47.820028818" Jul 21 01:22:48.170418 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:48.170352 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" podStartSLOduration=36.160106601 podStartE2EDuration="43.170327819s" totalImagesPullingTime="7.010221218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:48.168327627 +0000 UTC m=+47.854976183" watchObservedRunningTime="2026-07-21 01:22:48.170327819 +0000 UTC m=+47.856976375" Jul 21 01:22:48.187294 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:48.187233 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-z4cnj" podStartSLOduration=33.186025033 podStartE2EDuration="40.18721778s" totalImagesPullingTime="7.001192747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:48.186052878 +0000 UTC m=+47.872701434" watchObservedRunningTime="2026-07-21 01:22:48.18721778 +0000 UTC m=+47.873866333" Jul 21 01:22:49.108137 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.108110 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/1.log" Jul 21 01:22:49.108633 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.108617 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/0.log" Jul 21 01:22:49.108683 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.108662 2553 generic.go:356] "Generic (PLEG): container finished" podID="73bb25b0-6876-4c1b-8fdd-fde15f47b714" containerID="18f0d90a317dc30ac03fe4d7314bc48a3c96442cb3c7ff31eaa7a3bb0f9deacf" exitCode=255 Jul 21 01:22:49.108860 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.108769 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" event={"ID":"73bb25b0-6876-4c1b-8fdd-fde15f47b714","Type":"ContainerDied","Data":"18f0d90a317dc30ac03fe4d7314bc48a3c96442cb3c7ff31eaa7a3bb0f9deacf"} Jul 21 01:22:49.108965 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.108901 2553 scope.go:117] "RemoveContainer" containerID="1a592c28a35f4a0f733982c6334a6785b7191dbdf4526421467cecfcea62317f" Jul 21 01:22:49.109900 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.109838 2553 scope.go:117] "RemoveContainer" containerID="18f0d90a317dc30ac03fe4d7314bc48a3c96442cb3c7ff31eaa7a3bb0f9deacf" Jul 21 01:22:49.110490 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:49.110463 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-6s4th_openshift-console-operator(73bb25b0-6876-4c1b-8fdd-fde15f47b714)\"" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" podUID="73bb25b0-6876-4c1b-8fdd-fde15f47b714" Jul 21 01:22:49.133904 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.133846 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" podStartSLOduration=35.133256407 podStartE2EDuration="42.133826983s" totalImagesPullingTime="7.000570576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:48.203026511 +0000 UTC m=+47.889675067" watchObservedRunningTime="2026-07-21 01:22:49.133826983 +0000 UTC m=+48.820475538" Jul 21 01:22:49.344625 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.344579 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9vf8g"] Jul 21 01:22:49.364444 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.364368 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9vf8g"] Jul 21 01:22:49.364602 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.364483 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:49.367707 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.367685 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 01:22:49.367899 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.367879 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 01:22:49.369463 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.369424 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fx296\"" Jul 21 01:22:49.422429 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.422376 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a40d3be0-6f40-4051-b315-bd86c50f939c-data-volume\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:49.422622 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.422440 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:49.422622 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.422498 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:49.422622 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.422549 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a40d3be0-6f40-4051-b315-bd86c50f939c-crio-socket\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:49.422754 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.422634 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfslc\" (UniqueName: \"kubernetes.io/projected/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-api-access-bfslc\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:49.523153 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.523106 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfslc\" (UniqueName: \"kubernetes.io/projected/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-api-access-bfslc\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:49.523350 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.523173 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a40d3be0-6f40-4051-b315-bd86c50f939c-data-volume\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:49.523350 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.523200 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:49.523350 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.523230 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:49.523350 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.523285 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a40d3be0-6f40-4051-b315-bd86c50f939c-crio-socket\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:49.523350 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:49.523315 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 01:22:49.523609 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:49.523390 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm podName:a40d3be0-6f40-4051-b315-bd86c50f939c nodeName:}" failed. No retries permitted until 2026-07-21 01:22:50.023369244 +0000 UTC m=+49.710017779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9vf8g" (UID: "a40d3be0-6f40-4051-b315-bd86c50f939c") : configmap "kube-rbac-proxy" not found Jul 21 01:22:49.523609 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:49.523531 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 01:22:49.523609 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:49.523580 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls podName:a40d3be0-6f40-4051-b315-bd86c50f939c nodeName:}" failed. No retries permitted until 2026-07-21 01:22:50.023568346 +0000 UTC m=+49.710216879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9vf8g" (UID: "a40d3be0-6f40-4051-b315-bd86c50f939c") : secret "insights-runtime-extractor-tls" not found Jul 21 01:22:49.523609 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.523591 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a40d3be0-6f40-4051-b315-bd86c50f939c-crio-socket\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:49.523770 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.523588 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a40d3be0-6f40-4051-b315-bd86c50f939c-data-volume\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:49.535840 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:49.535814 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfslc\" (UniqueName: \"kubernetes.io/projected/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-api-access-bfslc\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:50.028430 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:50.028378 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:50.028636 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:50.028458 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:50.028636 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:50.028510 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 01:22:50.028636 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:50.028591 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm podName:a40d3be0-6f40-4051-b315-bd86c50f939c nodeName:}" failed. No retries permitted until 2026-07-21 01:22:51.028571815 +0000 UTC m=+50.715220349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9vf8g" (UID: "a40d3be0-6f40-4051-b315-bd86c50f939c") : configmap "kube-rbac-proxy" not found Jul 21 01:22:50.028636 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:50.028603 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 01:22:50.028845 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:50.028665 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls podName:a40d3be0-6f40-4051-b315-bd86c50f939c nodeName:}" failed. No retries permitted until 2026-07-21 01:22:51.028648171 +0000 UTC m=+50.715296730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9vf8g" (UID: "a40d3be0-6f40-4051-b315-bd86c50f939c") : secret "insights-runtime-extractor-tls" not found Jul 21 01:22:50.113085 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:50.113057 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/1.log" Jul 21 01:22:50.113456 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:50.113442 2553 scope.go:117] "RemoveContainer" containerID="18f0d90a317dc30ac03fe4d7314bc48a3c96442cb3c7ff31eaa7a3bb0f9deacf" Jul 21 01:22:50.113649 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:50.113626 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-6s4th_openshift-console-operator(73bb25b0-6876-4c1b-8fdd-fde15f47b714)\"" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" podUID="73bb25b0-6876-4c1b-8fdd-fde15f47b714" Jul 21 01:22:50.136892 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:50.136858 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:50.137070 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:50.136944 2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:22:51.037130 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:51.037088 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:51.037310 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:51.037149 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:51.037310 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:51.037221 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 01:22:51.037310 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:51.037286 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm podName:a40d3be0-6f40-4051-b315-bd86c50f939c nodeName:}" failed. No retries permitted until 2026-07-21 01:22:53.037271256 +0000 UTC m=+52.723919789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9vf8g" (UID: "a40d3be0-6f40-4051-b315-bd86c50f939c") : configmap "kube-rbac-proxy" not found Jul 21 01:22:51.037419 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:51.037324 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 01:22:51.037419 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:51.037387 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls podName:a40d3be0-6f40-4051-b315-bd86c50f939c nodeName:}" failed. No retries permitted until 2026-07-21 01:22:53.037373077 +0000 UTC m=+52.724021610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9vf8g" (UID: "a40d3be0-6f40-4051-b315-bd86c50f939c") : secret "insights-runtime-extractor-tls" not found Jul 21 01:22:51.116026 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:51.115995 2553 scope.go:117] "RemoveContainer" containerID="18f0d90a317dc30ac03fe4d7314bc48a3c96442cb3c7ff31eaa7a3bb0f9deacf" Jul 21 01:22:51.116425 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:51.116179 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-6s4th_openshift-console-operator(73bb25b0-6876-4c1b-8fdd-fde15f47b714)\"" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" podUID="73bb25b0-6876-4c1b-8fdd-fde15f47b714" Jul 21 01:22:51.739854 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:51.739828 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dfxqd_8fbee072-3882-4927-832c-417b526001f8/dns-node-resolver/0.log" Jul 21 01:22:52.939506 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:52.939476 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t99s5_832d95fc-ede2-4c3f-88df-2e819c834774/node-ca/0.log" Jul 21 01:22:53.054718 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:53.054680 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:53.054908 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:53.054858 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:53.054908 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:53.054862 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 01:22:53.054908 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:53.054894 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 01:22:53.055009 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:53.054948 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls podName:a40d3be0-6f40-4051-b315-bd86c50f939c nodeName:}" failed. No retries permitted until 2026-07-21 01:22:57.054932019 +0000 UTC m=+56.741580553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9vf8g" (UID: "a40d3be0-6f40-4051-b315-bd86c50f939c") : secret "insights-runtime-extractor-tls" not found Jul 21 01:22:53.055009 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:53.054964 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm podName:a40d3be0-6f40-4051-b315-bd86c50f939c nodeName:}" failed. No retries permitted until 2026-07-21 01:22:57.054956917 +0000 UTC m=+56.741605449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9vf8g" (UID: "a40d3be0-6f40-4051-b315-bd86c50f939c") : configmap "kube-rbac-proxy" not found Jul 21 01:22:53.339161 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:53.339105 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-44fmn_c5b6b6a0-c584-40dd-b282-138bac6eb9fb/serve-healthcheck-canary/0.log" Jul 21 01:22:54.140831 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:54.140784 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-t66c8_7d50086c-1067-4d0a-8c37-73f113f4161e/kube-storage-version-migrator-operator/0.log" Jul 21 01:22:55.679665 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:55.679618 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b7jkk\" (UID: \"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:22:55.679665 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:55.679664 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:22:55.680172 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:55.679701 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-85b55\" (UID: \"a0c075c1-9809-4f62-a028-df0b723cfe23\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" Jul 21 01:22:55.680172 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:55.679779 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 01:22:55.680172 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:55.679837 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 01:22:55.680172 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:55.679854 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6984fd67cf-xhr5k: secret "image-registry-tls" not found Jul 21 01:22:55.680172 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:55.679864 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls podName:f1fd6a51-620f-4a81-83c1-1fdfc308cf6b nodeName:}" failed. No retries permitted until 2026-07-21 01:23:11.679846 +0000 UTC m=+71.366494533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-b7jkk" (UID: "f1fd6a51-620f-4a81-83c1-1fdfc308cf6b") : secret "cluster-monitoring-operator-tls" not found Jul 21 01:22:55.680172 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:55.679891 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls podName:8af6188a-42f9-4094-9176-2896eebb5955 nodeName:}" failed. No retries permitted until 2026-07-21 01:23:11.679879421 +0000 UTC m=+71.366527953 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls") pod "image-registry-6984fd67cf-xhr5k" (UID: "8af6188a-42f9-4094-9176-2896eebb5955") : secret "image-registry-tls" not found Jul 21 01:22:55.682360 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:55.682339 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0c075c1-9809-4f62-a028-df0b723cfe23-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-85b55\" (UID: \"a0c075c1-9809-4f62-a028-df0b723cfe23\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" Jul 21 01:22:55.780823 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:55.780773 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9znl2\" (UID: \"a3871dc2-4b1d-48c5-9654-488e1c2eba0a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" Jul 21 01:22:55.781014 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:55.780871 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:55.781014 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:55.780890 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:22:55.781014 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:55.780938 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:22:55.781014 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:55.780943 2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 01:22:55.781179 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:55.781023 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 01:22:55.781179 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:55.781033 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 01:22:55.781179 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:55.781029 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert podName:a3871dc2-4b1d-48c5-9654-488e1c2eba0a nodeName:}" failed. No retries permitted until 2026-07-21 01:23:11.781012326 +0000 UTC m=+71.467660858 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-9znl2" (UID: "a3871dc2-4b1d-48c5-9654-488e1c2eba0a") : secret "networking-console-plugin-cert" not found Jul 21 01:22:55.781179 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:55.781077 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle podName:9255a818-3a1b-4d27-b06c-a668e13160fe nodeName:}" failed. No retries permitted until 2026-07-21 01:23:11.78106491 +0000 UTC m=+71.467713442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle") pod "router-default-7789f5dbd8-ppcw5" (UID: "9255a818-3a1b-4d27-b06c-a668e13160fe") : configmap references non-existent config key: service-ca.crt Jul 21 01:22:55.781179 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:55.781088 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs podName:9255a818-3a1b-4d27-b06c-a668e13160fe nodeName:}" failed. No retries permitted until 2026-07-21 01:23:11.781081943 +0000 UTC m=+71.467730475 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs") pod "router-default-7789f5dbd8-ppcw5" (UID: "9255a818-3a1b-4d27-b06c-a668e13160fe") : secret "router-metrics-certs-default" not found Jul 21 01:22:55.781179 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:55.781097 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls podName:5d85b020-179c-45af-aa56-b2d590ec10b8 nodeName:}" failed. No retries permitted until 2026-07-21 01:23:11.781092569 +0000 UTC m=+71.467741102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls") pod "dns-default-zdmk7" (UID: "5d85b020-179c-45af-aa56-b2d590ec10b8") : secret "dns-default-metrics-tls" not found Jul 21 01:22:55.981982 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:55.981949 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" Jul 21 01:22:56.140290 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:56.140257 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55"] Jul 21 01:22:57.092739 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:57.092702 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:57.092739 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:57.092756 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:22:57.093235 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:57.092870 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 01:22:57.093235 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:57.092957 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm podName:a40d3be0-6f40-4051-b315-bd86c50f939c nodeName:}" failed. No retries permitted until 2026-07-21 01:23:05.092935593 +0000 UTC m=+64.779584141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9vf8g" (UID: "a40d3be0-6f40-4051-b315-bd86c50f939c") : configmap "kube-rbac-proxy" not found Jul 21 01:22:57.093235 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:57.092987 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 01:22:57.093235 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:22:57.093046 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls podName:a40d3be0-6f40-4051-b315-bd86c50f939c nodeName:}" failed. No retries permitted until 2026-07-21 01:23:05.093030488 +0000 UTC m=+64.779679026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9vf8g" (UID: "a40d3be0-6f40-4051-b315-bd86c50f939c") : secret "insights-runtime-extractor-tls" not found Jul 21 01:22:57.136581 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:57.136546 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" event={"ID":"a0c075c1-9809-4f62-a028-df0b723cfe23","Type":"ContainerStarted","Data":"19e8be886701d32cfbe4069c184f6c60a37d8e41a5af8ce80bfc021422388bb9"} Jul 21 01:22:59.145385 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:59.145349 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" event={"ID":"a0c075c1-9809-4f62-a028-df0b723cfe23","Type":"ContainerStarted","Data":"8505298aba4af16ffc84e224d2c45b9e5107a3bc0bff3e27db981da0683474e1"} Jul 21 01:22:59.145785 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:59.145402 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" event={"ID":"a0c075c1-9809-4f62-a028-df0b723cfe23","Type":"ContainerStarted","Data":"7125d580e8612f1adecb31f3bd6e829e9db29a0b5a2ca241be6b72370f1bb8d9"} Jul 21 01:22:59.172744 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:22:59.172692 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-85b55" podStartSLOduration=54.84458344 podStartE2EDuration="57.172677346s" totalImagesPullingTime="2.328093906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:59.171436655 +0000 UTC m=+58.858085210" watchObservedRunningTime="2026-07-21 01:22:59.172677346 +0000 UTC m=+58.859325901" Jul 21 01:23:05.019379 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:05.019351 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jdsfw" Jul 21 01:23:05.172280 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:05.172239 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:23:05.172476 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:05.172310 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:23:05.172772 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:05.172749 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a40d3be0-6f40-4051-b315-bd86c50f939c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:23:05.174774 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:05.174749 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a40d3be0-6f40-4051-b315-bd86c50f939c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vf8g\" (UID: \"a40d3be0-6f40-4051-b315-bd86c50f939c\") " pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:23:05.281699 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:05.281618 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fx296\"" Jul 21 01:23:05.289120 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:05.289090 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9vf8g" Jul 21 01:23:05.419745 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:05.419691 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9vf8g"] Jul 21 01:23:05.422871 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:23:05.422843 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda40d3be0_6f40_4051_b315_bd86c50f939c.slice/crio-fc1bdb53b9cc2c4795aea7c4b1f25463a215c8a6e4d9784966dfab5eda62d502 WatchSource:0}: Error finding container fc1bdb53b9cc2c4795aea7c4b1f25463a215c8a6e4d9784966dfab5eda62d502: Status 404 returned error can't find the container with id fc1bdb53b9cc2c4795aea7c4b1f25463a215c8a6e4d9784966dfab5eda62d502 Jul 21 01:23:05.830172 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:05.830142 2553 scope.go:117] "RemoveContainer" containerID="18f0d90a317dc30ac03fe4d7314bc48a3c96442cb3c7ff31eaa7a3bb0f9deacf" Jul 21 01:23:06.182812 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.182762 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:23:06.183740 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.183593 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/1.log" Jul 21 01:23:06.183740 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.183638 2553 generic.go:356] "Generic (PLEG): container finished" podID="73bb25b0-6876-4c1b-8fdd-fde15f47b714" containerID="bb3a2ace1cef25367b283f5f11d2dc204999f9f20a40abcee45103384b80af33" exitCode=255 Jul 21 01:23:06.183740 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.183717 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" event={"ID":"73bb25b0-6876-4c1b-8fdd-fde15f47b714","Type":"ContainerDied","Data":"bb3a2ace1cef25367b283f5f11d2dc204999f9f20a40abcee45103384b80af33"} Jul 21 01:23:06.183976 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.183845 2553 scope.go:117] "RemoveContainer" containerID="18f0d90a317dc30ac03fe4d7314bc48a3c96442cb3c7ff31eaa7a3bb0f9deacf" Jul 21 01:23:06.184230 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.184213 2553 scope.go:117] "RemoveContainer" containerID="bb3a2ace1cef25367b283f5f11d2dc204999f9f20a40abcee45103384b80af33" Jul 21 01:23:06.184421 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:23:06.184402 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-6s4th_openshift-console-operator(73bb25b0-6876-4c1b-8fdd-fde15f47b714)\"" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" podUID="73bb25b0-6876-4c1b-8fdd-fde15f47b714" Jul 21 01:23:06.186133 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.186065 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9vf8g" event={"ID":"a40d3be0-6f40-4051-b315-bd86c50f939c","Type":"ContainerStarted","Data":"fc1bdb53b9cc2c4795aea7c4b1f25463a215c8a6e4d9784966dfab5eda62d502"} Jul 21 01:23:06.585474 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.585434 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:23:06.585785 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.585488 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs\") pod \"network-metrics-daemon-zmvvl\" (UID: \"00543583-912d-4354-8810-fc0e9f4a54be\") " pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:23:06.585785 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.585632 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j87hc\" (UniqueName: \"kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc\") pod \"network-check-target-jln5h\" (UID: \"aa4beaba-0f0c-4f29-ac98-24ab6a629f60\") " pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:23:06.588505 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.588482 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 01:23:06.588731 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.588531 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 01:23:06.588827 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.588767 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j87hc\" (UniqueName: \"kubernetes.io/projected/aa4beaba-0f0c-4f29-ac98-24ab6a629f60-kube-api-access-j87hc\") pod \"network-check-target-jln5h\" (UID: \"aa4beaba-0f0c-4f29-ac98-24ab6a629f60\") " pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:23:06.598547 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.598520 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47b65ca9-dc09-4748-a6db-6a40b0b156aa-original-pull-secret\") pod \"global-pull-secret-syncer-gssj9\" (UID: \"47b65ca9-dc09-4748-a6db-6a40b0b156aa\") " pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:23:06.598855 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.598834 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00543583-912d-4354-8810-fc0e9f4a54be-metrics-certs\") pod \"network-metrics-daemon-zmvvl\" (UID: \"00543583-912d-4354-8810-fc0e9f4a54be\") " pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:23:06.650914 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.650882 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qrsnk\"" Jul 21 01:23:06.655573 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.655545 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gssj9" Jul 21 01:23:06.659072 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.659053 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmvvl" Jul 21 01:23:06.820684 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.820649 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zmvvl"] Jul 21 01:23:06.824523 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:23:06.824495 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00543583_912d_4354_8810_fc0e9f4a54be.slice/crio-e82708ee9ab8e59dc1a5dfa395accfc95104e50b470fa3dd395b5367b8f127aa WatchSource:0}: Error finding container e82708ee9ab8e59dc1a5dfa395accfc95104e50b470fa3dd395b5367b8f127aa: Status 404 returned error can't find the container with id e82708ee9ab8e59dc1a5dfa395accfc95104e50b470fa3dd395b5367b8f127aa Jul 21 01:23:06.838028 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.838007 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gssj9"] Jul 21 01:23:06.840957 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:23:06.840916 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b65ca9_dc09_4748_a6db_6a40b0b156aa.slice/crio-e690dc5188f86b808295314c0192b43a1c810444d1554d166b99e26f6fe8ce49 WatchSource:0}: Error finding container e690dc5188f86b808295314c0192b43a1c810444d1554d166b99e26f6fe8ce49: Status 404 returned error can't find the container with id e690dc5188f86b808295314c0192b43a1c810444d1554d166b99e26f6fe8ce49 Jul 21 01:23:06.868432 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.868405 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-48mr4\"" Jul 21 01:23:06.875925 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:06.875832 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:23:07.023093 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:07.023059 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jln5h"] Jul 21 01:23:07.026837 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:23:07.026774 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4beaba_0f0c_4f29_ac98_24ab6a629f60.slice/crio-79b76a7fab29041c54db2f82bb45ef83313a30bd71840740f4ab8262b3a9b708 WatchSource:0}: Error finding container 79b76a7fab29041c54db2f82bb45ef83313a30bd71840740f4ab8262b3a9b708: Status 404 returned error can't find the container with id 79b76a7fab29041c54db2f82bb45ef83313a30bd71840740f4ab8262b3a9b708 Jul 21 01:23:07.191973 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:07.191929 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jln5h" event={"ID":"aa4beaba-0f0c-4f29-ac98-24ab6a629f60","Type":"ContainerStarted","Data":"09f7ad18fe6b8f1925264208e32647e29120124d7e904e7b81daed0f3e1d0a8e"} Jul 21 01:23:07.192409 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:07.191989 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jln5h" event={"ID":"aa4beaba-0f0c-4f29-ac98-24ab6a629f60","Type":"ContainerStarted","Data":"79b76a7fab29041c54db2f82bb45ef83313a30bd71840740f4ab8262b3a9b708"} Jul 21 01:23:07.192409 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:07.192039 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:23:07.193753 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:07.193721 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zmvvl" event={"ID":"00543583-912d-4354-8810-fc0e9f4a54be","Type":"ContainerStarted","Data":"e82708ee9ab8e59dc1a5dfa395accfc95104e50b470fa3dd395b5367b8f127aa"} Jul 21 01:23:07.195249 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:07.195200 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gssj9" event={"ID":"47b65ca9-dc09-4748-a6db-6a40b0b156aa","Type":"ContainerStarted","Data":"e690dc5188f86b808295314c0192b43a1c810444d1554d166b99e26f6fe8ce49"} Jul 21 01:23:07.197216 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:07.197196 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:23:10.136963 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:10.136932 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:23:10.137358 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:10.136991 2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:23:10.137358 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:10.137297 2553 scope.go:117] "RemoveContainer" containerID="bb3a2ace1cef25367b283f5f11d2dc204999f9f20a40abcee45103384b80af33" Jul 21 01:23:10.137461 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:23:10.137442 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-6s4th_openshift-console-operator(73bb25b0-6876-4c1b-8fdd-fde15f47b714)\"" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" podUID="73bb25b0-6876-4c1b-8fdd-fde15f47b714" Jul 21 01:23:10.155741 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:10.155689 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jln5h" podStartSLOduration=70.155673102 podStartE2EDuration="1m10.155673102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:07.225648724 +0000 UTC m=+66.912297283" watchObservedRunningTime="2026-07-21 01:23:10.155673102 +0000 UTC m=+69.842321665" Jul 21 01:23:11.738425 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.738382 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b7jkk\" (UID: \"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:23:11.738425 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.738425 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:23:11.741390 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.741364 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls\") pod \"image-registry-6984fd67cf-xhr5k\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:23:11.741518 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.741392 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1fd6a51-620f-4a81-83c1-1fdfc308cf6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b7jkk\" (UID: \"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:23:11.839550 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.839510 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:23:11.839709 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.839568 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9znl2\" (UID: \"a3871dc2-4b1d-48c5-9654-488e1c2eba0a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" Jul 21 01:23:11.839709 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.839614 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:23:11.839709 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.839631 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:23:11.840267 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.840237 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9255a818-3a1b-4d27-b06c-a668e13160fe-service-ca-bundle\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:23:11.841989 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.841969 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d85b020-179c-45af-aa56-b2d590ec10b8-metrics-tls\") pod \"dns-default-zdmk7\" (UID: \"5d85b020-179c-45af-aa56-b2d590ec10b8\") " pod="openshift-dns/dns-default-zdmk7" Jul 21 01:23:11.842647 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.842627 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9255a818-3a1b-4d27-b06c-a668e13160fe-metrics-certs\") pod \"router-default-7789f5dbd8-ppcw5\" (UID: \"9255a818-3a1b-4d27-b06c-a668e13160fe\") " pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:23:11.842647 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.842640 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3871dc2-4b1d-48c5-9654-488e1c2eba0a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9znl2\" (UID: \"a3871dc2-4b1d-48c5-9654-488e1c2eba0a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" Jul 21 01:23:11.864710 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.864684 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7tn6h\"" Jul 21 01:23:11.872147 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.872125 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" Jul 21 01:23:11.919227 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.919197 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hmzxh\"" Jul 21 01:23:11.926526 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.926498 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:23:11.944447 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.944423 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2qs48\"" Jul 21 01:23:11.951819 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.951774 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:23:11.982286 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.982251 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vm486\"" Jul 21 01:23:11.988842 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:11.988754 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" Jul 21 01:23:12.023667 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:12.023643 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wtqvb\"" Jul 21 01:23:12.032030 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:12.032005 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zdmk7" Jul 21 01:23:12.775934 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:12.774144 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk"] Jul 21 01:23:12.791233 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:23:12.791195 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1fd6a51_620f_4a81_83c1_1fdfc308cf6b.slice/crio-738bc45f45f7c7f95dbf5c78be63853244dbe6a06fe0ceda2139ffb0882191d9 WatchSource:0}: Error finding container 738bc45f45f7c7f95dbf5c78be63853244dbe6a06fe0ceda2139ffb0882191d9: Status 404 returned error can't find the container with id 738bc45f45f7c7f95dbf5c78be63853244dbe6a06fe0ceda2139ffb0882191d9 Jul 21 01:23:12.822323 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:12.818139 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7789f5dbd8-ppcw5"] Jul 21 01:23:12.856143 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:12.856115 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zdmk7"] Jul 21 01:23:12.857510 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:12.857458 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6984fd67cf-xhr5k"] Jul 21 01:23:12.860988 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:23:12.860959 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d85b020_179c_45af_aa56_b2d590ec10b8.slice/crio-fd464d8e0af4bbdc04f4eba059e25b005119de039a87242590a1621378cbf81e WatchSource:0}: Error finding container fd464d8e0af4bbdc04f4eba059e25b005119de039a87242590a1621378cbf81e: Status 404 returned error can't find the container with id fd464d8e0af4bbdc04f4eba059e25b005119de039a87242590a1621378cbf81e Jul 21 01:23:12.861685 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:23:12.861634 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af6188a_42f9_4094_9176_2896eebb5955.slice/crio-fc50b01aef155fef76586c65c94568e1eed553704bd54ad701ec517ef7ef2c51 WatchSource:0}: Error finding container fc50b01aef155fef76586c65c94568e1eed553704bd54ad701ec517ef7ef2c51: Status 404 returned error can't find the container with id fc50b01aef155fef76586c65c94568e1eed553704bd54ad701ec517ef7ef2c51 Jul 21 01:23:13.008852 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.008721 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2"] Jul 21 01:23:13.012690 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:23:13.012659 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3871dc2_4b1d_48c5_9654_488e1c2eba0a.slice/crio-0fb005c568934d124f3d116bbd32f1a3c133b5ba199681516169cee95e4e6090 WatchSource:0}: Error finding container 0fb005c568934d124f3d116bbd32f1a3c133b5ba199681516169cee95e4e6090: Status 404 returned error can't find the container with id 0fb005c568934d124f3d116bbd32f1a3c133b5ba199681516169cee95e4e6090 Jul 21 01:23:13.221193 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.221157 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9vf8g" event={"ID":"a40d3be0-6f40-4051-b315-bd86c50f939c","Type":"ContainerStarted","Data":"05623a1a53829a714fb7d26f66c430bfe7f3f2e43c4896f2d8ad953b2c3b6630"} Jul 21 01:23:13.222689 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.222664 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" event={"ID":"9255a818-3a1b-4d27-b06c-a668e13160fe","Type":"ContainerStarted","Data":"5f67714cd13e1e2d5a5dfe57372eedba18cd9332aec36c1050d29433f7662e0f"} Jul 21 01:23:13.222832 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.222700 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" event={"ID":"9255a818-3a1b-4d27-b06c-a668e13160fe","Type":"ContainerStarted","Data":"418e7c425cc81de376321185366a671248019a9867ee5f318a8ba7e850743727"} Jul 21 01:23:13.224342 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.224157 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" event={"ID":"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b","Type":"ContainerStarted","Data":"738bc45f45f7c7f95dbf5c78be63853244dbe6a06fe0ceda2139ffb0882191d9"} Jul 21 01:23:13.230385 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.230355 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" event={"ID":"a3871dc2-4b1d-48c5-9654-488e1c2eba0a","Type":"ContainerStarted","Data":"0fb005c568934d124f3d116bbd32f1a3c133b5ba199681516169cee95e4e6090"} Jul 21 01:23:13.232233 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.232194 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zmvvl" event={"ID":"00543583-912d-4354-8810-fc0e9f4a54be","Type":"ContainerStarted","Data":"b1fe734ebc05e4c8186394c89507ad06fa11bc4360c31e3a407447ca32866695"} Jul 21 01:23:13.232344 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.232242 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zmvvl" event={"ID":"00543583-912d-4354-8810-fc0e9f4a54be","Type":"ContainerStarted","Data":"128b043095e185c73433b8bfb7ad3350959f232db638abb9ad062b8cb53abc43"} Jul 21 01:23:13.233741 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.233719 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gssj9" event={"ID":"47b65ca9-dc09-4748-a6db-6a40b0b156aa","Type":"ContainerStarted","Data":"ddf9b06287a5bb2a8fc3e7930f18b7e23966e292e9a92e250a99e3ba995e5889"} Jul 21 01:23:13.234930 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.234909 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zdmk7" event={"ID":"5d85b020-179c-45af-aa56-b2d590ec10b8","Type":"ContainerStarted","Data":"fd464d8e0af4bbdc04f4eba059e25b005119de039a87242590a1621378cbf81e"} Jul 21 01:23:13.236308 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.236289 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" event={"ID":"8af6188a-42f9-4094-9176-2896eebb5955","Type":"ContainerStarted","Data":"5436ed9c687bf2e2707c9de118bb3f3dc7ffe1c7f0cba12e0c58678ea53d87de"} Jul 21 01:23:13.236407 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.236318 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" event={"ID":"8af6188a-42f9-4094-9176-2896eebb5955","Type":"ContainerStarted","Data":"fc50b01aef155fef76586c65c94568e1eed553704bd54ad701ec517ef7ef2c51"} Jul 21 01:23:13.236479 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.236415 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:23:13.249232 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.249183 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" podStartSLOduration=71.249167611 podStartE2EDuration="1m11.249167611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:13.247748823 +0000 UTC m=+72.934397391" watchObservedRunningTime="2026-07-21 01:23:13.249167611 +0000 UTC m=+72.935816167" Jul 21 01:23:13.256351 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.256322 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m"] Jul 21 01:23:13.259959 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.259936 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" Jul 21 01:23:13.263303 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.263201 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 21 01:23:13.263303 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.263248 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 21 01:23:13.263303 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.263257 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 21 01:23:13.263581 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.263560 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 21 01:23:13.273753 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.273725 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m"] Jul 21 01:23:13.281243 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.281179 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gssj9" podStartSLOduration=66.614179747 podStartE2EDuration="1m12.281158074s" totalImagesPullingTime="5.666978327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:13.281093702 +0000 UTC m=+72.967742256" watchObservedRunningTime="2026-07-21 01:23:13.281158074 +0000 UTC m=+72.967806634" Jul 21 01:23:13.313217 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.313163 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" podStartSLOduration=72.313145797 podStartE2EDuration="1m12.313145797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:13.31247577 +0000 UTC m=+72.999124326" watchObservedRunningTime="2026-07-21 01:23:13.313145797 +0000 UTC m=+72.999794352" Jul 21 01:23:13.358484 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.358260 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6-tmp\") pod \"klusterlet-addon-workmgr-768f59cc59-ct89m\" (UID: \"0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" Jul 21 01:23:13.358484 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.358365 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6-klusterlet-config\") pod \"klusterlet-addon-workmgr-768f59cc59-ct89m\" (UID: \"0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" Jul 21 01:23:13.358484 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.358399 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2ht7\" (UniqueName: \"kubernetes.io/projected/0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6-kube-api-access-b2ht7\") pod \"klusterlet-addon-workmgr-768f59cc59-ct89m\" (UID: \"0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" Jul 21 01:23:13.376638 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.375532 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zmvvl" podStartSLOduration=66.692121081 podStartE2EDuration="1m12.37550807s" totalImagesPullingTime="5.683386989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:13.343927254 +0000 UTC m=+73.030575810" watchObservedRunningTime="2026-07-21 01:23:13.37550807 +0000 UTC m=+73.062156627" Jul 21 01:23:13.460379 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.459337 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6-klusterlet-config\") pod \"klusterlet-addon-workmgr-768f59cc59-ct89m\" (UID: \"0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" Jul 21 01:23:13.460379 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.459392 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2ht7\" (UniqueName: \"kubernetes.io/projected/0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6-kube-api-access-b2ht7\") pod \"klusterlet-addon-workmgr-768f59cc59-ct89m\" (UID: \"0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" Jul 21 01:23:13.460379 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.459436 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6-tmp\") pod \"klusterlet-addon-workmgr-768f59cc59-ct89m\" (UID: \"0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" Jul 21 01:23:13.460379 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.459960 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6-tmp\") pod \"klusterlet-addon-workmgr-768f59cc59-ct89m\" (UID: \"0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" Jul 21 01:23:13.469456 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.469399 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6-klusterlet-config\") pod \"klusterlet-addon-workmgr-768f59cc59-ct89m\" (UID: \"0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" Jul 21 01:23:13.472181 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.472086 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2ht7\" (UniqueName: \"kubernetes.io/projected/0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6-kube-api-access-b2ht7\") pod \"klusterlet-addon-workmgr-768f59cc59-ct89m\" (UID: \"0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" Jul 21 01:23:13.570707 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.570621 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" Jul 21 01:23:13.758965 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.758890 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m"] Jul 21 01:23:13.953026 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.952942 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:23:13.956232 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:13.956208 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:23:14.244976 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:14.244938 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" event={"ID":"0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6","Type":"ContainerStarted","Data":"00e1ec12d33fca20fa87a714a36bd5a7f6353d3b8cec04919d9b00c3bc551cc0"} Jul 21 01:23:14.245496 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:14.245475 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:23:14.246961 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:14.246939 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7789f5dbd8-ppcw5" Jul 21 01:23:21.281534 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:21.281394 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9vf8g" event={"ID":"a40d3be0-6f40-4051-b315-bd86c50f939c","Type":"ContainerStarted","Data":"26b12104e5a08bbf7c28f81f0e2df9cf99cb55c923a612fa7b8fd6e9180d13d4"} Jul 21 01:23:21.283541 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:21.283507 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" event={"ID":"a3871dc2-4b1d-48c5-9654-488e1c2eba0a","Type":"ContainerStarted","Data":"3c082aa356d6b33746c2ed4d626defd7e4f5f3399283cd94cf29fc3ad3d7088a"} Jul 21 01:23:21.285378 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:21.285349 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" event={"ID":"f1fd6a51-620f-4a81-83c1-1fdfc308cf6b","Type":"ContainerStarted","Data":"58156095f77d4da0f4920929cbcf70c65bfaa20c3c5499c49814887d68650644"} Jul 21 01:23:21.286847 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:21.286766 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zdmk7" event={"ID":"5d85b020-179c-45af-aa56-b2d590ec10b8","Type":"ContainerStarted","Data":"17d576593fd496af1c411b75847b070dae17f8b361153c9c6f6220cc76794395"} Jul 21 01:23:21.288478 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:21.288421 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" event={"ID":"0e5123c9-7d38-4c8d-b3bf-fb08c135bdd6","Type":"ContainerStarted","Data":"f168762f8bc53e552ad98254d8cde75de64ece0ab8d263a8c77501675ccaf17c"} Jul 21 01:23:21.300816 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:21.300487 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" Jul 21 01:23:21.302467 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:21.302414 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" Jul 21 01:23:21.338684 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:21.337629 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b7jkk" podStartSLOduration=71.564040953 podStartE2EDuration="1m19.337607312s" totalImagesPullingTime="7.773566359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:21.336467132 +0000 UTC m=+81.023115688" watchObservedRunningTime="2026-07-21 01:23:21.337607312 +0000 UTC m=+81.024255869" Jul 21 01:23:21.338684 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:21.338193 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9znl2" podStartSLOduration=41.117693066 podStartE2EDuration="47.338178668s" totalImagesPullingTime="6.220485602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:21.318904661 +0000 UTC m=+81.005553217" watchObservedRunningTime="2026-07-21 01:23:21.338178668 +0000 UTC m=+81.024827223" Jul 21 01:23:21.355613 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:21.355549 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-768f59cc59-ct89m" podStartSLOduration=1.010084336 podStartE2EDuration="8.355525847s" totalImagesPullingTime="7.345441511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:21.354186516 +0000 UTC m=+81.040835073" watchObservedRunningTime="2026-07-21 01:23:21.355525847 +0000 UTC m=+81.042174404" Jul 21 01:23:22.295836 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:22.295774 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zdmk7" event={"ID":"5d85b020-179c-45af-aa56-b2d590ec10b8","Type":"ContainerStarted","Data":"6d336edb9faced9edf0c50050ecb951858b78ea1e196d5e1f69e82ef5b7bce71"} Jul 21 01:23:22.313963 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:22.313908 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zdmk7" podStartSLOduration=35.610631694 podStartE2EDuration="43.313885843s" totalImagesPullingTime="7.703254149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:22.313393749 +0000 UTC m=+82.000042315" watchObservedRunningTime="2026-07-21 01:23:22.313885843 +0000 UTC m=+82.000534399" Jul 21 01:23:22.830113 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:22.830021 2553 scope.go:117] "RemoveContainer" containerID="bb3a2ace1cef25367b283f5f11d2dc204999f9f20a40abcee45103384b80af33" Jul 21 01:23:22.830316 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:23:22.830267 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-6s4th_openshift-console-operator(73bb25b0-6876-4c1b-8fdd-fde15f47b714)\"" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" podUID="73bb25b0-6876-4c1b-8fdd-fde15f47b714" Jul 21 01:23:23.300645 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:23.300611 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zdmk7" Jul 21 01:23:25.310298 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:25.310261 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9vf8g" event={"ID":"a40d3be0-6f40-4051-b315-bd86c50f939c","Type":"ContainerStarted","Data":"50e58e43f1961c02e15d4456b78da1f49d2d4e1e9ebb59f48180a41a768dc065"} Jul 21 01:23:25.336107 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:25.336060 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9vf8g" podStartSLOduration=17.191746109 podStartE2EDuration="36.336035324s" totalImagesPullingTime="19.144289215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:25.334882956 +0000 UTC m=+85.021531537" watchObservedRunningTime="2026-07-21 01:23:25.336035324 +0000 UTC m=+85.022683870" Jul 21 01:23:33.307159 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:33.307126 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zdmk7" Jul 21 01:23:34.129679 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.129638 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9dssm"] Jul 21 01:23:34.135721 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.135692 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.138208 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.138181 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 01:23:34.138376 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.138357 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6twlm\"" Jul 21 01:23:34.138738 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.138725 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 01:23:34.139755 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.139732 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 01:23:34.139888 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.139759 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 01:23:34.239274 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.239236 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-tls\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.239274 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.239273 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xdnw\" (UniqueName: \"kubernetes.io/projected/7bb12194-2b28-413b-9f03-42f8b0405385-kube-api-access-5xdnw\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.239481 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.239313 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.239481 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.239358 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-wtmp\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.239481 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.239381 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-accelerators-collector-config\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.239481 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.239399 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-textfile\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.239481 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.239465 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7bb12194-2b28-413b-9f03-42f8b0405385-root\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.239630 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.239518 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bb12194-2b28-413b-9f03-42f8b0405385-metrics-client-ca\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.239630 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.239536 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bb12194-2b28-413b-9f03-42f8b0405385-sys\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.250223 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.250197 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:23:34.340644 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.340608 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bb12194-2b28-413b-9f03-42f8b0405385-metrics-client-ca\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.341151 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.340663 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bb12194-2b28-413b-9f03-42f8b0405385-sys\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.341151 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.340742 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bb12194-2b28-413b-9f03-42f8b0405385-sys\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.341151 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.340853 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-tls\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.341151 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.340884 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xdnw\" (UniqueName: \"kubernetes.io/projected/7bb12194-2b28-413b-9f03-42f8b0405385-kube-api-access-5xdnw\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.341151 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.340981 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.341151 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.341017 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-wtmp\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.341151 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.341044 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-accelerators-collector-config\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.341151 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.341073 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-textfile\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.341151 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:23:34.341114 2553 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 21 01:23:34.341151 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.341132 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7bb12194-2b28-413b-9f03-42f8b0405385-root\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.341151 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:23:34.341160 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-tls podName:7bb12194-2b28-413b-9f03-42f8b0405385 nodeName:}" failed. No retries permitted until 2026-07-21 01:23:34.8411465 +0000 UTC m=+94.527795033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-tls") pod "node-exporter-9dssm" (UID: "7bb12194-2b28-413b-9f03-42f8b0405385") : secret "node-exporter-tls" not found Jul 21 01:23:34.341695 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.341179 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7bb12194-2b28-413b-9f03-42f8b0405385-root\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.341695 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.341266 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-wtmp\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.341695 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.341283 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bb12194-2b28-413b-9f03-42f8b0405385-metrics-client-ca\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.341878 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.341854 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-textfile\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.342011 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.341986 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-accelerators-collector-config\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.343651 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.343630 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.349714 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.349692 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xdnw\" (UniqueName: \"kubernetes.io/projected/7bb12194-2b28-413b-9f03-42f8b0405385-kube-api-access-5xdnw\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.846789 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.846754 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-tls\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:34.849342 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:34.849318 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7bb12194-2b28-413b-9f03-42f8b0405385-node-exporter-tls\") pod \"node-exporter-9dssm\" (UID: \"7bb12194-2b28-413b-9f03-42f8b0405385\") " pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:35.044723 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:35.044690 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9dssm" Jul 21 01:23:35.058462 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:23:35.058428 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb12194_2b28_413b_9f03_42f8b0405385.slice/crio-d5801835453770408c7bcd541c7b189e3e503114137a4f581990b3e0524f4208 WatchSource:0}: Error finding container d5801835453770408c7bcd541c7b189e3e503114137a4f581990b3e0524f4208: Status 404 returned error can't find the container with id d5801835453770408c7bcd541c7b189e3e503114137a4f581990b3e0524f4208 Jul 21 01:23:35.353579 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:35.353536 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9dssm" event={"ID":"7bb12194-2b28-413b-9f03-42f8b0405385","Type":"ContainerStarted","Data":"d5801835453770408c7bcd541c7b189e3e503114137a4f581990b3e0524f4208"} Jul 21 01:23:35.830412 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:35.830381 2553 scope.go:117] "RemoveContainer" containerID="bb3a2ace1cef25367b283f5f11d2dc204999f9f20a40abcee45103384b80af33" Jul 21 01:23:36.360022 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:36.359954 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:23:36.360473 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:36.360046 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" event={"ID":"73bb25b0-6876-4c1b-8fdd-fde15f47b714","Type":"ContainerStarted","Data":"99ba06e1a7a92f59cd11097a67df2206348b984a41edbc0b08c68b86965ef7bc"} Jul 21 01:23:36.360473 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:36.360432 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:23:36.362024 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:36.361998 2553 generic.go:356] "Generic (PLEG): container finished" podID="7bb12194-2b28-413b-9f03-42f8b0405385" containerID="65b081e8825e005aa399aecfd1795a14c323baeee28f10e5a35b8400d69ded8d" exitCode=0 Jul 21 01:23:36.362121 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:36.362084 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9dssm" event={"ID":"7bb12194-2b28-413b-9f03-42f8b0405385","Type":"ContainerDied","Data":"65b081e8825e005aa399aecfd1795a14c323baeee28f10e5a35b8400d69ded8d"} Jul 21 01:23:36.379777 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:36.379735 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" podStartSLOduration=87.33668647 podStartE2EDuration="1m34.379718853s" totalImagesPullingTime="7.043032383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:36.37835973 +0000 UTC m=+96.065008281" watchObservedRunningTime="2026-07-21 01:23:36.379718853 +0000 UTC m=+96.066367407" Jul 21 01:23:36.679017 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:36.678927 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-6s4th" Jul 21 01:23:37.127303 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:37.127268 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6984fd67cf-xhr5k"] Jul 21 01:23:37.369033 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:37.368997 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9dssm" event={"ID":"7bb12194-2b28-413b-9f03-42f8b0405385","Type":"ContainerStarted","Data":"ba407eafb20906dfeeda18030d9216cbbc1a886bd7c669990393b75ca7441112"} Jul 21 01:23:37.369426 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:37.369047 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9dssm" event={"ID":"7bb12194-2b28-413b-9f03-42f8b0405385","Type":"ContainerStarted","Data":"ac4c95a3dbb554fbbcda7ccd001cba457e8e75553c93b31194f65b022912699d"} Jul 21 01:23:37.390887 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:37.390763 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9dssm" podStartSLOduration=2.342554241 podStartE2EDuration="3.39074715s" totalImagesPullingTime="976.299366ms" totalInitContainerRuntime="71.893543ms" isStatefulPod=true podCreationTimestamp="2026-07-21 01:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:37.389978561 +0000 UTC m=+97.076627118" watchObservedRunningTime="2026-07-21 01:23:37.39074715 +0000 UTC m=+97.077395705" Jul 21 01:23:38.203919 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:38.203889 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jln5h" Jul 21 01:23:46.157164 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.157128 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bd9546b5f-k7nrx"] Jul 21 01:23:46.312789 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.312752 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd9546b5f-k7nrx"] Jul 21 01:23:46.312994 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.312901 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.316222 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.316200 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xgxmc\"" Jul 21 01:23:46.316354 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.316221 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 21 01:23:46.316412 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.316357 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 21 01:23:46.316464 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.316440 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 01:23:46.316464 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.316445 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 21 01:23:46.316464 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.316442 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 21 01:23:46.317299 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.317280 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 21 01:23:46.317563 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.317545 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 01:23:46.447409 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.447318 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f54cd827-38d2-4a3b-be11-298471aa5f87-console-serving-cert\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.447409 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.447375 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4b2p\" (UniqueName: \"kubernetes.io/projected/f54cd827-38d2-4a3b-be11-298471aa5f87-kube-api-access-r4b2p\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.447409 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.447408 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f54cd827-38d2-4a3b-be11-298471aa5f87-console-oauth-config\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.447673 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.447435 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-oauth-serving-cert\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.447673 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.447506 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-service-ca\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.447673 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.447536 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-console-config\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.548718 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.548682 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-service-ca\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.548718 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.548721 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-console-config\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.549009 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.548746 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f54cd827-38d2-4a3b-be11-298471aa5f87-console-serving-cert\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.549009 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.548823 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4b2p\" (UniqueName: \"kubernetes.io/projected/f54cd827-38d2-4a3b-be11-298471aa5f87-kube-api-access-r4b2p\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.549009 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.548850 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f54cd827-38d2-4a3b-be11-298471aa5f87-console-oauth-config\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.549009 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.548879 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-oauth-serving-cert\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.549662 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.549578 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-console-config\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.549662 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.549604 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-service-ca\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.549662 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.549583 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-oauth-serving-cert\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.551429 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.551409 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f54cd827-38d2-4a3b-be11-298471aa5f87-console-serving-cert\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.551429 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.551427 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f54cd827-38d2-4a3b-be11-298471aa5f87-console-oauth-config\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.557001 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.556982 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4b2p\" (UniqueName: \"kubernetes.io/projected/f54cd827-38d2-4a3b-be11-298471aa5f87-kube-api-access-r4b2p\") pod \"console-bd9546b5f-k7nrx\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.624041 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.623996 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:46.803303 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:46.803267 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd9546b5f-k7nrx"] Jul 21 01:23:46.808581 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:23:46.808555 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54cd827_38d2_4a3b_be11_298471aa5f87.slice/crio-6dcd7516f07cbc354970e0f9a72c48f79ba9bc77dae6bf0fc9c6b88cfd96488c WatchSource:0}: Error finding container 6dcd7516f07cbc354970e0f9a72c48f79ba9bc77dae6bf0fc9c6b88cfd96488c: Status 404 returned error can't find the container with id 6dcd7516f07cbc354970e0f9a72c48f79ba9bc77dae6bf0fc9c6b88cfd96488c Jul 21 01:23:47.407000 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:47.406964 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd9546b5f-k7nrx" event={"ID":"f54cd827-38d2-4a3b-be11-298471aa5f87","Type":"ContainerStarted","Data":"6dcd7516f07cbc354970e0f9a72c48f79ba9bc77dae6bf0fc9c6b88cfd96488c"} Jul 21 01:23:51.424050 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:51.424012 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd9546b5f-k7nrx" event={"ID":"f54cd827-38d2-4a3b-be11-298471aa5f87","Type":"ContainerStarted","Data":"d1ad08fc5c131e43b4678b93959f07453ab8f8cc111d617435a1743925f66aaf"} Jul 21 01:23:51.443159 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:51.443111 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bd9546b5f-k7nrx" podStartSLOduration=1.4885765690000001 podStartE2EDuration="5.443095233s" totalImagesPullingTime="3.954518664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:51.44215469 +0000 UTC m=+111.128803428" watchObservedRunningTime="2026-07-21 01:23:51.443095233 +0000 UTC m=+111.129743788" Jul 21 01:23:55.753860 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:55.753824 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-559987dddc-brwh9"] Jul 21 01:23:55.756568 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:55.756550 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:55.766191 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:55.766165 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 21 01:23:55.766708 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:55.766686 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559987dddc-brwh9"] Jul 21 01:23:55.931115 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:55.931081 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-serving-cert\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:55.931279 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:55.931127 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-oauth-serving-cert\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:55.931279 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:55.931166 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-config\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:55.931279 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:55.931235 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-oauth-config\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:55.931279 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:55.931259 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-service-ca\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:55.931279 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:55.931277 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kprrd\" (UniqueName: \"kubernetes.io/projected/c416cfc8-c266-4ec5-acef-a81a56a04cf3-kube-api-access-kprrd\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:55.931437 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:55.931296 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-trusted-ca-bundle\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.032090 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.031998 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-oauth-config\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.032090 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.032039 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-service-ca\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.032090 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.032072 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kprrd\" (UniqueName: \"kubernetes.io/projected/c416cfc8-c266-4ec5-acef-a81a56a04cf3-kube-api-access-kprrd\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.032378 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.032098 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-trusted-ca-bundle\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.032378 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.032129 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-serving-cert\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.032378 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.032168 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-oauth-serving-cert\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.032378 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.032213 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-config\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.032921 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.032855 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-service-ca\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.033126 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.032993 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-config\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.033126 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.033004 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-oauth-serving-cert\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.033126 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.033042 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-trusted-ca-bundle\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.034705 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.034687 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-serving-cert\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.034835 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.034817 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-oauth-config\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.041131 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.041108 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kprrd\" (UniqueName: \"kubernetes.io/projected/c416cfc8-c266-4ec5-acef-a81a56a04cf3-kube-api-access-kprrd\") pod \"console-559987dddc-brwh9\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.065980 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.065950 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:23:56.199067 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.199038 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559987dddc-brwh9"] Jul 21 01:23:56.201567 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:23:56.201543 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc416cfc8_c266_4ec5_acef_a81a56a04cf3.slice/crio-a5044fb124a93f5fad3f8949d47189d86e3dd73d7543a882f8f9f83ffe9dc734 WatchSource:0}: Error finding container a5044fb124a93f5fad3f8949d47189d86e3dd73d7543a882f8f9f83ffe9dc734: Status 404 returned error can't find the container with id a5044fb124a93f5fad3f8949d47189d86e3dd73d7543a882f8f9f83ffe9dc734 Jul 21 01:23:56.444661 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.444570 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559987dddc-brwh9" event={"ID":"c416cfc8-c266-4ec5-acef-a81a56a04cf3","Type":"ContainerStarted","Data":"bcfccd519eccab07f85e9f07e061260fd4c351fd607de18121bae3c055bdbfa4"} Jul 21 01:23:56.444661 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.444630 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559987dddc-brwh9" event={"ID":"c416cfc8-c266-4ec5-acef-a81a56a04cf3","Type":"ContainerStarted","Data":"a5044fb124a93f5fad3f8949d47189d86e3dd73d7543a882f8f9f83ffe9dc734"} Jul 21 01:23:56.463908 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.463857 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-559987dddc-brwh9" podStartSLOduration=1.463842877 podStartE2EDuration="1.463842877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:56.462950897 +0000 UTC m=+116.149599453" watchObservedRunningTime="2026-07-21 01:23:56.463842877 +0000 UTC m=+116.150491431" Jul 21 01:23:56.624387 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.624349 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:56.624662 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.624639 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:56.629473 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:56.629454 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:23:57.452561 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:23:57.452531 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:24:02.149493 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.149404 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" podUID="8af6188a-42f9-4094-9176-2896eebb5955" containerName="registry" containerID="cri-o://5436ed9c687bf2e2707c9de118bb3f3dc7ffe1c7f0cba12e0c58678ea53d87de" gracePeriod=30 Jul 21 01:24:02.413055 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.413031 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:24:02.469217 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.469183 2553 generic.go:356] "Generic (PLEG): container finished" podID="8af6188a-42f9-4094-9176-2896eebb5955" containerID="5436ed9c687bf2e2707c9de118bb3f3dc7ffe1c7f0cba12e0c58678ea53d87de" exitCode=0 Jul 21 01:24:02.469409 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.469238 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" Jul 21 01:24:02.469409 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.469268 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" event={"ID":"8af6188a-42f9-4094-9176-2896eebb5955","Type":"ContainerDied","Data":"5436ed9c687bf2e2707c9de118bb3f3dc7ffe1c7f0cba12e0c58678ea53d87de"} Jul 21 01:24:02.469409 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.469323 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6984fd67cf-xhr5k" event={"ID":"8af6188a-42f9-4094-9176-2896eebb5955","Type":"ContainerDied","Data":"fc50b01aef155fef76586c65c94568e1eed553704bd54ad701ec517ef7ef2c51"} Jul 21 01:24:02.469409 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.469344 2553 scope.go:117] "RemoveContainer" containerID="5436ed9c687bf2e2707c9de118bb3f3dc7ffe1c7f0cba12e0c58678ea53d87de" Jul 21 01:24:02.478476 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.478460 2553 scope.go:117] "RemoveContainer" containerID="5436ed9c687bf2e2707c9de118bb3f3dc7ffe1c7f0cba12e0c58678ea53d87de" Jul 21 01:24:02.478779 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:24:02.478761 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5436ed9c687bf2e2707c9de118bb3f3dc7ffe1c7f0cba12e0c58678ea53d87de\": container with ID starting with 5436ed9c687bf2e2707c9de118bb3f3dc7ffe1c7f0cba12e0c58678ea53d87de not found: ID does not exist" containerID="5436ed9c687bf2e2707c9de118bb3f3dc7ffe1c7f0cba12e0c58678ea53d87de" Jul 21 01:24:02.478850 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.478791 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5436ed9c687bf2e2707c9de118bb3f3dc7ffe1c7f0cba12e0c58678ea53d87de"} err="failed to get container status \"5436ed9c687bf2e2707c9de118bb3f3dc7ffe1c7f0cba12e0c58678ea53d87de\": rpc error: code = NotFound desc = could not find container \"5436ed9c687bf2e2707c9de118bb3f3dc7ffe1c7f0cba12e0c58678ea53d87de\": container with ID starting with 5436ed9c687bf2e2707c9de118bb3f3dc7ffe1c7f0cba12e0c58678ea53d87de not found: ID does not exist" Jul 21 01:24:02.490242 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.490217 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8af6188a-42f9-4094-9176-2896eebb5955-registry-certificates\") pod \"8af6188a-42f9-4094-9176-2896eebb5955\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " Jul 21 01:24:02.490387 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.490255 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-bound-sa-token\") pod \"8af6188a-42f9-4094-9176-2896eebb5955\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " Jul 21 01:24:02.490387 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.490277 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8bj5\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-kube-api-access-n8bj5\") pod \"8af6188a-42f9-4094-9176-2896eebb5955\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " Jul 21 01:24:02.490387 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.490298 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8af6188a-42f9-4094-9176-2896eebb5955-installation-pull-secrets\") pod \"8af6188a-42f9-4094-9176-2896eebb5955\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " Jul 21 01:24:02.490387 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.490349 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls\") pod \"8af6188a-42f9-4094-9176-2896eebb5955\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " Jul 21 01:24:02.490387 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.490380 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8af6188a-42f9-4094-9176-2896eebb5955-ca-trust-extracted\") pod \"8af6188a-42f9-4094-9176-2896eebb5955\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " Jul 21 01:24:02.490635 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.490414 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8af6188a-42f9-4094-9176-2896eebb5955-trusted-ca\") pod \"8af6188a-42f9-4094-9176-2896eebb5955\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " Jul 21 01:24:02.490635 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.490442 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8af6188a-42f9-4094-9176-2896eebb5955-image-registry-private-configuration\") pod \"8af6188a-42f9-4094-9176-2896eebb5955\" (UID: \"8af6188a-42f9-4094-9176-2896eebb5955\") " Jul 21 01:24:02.490848 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.490791 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8af6188a-42f9-4094-9176-2896eebb5955-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8af6188a-42f9-4094-9176-2896eebb5955" (UID: "8af6188a-42f9-4094-9176-2896eebb5955"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:24:02.491159 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.491110 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8af6188a-42f9-4094-9176-2896eebb5955-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8af6188a-42f9-4094-9176-2896eebb5955" (UID: "8af6188a-42f9-4094-9176-2896eebb5955"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:24:02.493625 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.493599 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8af6188a-42f9-4094-9176-2896eebb5955" (UID: "8af6188a-42f9-4094-9176-2896eebb5955"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:24:02.493748 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.493611 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8af6188a-42f9-4094-9176-2896eebb5955-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8af6188a-42f9-4094-9176-2896eebb5955" (UID: "8af6188a-42f9-4094-9176-2896eebb5955"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 01:24:02.493748 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.493716 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-kube-api-access-n8bj5" (OuterVolumeSpecName: "kube-api-access-n8bj5") pod "8af6188a-42f9-4094-9176-2896eebb5955" (UID: "8af6188a-42f9-4094-9176-2896eebb5955"). InnerVolumeSpecName "kube-api-access-n8bj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:24:02.493748 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.493728 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8af6188a-42f9-4094-9176-2896eebb5955-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8af6188a-42f9-4094-9176-2896eebb5955" (UID: "8af6188a-42f9-4094-9176-2896eebb5955"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 01:24:02.493945 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.493771 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8af6188a-42f9-4094-9176-2896eebb5955" (UID: "8af6188a-42f9-4094-9176-2896eebb5955"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:24:02.501279 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.501235 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af6188a-42f9-4094-9176-2896eebb5955-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8af6188a-42f9-4094-9176-2896eebb5955" (UID: "8af6188a-42f9-4094-9176-2896eebb5955"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:24:02.591011 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.590976 2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-bound-sa-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:24:02.591011 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.591004 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8bj5\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-kube-api-access-n8bj5\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:24:02.591011 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.591015 2553 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8af6188a-42f9-4094-9176-2896eebb5955-installation-pull-secrets\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:24:02.591243 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.591024 2553 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8af6188a-42f9-4094-9176-2896eebb5955-registry-tls\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:24:02.591243 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.591033 2553 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8af6188a-42f9-4094-9176-2896eebb5955-ca-trust-extracted\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:24:02.591243 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.591040 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8af6188a-42f9-4094-9176-2896eebb5955-trusted-ca\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:24:02.591243 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.591049 2553 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8af6188a-42f9-4094-9176-2896eebb5955-image-registry-private-configuration\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:24:02.591243 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.591058 2553 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8af6188a-42f9-4094-9176-2896eebb5955-registry-certificates\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:24:02.792639 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.792611 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6984fd67cf-xhr5k"] Jul 21 01:24:02.795786 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.795759 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6984fd67cf-xhr5k"] Jul 21 01:24:02.834353 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:02.834321 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8af6188a-42f9-4094-9176-2896eebb5955" path="/var/lib/kubelet/pods/8af6188a-42f9-4094-9176-2896eebb5955/volumes" Jul 21 01:24:03.475266 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:03.475233 2553 generic.go:356] "Generic (PLEG): container finished" podID="7d50086c-1067-4d0a-8c37-73f113f4161e" containerID="45f2c8c8d7a3f259ca794ac5cf7db0eb477d7ef7e0643b36af1ebe232ef20b2d" exitCode=0 Jul 21 01:24:03.475652 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:03.475307 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" event={"ID":"7d50086c-1067-4d0a-8c37-73f113f4161e","Type":"ContainerDied","Data":"45f2c8c8d7a3f259ca794ac5cf7db0eb477d7ef7e0643b36af1ebe232ef20b2d"} Jul 21 01:24:03.475737 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:03.475655 2553 scope.go:117] "RemoveContainer" containerID="45f2c8c8d7a3f259ca794ac5cf7db0eb477d7ef7e0643b36af1ebe232ef20b2d" Jul 21 01:24:04.482043 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:04.482008 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t66c8" event={"ID":"7d50086c-1067-4d0a-8c37-73f113f4161e","Type":"ContainerStarted","Data":"7379bb440ddf51697a0c494f64c3529dc72f5d3a9957a71bb5de743d7d3bde40"} Jul 21 01:24:06.066912 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:06.066858 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:24:06.067365 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:06.066975 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:24:06.071907 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:06.071880 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:24:06.494163 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:06.494140 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:24:06.539887 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:06.539857 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd9546b5f-k7nrx"] Jul 21 01:24:08.498493 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:08.498459 2553 generic.go:356] "Generic (PLEG): container finished" podID="c8eaec8a-3749-4230-be3b-735a598ef51c" containerID="35f5cc4cb3e644ff7fe998c68f25353288a563c54deb0258d8f9e15dc1172d10" exitCode=0 Jul 21 01:24:08.498933 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:08.498499 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" event={"ID":"c8eaec8a-3749-4230-be3b-735a598ef51c","Type":"ContainerDied","Data":"35f5cc4cb3e644ff7fe998c68f25353288a563c54deb0258d8f9e15dc1172d10"} Jul 21 01:24:08.498933 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:08.498828 2553 scope.go:117] "RemoveContainer" containerID="35f5cc4cb3e644ff7fe998c68f25353288a563c54deb0258d8f9e15dc1172d10" Jul 21 01:24:09.504074 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:09.504036 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pqpq5" event={"ID":"c8eaec8a-3749-4230-be3b-735a598ef51c","Type":"ContainerStarted","Data":"04c6064b5296081663422b2c08e9ee146c9afcc70f75ab6feae093cf30115bc2"} Jul 21 01:24:14.525218 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:14.525181 2553 generic.go:356] "Generic (PLEG): container finished" podID="b54a3b1b-9ca0-4912-9983-57ad08dafdd5" containerID="93203b5f32abdc33981b38e79ffd3934228564b9ae39c440f26fa6bb91a3f14a" exitCode=0 Jul 21 01:24:14.525612 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:14.525253 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xfd6h" event={"ID":"b54a3b1b-9ca0-4912-9983-57ad08dafdd5","Type":"ContainerDied","Data":"93203b5f32abdc33981b38e79ffd3934228564b9ae39c440f26fa6bb91a3f14a"} Jul 21 01:24:14.525670 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:14.525628 2553 scope.go:117] "RemoveContainer" containerID="93203b5f32abdc33981b38e79ffd3934228564b9ae39c440f26fa6bb91a3f14a" Jul 21 01:24:15.530626 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:15.530593 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xfd6h" event={"ID":"b54a3b1b-9ca0-4912-9983-57ad08dafdd5","Type":"ContainerStarted","Data":"4ed07c442af7e72e83ea91e7d4808b5302df184aa96f61bec9f863c83cc945db"} Jul 21 01:24:31.561398 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:31.561356 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bd9546b5f-k7nrx" podUID="f54cd827-38d2-4a3b-be11-298471aa5f87" containerName="console" containerID="cri-o://d1ad08fc5c131e43b4678b93959f07453ab8f8cc111d617435a1743925f66aaf" gracePeriod=15 Jul 21 01:24:31.807426 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:31.807402 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:24:31.934382 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:31.934291 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-oauth-serving-cert\") pod \"f54cd827-38d2-4a3b-be11-298471aa5f87\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " Jul 21 01:24:31.934382 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:31.934347 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4b2p\" (UniqueName: \"kubernetes.io/projected/f54cd827-38d2-4a3b-be11-298471aa5f87-kube-api-access-r4b2p\") pod \"f54cd827-38d2-4a3b-be11-298471aa5f87\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " Jul 21 01:24:31.934601 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:31.934398 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f54cd827-38d2-4a3b-be11-298471aa5f87-console-serving-cert\") pod \"f54cd827-38d2-4a3b-be11-298471aa5f87\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " Jul 21 01:24:31.934601 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:31.934423 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-service-ca\") pod \"f54cd827-38d2-4a3b-be11-298471aa5f87\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " Jul 21 01:24:31.934601 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:31.934471 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-console-config\") pod \"f54cd827-38d2-4a3b-be11-298471aa5f87\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " Jul 21 01:24:31.934601 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:31.934503 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f54cd827-38d2-4a3b-be11-298471aa5f87-console-oauth-config\") pod \"f54cd827-38d2-4a3b-be11-298471aa5f87\" (UID: \"f54cd827-38d2-4a3b-be11-298471aa5f87\") " Jul 21 01:24:31.934842 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:31.934785 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f54cd827-38d2-4a3b-be11-298471aa5f87" (UID: "f54cd827-38d2-4a3b-be11-298471aa5f87"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:24:31.934910 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:31.934891 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-service-ca" (OuterVolumeSpecName: "service-ca") pod "f54cd827-38d2-4a3b-be11-298471aa5f87" (UID: "f54cd827-38d2-4a3b-be11-298471aa5f87"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:24:31.934910 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:31.934898 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-console-config" (OuterVolumeSpecName: "console-config") pod "f54cd827-38d2-4a3b-be11-298471aa5f87" (UID: "f54cd827-38d2-4a3b-be11-298471aa5f87"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:24:31.936932 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:31.936903 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f54cd827-38d2-4a3b-be11-298471aa5f87-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f54cd827-38d2-4a3b-be11-298471aa5f87" (UID: "f54cd827-38d2-4a3b-be11-298471aa5f87"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 01:24:31.937048 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:31.936954 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f54cd827-38d2-4a3b-be11-298471aa5f87-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f54cd827-38d2-4a3b-be11-298471aa5f87" (UID: "f54cd827-38d2-4a3b-be11-298471aa5f87"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 01:24:31.937048 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:31.936984 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f54cd827-38d2-4a3b-be11-298471aa5f87-kube-api-access-r4b2p" (OuterVolumeSpecName: "kube-api-access-r4b2p") pod "f54cd827-38d2-4a3b-be11-298471aa5f87" (UID: "f54cd827-38d2-4a3b-be11-298471aa5f87"). InnerVolumeSpecName "kube-api-access-r4b2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:24:32.035854 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.035824 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-console-config\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:24:32.035854 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.035852 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f54cd827-38d2-4a3b-be11-298471aa5f87-console-oauth-config\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:24:32.035854 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.035863 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-oauth-serving-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:24:32.036085 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.035871 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4b2p\" (UniqueName: \"kubernetes.io/projected/f54cd827-38d2-4a3b-be11-298471aa5f87-kube-api-access-r4b2p\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:24:32.036085 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.035880 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f54cd827-38d2-4a3b-be11-298471aa5f87-console-serving-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:24:32.036085 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.035888 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f54cd827-38d2-4a3b-be11-298471aa5f87-service-ca\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:24:32.602272 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.602232 2553 generic.go:356] "Generic (PLEG): container finished" podID="f54cd827-38d2-4a3b-be11-298471aa5f87" containerID="d1ad08fc5c131e43b4678b93959f07453ab8f8cc111d617435a1743925f66aaf" exitCode=0 Jul 21 01:24:32.602689 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.602281 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd9546b5f-k7nrx" Jul 21 01:24:32.602689 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.602317 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd9546b5f-k7nrx" event={"ID":"f54cd827-38d2-4a3b-be11-298471aa5f87","Type":"ContainerDied","Data":"d1ad08fc5c131e43b4678b93959f07453ab8f8cc111d617435a1743925f66aaf"} Jul 21 01:24:32.602689 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.602376 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd9546b5f-k7nrx" event={"ID":"f54cd827-38d2-4a3b-be11-298471aa5f87","Type":"ContainerDied","Data":"6dcd7516f07cbc354970e0f9a72c48f79ba9bc77dae6bf0fc9c6b88cfd96488c"} Jul 21 01:24:32.602689 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.602400 2553 scope.go:117] "RemoveContainer" containerID="d1ad08fc5c131e43b4678b93959f07453ab8f8cc111d617435a1743925f66aaf" Jul 21 01:24:32.611234 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.611218 2553 scope.go:117] "RemoveContainer" containerID="d1ad08fc5c131e43b4678b93959f07453ab8f8cc111d617435a1743925f66aaf" Jul 21 01:24:32.611515 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:24:32.611496 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1ad08fc5c131e43b4678b93959f07453ab8f8cc111d617435a1743925f66aaf\": container with ID starting with d1ad08fc5c131e43b4678b93959f07453ab8f8cc111d617435a1743925f66aaf not found: ID does not exist" containerID="d1ad08fc5c131e43b4678b93959f07453ab8f8cc111d617435a1743925f66aaf" Jul 21 01:24:32.611556 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.611525 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ad08fc5c131e43b4678b93959f07453ab8f8cc111d617435a1743925f66aaf"} err="failed to get container status \"d1ad08fc5c131e43b4678b93959f07453ab8f8cc111d617435a1743925f66aaf\": rpc error: code = NotFound desc = could not find container \"d1ad08fc5c131e43b4678b93959f07453ab8f8cc111d617435a1743925f66aaf\": container with ID starting with d1ad08fc5c131e43b4678b93959f07453ab8f8cc111d617435a1743925f66aaf not found: ID does not exist" Jul 21 01:24:32.622303 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.622278 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd9546b5f-k7nrx"] Jul 21 01:24:32.626370 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.626347 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bd9546b5f-k7nrx"] Jul 21 01:24:32.834640 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:24:32.834606 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f54cd827-38d2-4a3b-be11-298471aa5f87" path="/var/lib/kubelet/pods/f54cd827-38d2-4a3b-be11-298471aa5f87/volumes" Jul 21 01:25:02.891326 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.891292 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54f9bf4f67-lrrtv"] Jul 21 01:25:02.891790 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.891584 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8af6188a-42f9-4094-9176-2896eebb5955" containerName="registry" Jul 21 01:25:02.891790 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.891595 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8af6188a-42f9-4094-9176-2896eebb5955" containerName="registry" Jul 21 01:25:02.891790 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.891614 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f54cd827-38d2-4a3b-be11-298471aa5f87" containerName="console" Jul 21 01:25:02.891790 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.891620 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f54cd827-38d2-4a3b-be11-298471aa5f87" containerName="console" Jul 21 01:25:02.891790 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.891666 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8af6188a-42f9-4094-9176-2896eebb5955" containerName="registry" Jul 21 01:25:02.891790 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.891676 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f54cd827-38d2-4a3b-be11-298471aa5f87" containerName="console" Jul 21 01:25:02.895955 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.895927 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:02.910360 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.910325 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f9bf4f67-lrrtv"] Jul 21 01:25:02.984791 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.984745 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-service-ca\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:02.985026 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.984854 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrthg\" (UniqueName: \"kubernetes.io/projected/0f2f2689-86aa-45e0-81ee-fff040cddec7-kube-api-access-hrthg\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:02.985026 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.984888 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-serving-cert\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:02.985026 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.984914 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-trusted-ca-bundle\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:02.985026 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.984947 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-oauth-config\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:02.985026 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.984987 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-config\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:02.985026 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:02.985021 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-oauth-serving-cert\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.085499 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.085462 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrthg\" (UniqueName: \"kubernetes.io/projected/0f2f2689-86aa-45e0-81ee-fff040cddec7-kube-api-access-hrthg\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.085499 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.085502 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-serving-cert\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.085865 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.085529 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-trusted-ca-bundle\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.085865 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.085565 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-oauth-config\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.085865 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.085590 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-config\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.085865 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.085614 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-oauth-serving-cert\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.085865 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.085658 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-service-ca\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.086494 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.086464 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-oauth-serving-cert\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.086604 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.086527 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-config\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.086604 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.086563 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-trusted-ca-bundle\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.086718 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.086606 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-service-ca\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.088195 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.088161 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-oauth-config\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.088354 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.088335 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-serving-cert\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.095065 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.095044 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrthg\" (UniqueName: \"kubernetes.io/projected/0f2f2689-86aa-45e0-81ee-fff040cddec7-kube-api-access-hrthg\") pod \"console-54f9bf4f67-lrrtv\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.208375 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.208272 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:03.344603 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.344577 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f9bf4f67-lrrtv"] Jul 21 01:25:03.347285 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:25:03.347260 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f2f2689_86aa_45e0_81ee_fff040cddec7.slice/crio-a002b6a2758d654408be249d5684b51255b9e6e21f66af4b248e31cd48753d87 WatchSource:0}: Error finding container a002b6a2758d654408be249d5684b51255b9e6e21f66af4b248e31cd48753d87: Status 404 returned error can't find the container with id a002b6a2758d654408be249d5684b51255b9e6e21f66af4b248e31cd48753d87 Jul 21 01:25:03.717716 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.717684 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f9bf4f67-lrrtv" event={"ID":"0f2f2689-86aa-45e0-81ee-fff040cddec7","Type":"ContainerStarted","Data":"ab69eb2c728445016bda50b9e2e7513b78f8f323dacbe7b474c91af6859e18a4"} Jul 21 01:25:03.717922 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.717733 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f9bf4f67-lrrtv" event={"ID":"0f2f2689-86aa-45e0-81ee-fff040cddec7","Type":"ContainerStarted","Data":"a002b6a2758d654408be249d5684b51255b9e6e21f66af4b248e31cd48753d87"} Jul 21 01:25:03.735913 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:03.735850 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54f9bf4f67-lrrtv" podStartSLOduration=1.7358311849999999 podStartE2EDuration="1.735831185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:25:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:25:03.735048388 +0000 UTC m=+183.421696944" watchObservedRunningTime="2026-07-21 01:25:03.735831185 +0000 UTC m=+183.422479741" Jul 21 01:25:13.208487 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:13.208448 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:13.208995 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:13.208542 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:13.213925 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:13.213903 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:13.760557 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:13.760529 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:25:13.807078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:13.807043 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559987dddc-brwh9"] Jul 21 01:25:38.830531 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:38.830470 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-559987dddc-brwh9" podUID="c416cfc8-c266-4ec5-acef-a81a56a04cf3" containerName="console" containerID="cri-o://bcfccd519eccab07f85e9f07e061260fd4c351fd607de18121bae3c055bdbfa4" gracePeriod=15 Jul 21 01:25:39.081871 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.081789 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:25:39.177668 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.177630 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-trusted-ca-bundle\") pod \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " Jul 21 01:25:39.177880 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.177677 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-serving-cert\") pod \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " Jul 21 01:25:39.177880 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.177700 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-config\") pod \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " Jul 21 01:25:39.177880 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.177729 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-oauth-serving-cert\") pod \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " Jul 21 01:25:39.177880 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.177751 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-oauth-config\") pod \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " Jul 21 01:25:39.177880 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.177869 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-service-ca\") pod \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " Jul 21 01:25:39.178151 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.177897 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kprrd\" (UniqueName: \"kubernetes.io/projected/c416cfc8-c266-4ec5-acef-a81a56a04cf3-kube-api-access-kprrd\") pod \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\" (UID: \"c416cfc8-c266-4ec5-acef-a81a56a04cf3\") " Jul 21 01:25:39.178151 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.178092 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c416cfc8-c266-4ec5-acef-a81a56a04cf3" (UID: "c416cfc8-c266-4ec5-acef-a81a56a04cf3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:25:39.178453 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.178371 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c416cfc8-c266-4ec5-acef-a81a56a04cf3" (UID: "c416cfc8-c266-4ec5-acef-a81a56a04cf3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:25:39.178453 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.178385 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-service-ca" (OuterVolumeSpecName: "service-ca") pod "c416cfc8-c266-4ec5-acef-a81a56a04cf3" (UID: "c416cfc8-c266-4ec5-acef-a81a56a04cf3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:25:39.178453 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.178402 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-config" (OuterVolumeSpecName: "console-config") pod "c416cfc8-c266-4ec5-acef-a81a56a04cf3" (UID: "c416cfc8-c266-4ec5-acef-a81a56a04cf3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:25:39.180120 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.180090 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c416cfc8-c266-4ec5-acef-a81a56a04cf3" (UID: "c416cfc8-c266-4ec5-acef-a81a56a04cf3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 01:25:39.180210 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.180138 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c416cfc8-c266-4ec5-acef-a81a56a04cf3" (UID: "c416cfc8-c266-4ec5-acef-a81a56a04cf3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 01:25:39.180280 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.180251 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c416cfc8-c266-4ec5-acef-a81a56a04cf3-kube-api-access-kprrd" (OuterVolumeSpecName: "kube-api-access-kprrd") pod "c416cfc8-c266-4ec5-acef-a81a56a04cf3" (UID: "c416cfc8-c266-4ec5-acef-a81a56a04cf3"). InnerVolumeSpecName "kube-api-access-kprrd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:25:39.278484 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.278444 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-service-ca\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:25:39.278484 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.278480 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kprrd\" (UniqueName: \"kubernetes.io/projected/c416cfc8-c266-4ec5-acef-a81a56a04cf3-kube-api-access-kprrd\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:25:39.278484 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.278494 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-trusted-ca-bundle\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:25:39.278738 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.278507 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-serving-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:25:39.278738 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.278518 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-config\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:25:39.278738 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.278529 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c416cfc8-c266-4ec5-acef-a81a56a04cf3-oauth-serving-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:25:39.278738 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.278539 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c416cfc8-c266-4ec5-acef-a81a56a04cf3-console-oauth-config\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:25:39.854930 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.854894 2553 generic.go:356] "Generic (PLEG): container finished" podID="c416cfc8-c266-4ec5-acef-a81a56a04cf3" containerID="bcfccd519eccab07f85e9f07e061260fd4c351fd607de18121bae3c055bdbfa4" exitCode=0 Jul 21 01:25:39.855322 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.854941 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559987dddc-brwh9" Jul 21 01:25:39.855322 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.854985 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559987dddc-brwh9" event={"ID":"c416cfc8-c266-4ec5-acef-a81a56a04cf3","Type":"ContainerDied","Data":"bcfccd519eccab07f85e9f07e061260fd4c351fd607de18121bae3c055bdbfa4"} Jul 21 01:25:39.855322 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.855037 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559987dddc-brwh9" event={"ID":"c416cfc8-c266-4ec5-acef-a81a56a04cf3","Type":"ContainerDied","Data":"a5044fb124a93f5fad3f8949d47189d86e3dd73d7543a882f8f9f83ffe9dc734"} Jul 21 01:25:39.855322 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.855059 2553 scope.go:117] "RemoveContainer" containerID="bcfccd519eccab07f85e9f07e061260fd4c351fd607de18121bae3c055bdbfa4" Jul 21 01:25:39.863841 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.863811 2553 scope.go:117] "RemoveContainer" containerID="bcfccd519eccab07f85e9f07e061260fd4c351fd607de18121bae3c055bdbfa4" Jul 21 01:25:39.864097 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:25:39.864082 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcfccd519eccab07f85e9f07e061260fd4c351fd607de18121bae3c055bdbfa4\": container with ID starting with bcfccd519eccab07f85e9f07e061260fd4c351fd607de18121bae3c055bdbfa4 not found: ID does not exist" containerID="bcfccd519eccab07f85e9f07e061260fd4c351fd607de18121bae3c055bdbfa4" Jul 21 01:25:39.864154 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.864104 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcfccd519eccab07f85e9f07e061260fd4c351fd607de18121bae3c055bdbfa4"} err="failed to get container status \"bcfccd519eccab07f85e9f07e061260fd4c351fd607de18121bae3c055bdbfa4\": rpc error: code = NotFound desc = could not find container \"bcfccd519eccab07f85e9f07e061260fd4c351fd607de18121bae3c055bdbfa4\": container with ID starting with bcfccd519eccab07f85e9f07e061260fd4c351fd607de18121bae3c055bdbfa4 not found: ID does not exist" Jul 21 01:25:39.880554 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.876765 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559987dddc-brwh9"] Jul 21 01:25:39.883324 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:39.883293 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-559987dddc-brwh9"] Jul 21 01:25:40.835141 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:25:40.835106 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c416cfc8-c266-4ec5-acef-a81a56a04cf3" path="/var/lib/kubelet/pods/c416cfc8-c266-4ec5-acef-a81a56a04cf3/volumes" Jul 21 01:26:25.550779 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.550694 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f9bf4b8df-crfv9"] Jul 21 01:26:25.551277 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.550993 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c416cfc8-c266-4ec5-acef-a81a56a04cf3" containerName="console" Jul 21 01:26:25.551277 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.551005 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c416cfc8-c266-4ec5-acef-a81a56a04cf3" containerName="console" Jul 21 01:26:25.551277 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.551058 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c416cfc8-c266-4ec5-acef-a81a56a04cf3" containerName="console" Jul 21 01:26:25.554175 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.554149 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.566559 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.566535 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9bf4b8df-crfv9"] Jul 21 01:26:25.639312 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.639273 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-console-config\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.639487 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.639335 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/420eca03-9a40-4890-8ba9-6d462df430a4-console-oauth-config\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.639487 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.639368 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzns9\" (UniqueName: \"kubernetes.io/projected/420eca03-9a40-4890-8ba9-6d462df430a4-kube-api-access-fzns9\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.639487 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.639393 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-trusted-ca-bundle\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.639487 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.639439 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/420eca03-9a40-4890-8ba9-6d462df430a4-console-serving-cert\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.639618 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.639524 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-oauth-serving-cert\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.639618 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.639562 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-service-ca\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.740855 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.740813 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-oauth-serving-cert\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.741056 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.740870 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-service-ca\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.741056 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.740894 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-console-config\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.741056 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.740915 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/420eca03-9a40-4890-8ba9-6d462df430a4-console-oauth-config\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.741056 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.740944 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzns9\" (UniqueName: \"kubernetes.io/projected/420eca03-9a40-4890-8ba9-6d462df430a4-kube-api-access-fzns9\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.741056 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.740967 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-trusted-ca-bundle\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.741056 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.740989 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/420eca03-9a40-4890-8ba9-6d462df430a4-console-serving-cert\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.741698 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.741673 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-console-config\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.741844 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.741719 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-service-ca\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.741898 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.741886 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-trusted-ca-bundle\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.741937 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.741920 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-oauth-serving-cert\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.743541 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.743519 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/420eca03-9a40-4890-8ba9-6d462df430a4-console-serving-cert\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.743662 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.743639 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/420eca03-9a40-4890-8ba9-6d462df430a4-console-oauth-config\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.751753 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.751726 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzns9\" (UniqueName: \"kubernetes.io/projected/420eca03-9a40-4890-8ba9-6d462df430a4-kube-api-access-fzns9\") pod \"console-5f9bf4b8df-crfv9\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:25.864416 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:25.864308 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:26.009034 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:26.009002 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9bf4b8df-crfv9"] Jul 21 01:26:26.011602 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:26:26.011578 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420eca03_9a40_4890_8ba9_6d462df430a4.slice/crio-9b50a97c1fa2519db526be256a75aa9d9d35fc628e0099d5bb3c4b116c88d5f4 WatchSource:0}: Error finding container 9b50a97c1fa2519db526be256a75aa9d9d35fc628e0099d5bb3c4b116c88d5f4: Status 404 returned error can't find the container with id 9b50a97c1fa2519db526be256a75aa9d9d35fc628e0099d5bb3c4b116c88d5f4 Jul 21 01:26:26.029637 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:26.029604 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9bf4b8df-crfv9" event={"ID":"420eca03-9a40-4890-8ba9-6d462df430a4","Type":"ContainerStarted","Data":"9b50a97c1fa2519db526be256a75aa9d9d35fc628e0099d5bb3c4b116c88d5f4"} Jul 21 01:26:27.034993 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:27.034956 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9bf4b8df-crfv9" event={"ID":"420eca03-9a40-4890-8ba9-6d462df430a4","Type":"ContainerStarted","Data":"0fd2cc8248ab9e2fd7ef3c3b2ac449e298c9ff6875102c476463bd1176d630cd"} Jul 21 01:26:27.053686 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:27.053632 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f9bf4b8df-crfv9" podStartSLOduration=2.053614687 podStartE2EDuration="2.053614687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:26:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:26:27.05214631 +0000 UTC m=+266.738794865" watchObservedRunningTime="2026-07-21 01:26:27.053614687 +0000 UTC m=+266.740263244" Jul 21 01:26:35.864826 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:35.864756 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:35.865293 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:35.864854 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:35.869864 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:35.869838 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:36.073349 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:36.073317 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:26:36.120733 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:26:36.120658 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f9bf4f67-lrrtv"] Jul 21 01:27:00.707792 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:00.707762 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:27:00.713101 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:00.713069 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:27:00.714970 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:00.714947 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:27:00.718008 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:00.717987 2553 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 01:27:00.721220 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:00.721202 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:27:01.145257 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.145197 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54f9bf4f67-lrrtv" podUID="0f2f2689-86aa-45e0-81ee-fff040cddec7" containerName="console" containerID="cri-o://ab69eb2c728445016bda50b9e2e7513b78f8f323dacbe7b474c91af6859e18a4" gracePeriod=15 Jul 21 01:27:01.382445 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.382420 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:27:01.547352 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.547304 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-service-ca\") pod \"0f2f2689-86aa-45e0-81ee-fff040cddec7\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " Jul 21 01:27:01.547546 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.547393 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrthg\" (UniqueName: \"kubernetes.io/projected/0f2f2689-86aa-45e0-81ee-fff040cddec7-kube-api-access-hrthg\") pod \"0f2f2689-86aa-45e0-81ee-fff040cddec7\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " Jul 21 01:27:01.547546 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.547420 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-serving-cert\") pod \"0f2f2689-86aa-45e0-81ee-fff040cddec7\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " Jul 21 01:27:01.547546 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.547460 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-oauth-serving-cert\") pod \"0f2f2689-86aa-45e0-81ee-fff040cddec7\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " Jul 21 01:27:01.547546 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.547490 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-config\") pod \"0f2f2689-86aa-45e0-81ee-fff040cddec7\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " Jul 21 01:27:01.547546 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.547514 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-oauth-config\") pod \"0f2f2689-86aa-45e0-81ee-fff040cddec7\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " Jul 21 01:27:01.547833 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.547573 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-trusted-ca-bundle\") pod \"0f2f2689-86aa-45e0-81ee-fff040cddec7\" (UID: \"0f2f2689-86aa-45e0-81ee-fff040cddec7\") " Jul 21 01:27:01.547910 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.547747 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-service-ca" (OuterVolumeSpecName: "service-ca") pod "0f2f2689-86aa-45e0-81ee-fff040cddec7" (UID: "0f2f2689-86aa-45e0-81ee-fff040cddec7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:27:01.548019 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.547996 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0f2f2689-86aa-45e0-81ee-fff040cddec7" (UID: "0f2f2689-86aa-45e0-81ee-fff040cddec7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:27:01.548074 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.548013 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-config" (OuterVolumeSpecName: "console-config") pod "0f2f2689-86aa-45e0-81ee-fff040cddec7" (UID: "0f2f2689-86aa-45e0-81ee-fff040cddec7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:27:01.548168 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.548146 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0f2f2689-86aa-45e0-81ee-fff040cddec7" (UID: "0f2f2689-86aa-45e0-81ee-fff040cddec7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:27:01.549845 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.549812 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f2f2689-86aa-45e0-81ee-fff040cddec7-kube-api-access-hrthg" (OuterVolumeSpecName: "kube-api-access-hrthg") pod "0f2f2689-86aa-45e0-81ee-fff040cddec7" (UID: "0f2f2689-86aa-45e0-81ee-fff040cddec7"). InnerVolumeSpecName "kube-api-access-hrthg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:27:01.549845 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.549813 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0f2f2689-86aa-45e0-81ee-fff040cddec7" (UID: "0f2f2689-86aa-45e0-81ee-fff040cddec7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 01:27:01.549984 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.549897 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0f2f2689-86aa-45e0-81ee-fff040cddec7" (UID: "0f2f2689-86aa-45e0-81ee-fff040cddec7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 01:27:01.648580 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.648530 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrthg\" (UniqueName: \"kubernetes.io/projected/0f2f2689-86aa-45e0-81ee-fff040cddec7-kube-api-access-hrthg\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:27:01.648580 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.648572 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-serving-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:27:01.648580 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.648582 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-oauth-serving-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:27:01.648580 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.648591 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-config\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:27:01.648580 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.648600 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f2f2689-86aa-45e0-81ee-fff040cddec7-console-oauth-config\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:27:01.648919 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.648611 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-trusted-ca-bundle\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:27:01.648919 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:01.648619 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f2f2689-86aa-45e0-81ee-fff040cddec7-service-ca\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:27:02.170950 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:02.170918 2553 generic.go:356] "Generic (PLEG): container finished" podID="0f2f2689-86aa-45e0-81ee-fff040cddec7" containerID="ab69eb2c728445016bda50b9e2e7513b78f8f323dacbe7b474c91af6859e18a4" exitCode=0 Jul 21 01:27:02.171417 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:02.170974 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f9bf4f67-lrrtv" Jul 21 01:27:02.171417 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:02.170997 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f9bf4f67-lrrtv" event={"ID":"0f2f2689-86aa-45e0-81ee-fff040cddec7","Type":"ContainerDied","Data":"ab69eb2c728445016bda50b9e2e7513b78f8f323dacbe7b474c91af6859e18a4"} Jul 21 01:27:02.171417 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:02.171050 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f9bf4f67-lrrtv" event={"ID":"0f2f2689-86aa-45e0-81ee-fff040cddec7","Type":"ContainerDied","Data":"a002b6a2758d654408be249d5684b51255b9e6e21f66af4b248e31cd48753d87"} Jul 21 01:27:02.171417 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:02.171070 2553 scope.go:117] "RemoveContainer" containerID="ab69eb2c728445016bda50b9e2e7513b78f8f323dacbe7b474c91af6859e18a4" Jul 21 01:27:02.179993 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:02.179973 2553 scope.go:117] "RemoveContainer" containerID="ab69eb2c728445016bda50b9e2e7513b78f8f323dacbe7b474c91af6859e18a4" Jul 21 01:27:02.180296 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:27:02.180269 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab69eb2c728445016bda50b9e2e7513b78f8f323dacbe7b474c91af6859e18a4\": container with ID starting with ab69eb2c728445016bda50b9e2e7513b78f8f323dacbe7b474c91af6859e18a4 not found: ID does not exist" containerID="ab69eb2c728445016bda50b9e2e7513b78f8f323dacbe7b474c91af6859e18a4" Jul 21 01:27:02.180379 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:02.180309 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab69eb2c728445016bda50b9e2e7513b78f8f323dacbe7b474c91af6859e18a4"} err="failed to get container status \"ab69eb2c728445016bda50b9e2e7513b78f8f323dacbe7b474c91af6859e18a4\": rpc error: code = NotFound desc = could not find container \"ab69eb2c728445016bda50b9e2e7513b78f8f323dacbe7b474c91af6859e18a4\": container with ID starting with ab69eb2c728445016bda50b9e2e7513b78f8f323dacbe7b474c91af6859e18a4 not found: ID does not exist" Jul 21 01:27:02.203721 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:02.203685 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f9bf4f67-lrrtv"] Jul 21 01:27:02.211393 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:02.211364 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54f9bf4f67-lrrtv"] Jul 21 01:27:02.834677 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:02.834638 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f2f2689-86aa-45e0-81ee-fff040cddec7" path="/var/lib/kubelet/pods/0f2f2689-86aa-45e0-81ee-fff040cddec7/volumes" Jul 21 01:27:41.514296 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.514257 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58"] Jul 21 01:27:41.514761 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.514531 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f2f2689-86aa-45e0-81ee-fff040cddec7" containerName="console" Jul 21 01:27:41.514761 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.514541 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f2f2689-86aa-45e0-81ee-fff040cddec7" containerName="console" Jul 21 01:27:41.514761 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.514604 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f2f2689-86aa-45e0-81ee-fff040cddec7" containerName="console" Jul 21 01:27:41.517557 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.517540 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" Jul 21 01:27:41.520247 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.520229 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 21 01:27:41.520353 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.520276 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 21 01:27:41.521436 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.521419 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rhfhq\"" Jul 21 01:27:41.526844 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.526822 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58"] Jul 21 01:27:41.653507 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.653472 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58\" (UID: \"a2db99a4-0ce8-402d-82be-9e9d1edd0fce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" Jul 21 01:27:41.653686 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.653514 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58\" (UID: \"a2db99a4-0ce8-402d-82be-9e9d1edd0fce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" Jul 21 01:27:41.653686 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.653566 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz8m6\" (UniqueName: \"kubernetes.io/projected/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-kube-api-access-hz8m6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58\" (UID: \"a2db99a4-0ce8-402d-82be-9e9d1edd0fce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" Jul 21 01:27:41.754590 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.754550 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58\" (UID: \"a2db99a4-0ce8-402d-82be-9e9d1edd0fce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" Jul 21 01:27:41.754590 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.754593 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58\" (UID: \"a2db99a4-0ce8-402d-82be-9e9d1edd0fce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" Jul 21 01:27:41.754780 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.754623 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz8m6\" (UniqueName: \"kubernetes.io/projected/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-kube-api-access-hz8m6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58\" (UID: \"a2db99a4-0ce8-402d-82be-9e9d1edd0fce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" Jul 21 01:27:41.754964 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.754945 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58\" (UID: \"a2db99a4-0ce8-402d-82be-9e9d1edd0fce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" Jul 21 01:27:41.755038 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.755020 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58\" (UID: \"a2db99a4-0ce8-402d-82be-9e9d1edd0fce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" Jul 21 01:27:41.764657 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.764616 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz8m6\" (UniqueName: \"kubernetes.io/projected/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-kube-api-access-hz8m6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58\" (UID: \"a2db99a4-0ce8-402d-82be-9e9d1edd0fce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" Jul 21 01:27:41.827710 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.827681 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" Jul 21 01:27:41.956616 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.956583 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58"] Jul 21 01:27:41.960146 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:27:41.960118 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2db99a4_0ce8_402d_82be_9e9d1edd0fce.slice/crio-5f5b56c16ed39b556515540a429c32509b2df47da7be65994091f52c5f33fc5c WatchSource:0}: Error finding container 5f5b56c16ed39b556515540a429c32509b2df47da7be65994091f52c5f33fc5c: Status 404 returned error can't find the container with id 5f5b56c16ed39b556515540a429c32509b2df47da7be65994091f52c5f33fc5c Jul 21 01:27:41.962163 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:41.962146 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 01:27:42.321325 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:42.321288 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" event={"ID":"a2db99a4-0ce8-402d-82be-9e9d1edd0fce","Type":"ContainerStarted","Data":"5f5b56c16ed39b556515540a429c32509b2df47da7be65994091f52c5f33fc5c"} Jul 21 01:27:49.353453 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:49.353410 2553 generic.go:356] "Generic (PLEG): container finished" podID="a2db99a4-0ce8-402d-82be-9e9d1edd0fce" containerID="f3101968ae808d29ea47c92e06924a2186ad214dabceefee5ea24f5c08f14eaa" exitCode=0 Jul 21 01:27:49.353856 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:49.353497 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" event={"ID":"a2db99a4-0ce8-402d-82be-9e9d1edd0fce","Type":"ContainerDied","Data":"f3101968ae808d29ea47c92e06924a2186ad214dabceefee5ea24f5c08f14eaa"} Jul 21 01:27:52.370052 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:52.370010 2553 generic.go:356] "Generic (PLEG): container finished" podID="a2db99a4-0ce8-402d-82be-9e9d1edd0fce" containerID="31a767c05912a6bc5a2033c6995889fd2be8f4cc49aca61b91d9044a1613bbe5" exitCode=0 Jul 21 01:27:52.370425 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:27:52.370107 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" event={"ID":"a2db99a4-0ce8-402d-82be-9e9d1edd0fce","Type":"ContainerDied","Data":"31a767c05912a6bc5a2033c6995889fd2be8f4cc49aca61b91d9044a1613bbe5"} Jul 21 01:28:01.414631 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:01.414593 2553 generic.go:356] "Generic (PLEG): container finished" podID="a2db99a4-0ce8-402d-82be-9e9d1edd0fce" containerID="76daa12463fa07f9ee55438fd4e895f4ce77ca4f6560553096a6f436e9221012" exitCode=0 Jul 21 01:28:01.415075 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:01.414680 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" event={"ID":"a2db99a4-0ce8-402d-82be-9e9d1edd0fce","Type":"ContainerDied","Data":"76daa12463fa07f9ee55438fd4e895f4ce77ca4f6560553096a6f436e9221012"} Jul 21 01:28:02.543864 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:02.543840 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" Jul 21 01:28:02.633008 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:02.632969 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz8m6\" (UniqueName: \"kubernetes.io/projected/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-kube-api-access-hz8m6\") pod \"a2db99a4-0ce8-402d-82be-9e9d1edd0fce\" (UID: \"a2db99a4-0ce8-402d-82be-9e9d1edd0fce\") " Jul 21 01:28:02.633202 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:02.633032 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-util\") pod \"a2db99a4-0ce8-402d-82be-9e9d1edd0fce\" (UID: \"a2db99a4-0ce8-402d-82be-9e9d1edd0fce\") " Jul 21 01:28:02.633202 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:02.633065 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-bundle\") pod \"a2db99a4-0ce8-402d-82be-9e9d1edd0fce\" (UID: \"a2db99a4-0ce8-402d-82be-9e9d1edd0fce\") " Jul 21 01:28:02.633720 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:02.633694 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-bundle" (OuterVolumeSpecName: "bundle") pod "a2db99a4-0ce8-402d-82be-9e9d1edd0fce" (UID: "a2db99a4-0ce8-402d-82be-9e9d1edd0fce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:28:02.635321 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:02.635297 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-kube-api-access-hz8m6" (OuterVolumeSpecName: "kube-api-access-hz8m6") pod "a2db99a4-0ce8-402d-82be-9e9d1edd0fce" (UID: "a2db99a4-0ce8-402d-82be-9e9d1edd0fce"). InnerVolumeSpecName "kube-api-access-hz8m6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:28:02.637453 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:02.637427 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-util" (OuterVolumeSpecName: "util") pod "a2db99a4-0ce8-402d-82be-9e9d1edd0fce" (UID: "a2db99a4-0ce8-402d-82be-9e9d1edd0fce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:28:02.733775 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:02.733745 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-bundle\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:28:02.733775 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:02.733776 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz8m6\" (UniqueName: \"kubernetes.io/projected/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-kube-api-access-hz8m6\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:28:02.733983 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:02.733787 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2db99a4-0ce8-402d-82be-9e9d1edd0fce-util\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:28:03.425047 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:03.425021 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" Jul 21 01:28:03.425223 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:03.425010 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406lt58" event={"ID":"a2db99a4-0ce8-402d-82be-9e9d1edd0fce","Type":"ContainerDied","Data":"5f5b56c16ed39b556515540a429c32509b2df47da7be65994091f52c5f33fc5c"} Jul 21 01:28:03.425223 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:03.425142 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f5b56c16ed39b556515540a429c32509b2df47da7be65994091f52c5f33fc5c" Jul 21 01:28:09.570963 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.570927 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z6ncx"] Jul 21 01:28:09.571348 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.571198 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2db99a4-0ce8-402d-82be-9e9d1edd0fce" containerName="util" Jul 21 01:28:09.571348 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.571208 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2db99a4-0ce8-402d-82be-9e9d1edd0fce" containerName="util" Jul 21 01:28:09.571348 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.571215 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2db99a4-0ce8-402d-82be-9e9d1edd0fce" containerName="pull" Jul 21 01:28:09.571348 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.571220 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2db99a4-0ce8-402d-82be-9e9d1edd0fce" containerName="pull" Jul 21 01:28:09.571348 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.571237 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2db99a4-0ce8-402d-82be-9e9d1edd0fce" containerName="extract" Jul 21 01:28:09.571348 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.571243 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2db99a4-0ce8-402d-82be-9e9d1edd0fce" containerName="extract" Jul 21 01:28:09.571348 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.571291 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2db99a4-0ce8-402d-82be-9e9d1edd0fce" containerName="extract" Jul 21 01:28:09.575967 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.575950 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z6ncx" Jul 21 01:28:09.579095 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.579064 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 21 01:28:09.579217 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.579080 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 21 01:28:09.579217 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.579123 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-js2kn\"" Jul 21 01:28:09.586754 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.586729 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z6ncx"] Jul 21 01:28:09.687086 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.687050 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/027ac704-a264-4677-8ea1-224cbcc8cede-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z6ncx\" (UID: \"027ac704-a264-4677-8ea1-224cbcc8cede\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z6ncx" Jul 21 01:28:09.687267 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.687115 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht778\" (UniqueName: \"kubernetes.io/projected/027ac704-a264-4677-8ea1-224cbcc8cede-kube-api-access-ht778\") pod \"cert-manager-operator-controller-manager-55c444bf86-z6ncx\" (UID: \"027ac704-a264-4677-8ea1-224cbcc8cede\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z6ncx" Jul 21 01:28:09.788094 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.788056 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht778\" (UniqueName: \"kubernetes.io/projected/027ac704-a264-4677-8ea1-224cbcc8cede-kube-api-access-ht778\") pod \"cert-manager-operator-controller-manager-55c444bf86-z6ncx\" (UID: \"027ac704-a264-4677-8ea1-224cbcc8cede\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z6ncx" Jul 21 01:28:09.788280 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.788112 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/027ac704-a264-4677-8ea1-224cbcc8cede-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z6ncx\" (UID: \"027ac704-a264-4677-8ea1-224cbcc8cede\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z6ncx" Jul 21 01:28:09.788453 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.788437 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/027ac704-a264-4677-8ea1-224cbcc8cede-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z6ncx\" (UID: \"027ac704-a264-4677-8ea1-224cbcc8cede\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z6ncx" Jul 21 01:28:09.797646 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.797612 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht778\" (UniqueName: \"kubernetes.io/projected/027ac704-a264-4677-8ea1-224cbcc8cede-kube-api-access-ht778\") pod \"cert-manager-operator-controller-manager-55c444bf86-z6ncx\" (UID: \"027ac704-a264-4677-8ea1-224cbcc8cede\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z6ncx" Jul 21 01:28:09.884598 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:09.884509 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z6ncx" Jul 21 01:28:10.026712 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:10.026689 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z6ncx"] Jul 21 01:28:10.029536 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:28:10.029504 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027ac704_a264_4677_8ea1_224cbcc8cede.slice/crio-9e54d7d02409e23dbfb8d42878ad6b6cb91cc585b23a54ee40f0d515cc4719ec WatchSource:0}: Error finding container 9e54d7d02409e23dbfb8d42878ad6b6cb91cc585b23a54ee40f0d515cc4719ec: Status 404 returned error can't find the container with id 9e54d7d02409e23dbfb8d42878ad6b6cb91cc585b23a54ee40f0d515cc4719ec Jul 21 01:28:10.453366 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:10.453331 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z6ncx" event={"ID":"027ac704-a264-4677-8ea1-224cbcc8cede","Type":"ContainerStarted","Data":"9e54d7d02409e23dbfb8d42878ad6b6cb91cc585b23a54ee40f0d515cc4719ec"} Jul 21 01:28:12.463520 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:12.463485 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z6ncx" event={"ID":"027ac704-a264-4677-8ea1-224cbcc8cede","Type":"ContainerStarted","Data":"5eaac4d89ec57075bef2a05ee2530fc8924de5b968b3f8e1d1d467e7f960a7bb"} Jul 21 01:28:12.485674 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:12.485621 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z6ncx" podStartSLOduration=1.671136507 podStartE2EDuration="3.485604346s" totalImagesPullingTime="1.814467839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:28:12.48333756 +0000 UTC m=+372.169986128" watchObservedRunningTime="2026-07-21 01:28:12.485604346 +0000 UTC m=+372.172252900" Jul 21 01:28:13.007999 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.007961 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-g2x2s"] Jul 21 01:28:13.010396 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.010373 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-g2x2s" Jul 21 01:28:13.014304 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.014280 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-94xgx\"" Jul 21 01:28:13.014304 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.014280 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 21 01:28:13.014910 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.014893 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 21 01:28:13.040484 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.040454 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-g2x2s"] Jul 21 01:28:13.117555 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.117520 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fda886f4-8ea2-4550-b6a0-ada399d08b5b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-g2x2s\" (UID: \"fda886f4-8ea2-4550-b6a0-ada399d08b5b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-g2x2s" Jul 21 01:28:13.117734 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.117590 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9jxc\" (UniqueName: \"kubernetes.io/projected/fda886f4-8ea2-4550-b6a0-ada399d08b5b-kube-api-access-t9jxc\") pod \"cert-manager-webhook-6486ffd997-g2x2s\" (UID: \"fda886f4-8ea2-4550-b6a0-ada399d08b5b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-g2x2s" Jul 21 01:28:13.218786 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.218750 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fda886f4-8ea2-4550-b6a0-ada399d08b5b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-g2x2s\" (UID: \"fda886f4-8ea2-4550-b6a0-ada399d08b5b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-g2x2s" Jul 21 01:28:13.218972 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.218838 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9jxc\" (UniqueName: \"kubernetes.io/projected/fda886f4-8ea2-4550-b6a0-ada399d08b5b-kube-api-access-t9jxc\") pod \"cert-manager-webhook-6486ffd997-g2x2s\" (UID: \"fda886f4-8ea2-4550-b6a0-ada399d08b5b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-g2x2s" Jul 21 01:28:13.227633 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.227604 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fda886f4-8ea2-4550-b6a0-ada399d08b5b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-g2x2s\" (UID: \"fda886f4-8ea2-4550-b6a0-ada399d08b5b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-g2x2s" Jul 21 01:28:13.227755 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.227610 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9jxc\" (UniqueName: \"kubernetes.io/projected/fda886f4-8ea2-4550-b6a0-ada399d08b5b-kube-api-access-t9jxc\") pod \"cert-manager-webhook-6486ffd997-g2x2s\" (UID: \"fda886f4-8ea2-4550-b6a0-ada399d08b5b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-g2x2s" Jul 21 01:28:13.327458 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.327367 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-g2x2s" Jul 21 01:28:13.457132 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.457106 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-g2x2s"] Jul 21 01:28:13.459499 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:28:13.459462 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfda886f4_8ea2_4550_b6a0_ada399d08b5b.slice/crio-7c605d6895c578063568b709508430f3ae653151482e7f7f66a62f434b3cedd1 WatchSource:0}: Error finding container 7c605d6895c578063568b709508430f3ae653151482e7f7f66a62f434b3cedd1: Status 404 returned error can't find the container with id 7c605d6895c578063568b709508430f3ae653151482e7f7f66a62f434b3cedd1 Jul 21 01:28:13.469711 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.469683 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-g2x2s" event={"ID":"fda886f4-8ea2-4550-b6a0-ada399d08b5b","Type":"ContainerStarted","Data":"7c605d6895c578063568b709508430f3ae653151482e7f7f66a62f434b3cedd1"} Jul 21 01:28:13.585127 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.585044 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p"] Jul 21 01:28:13.590414 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.590395 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" Jul 21 01:28:13.593260 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.593227 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 21 01:28:13.593260 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.593255 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 21 01:28:13.593418 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.593320 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rhfhq\"" Jul 21 01:28:13.602007 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.601981 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p"] Jul 21 01:28:13.723020 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.722989 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e034e93-c690-4225-9aef-4b9db1c66b66-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p\" (UID: \"9e034e93-c690-4225-9aef-4b9db1c66b66\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" Jul 21 01:28:13.723177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.723036 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e034e93-c690-4225-9aef-4b9db1c66b66-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p\" (UID: \"9e034e93-c690-4225-9aef-4b9db1c66b66\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" Jul 21 01:28:13.723177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.723087 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzrnc\" (UniqueName: \"kubernetes.io/projected/9e034e93-c690-4225-9aef-4b9db1c66b66-kube-api-access-vzrnc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p\" (UID: \"9e034e93-c690-4225-9aef-4b9db1c66b66\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" Jul 21 01:28:13.823873 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.823839 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e034e93-c690-4225-9aef-4b9db1c66b66-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p\" (UID: \"9e034e93-c690-4225-9aef-4b9db1c66b66\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" Jul 21 01:28:13.824081 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.823896 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e034e93-c690-4225-9aef-4b9db1c66b66-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p\" (UID: \"9e034e93-c690-4225-9aef-4b9db1c66b66\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" Jul 21 01:28:13.824081 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.823956 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzrnc\" (UniqueName: \"kubernetes.io/projected/9e034e93-c690-4225-9aef-4b9db1c66b66-kube-api-access-vzrnc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p\" (UID: \"9e034e93-c690-4225-9aef-4b9db1c66b66\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" Jul 21 01:28:13.824254 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.824234 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e034e93-c690-4225-9aef-4b9db1c66b66-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p\" (UID: \"9e034e93-c690-4225-9aef-4b9db1c66b66\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" Jul 21 01:28:13.824343 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.824269 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e034e93-c690-4225-9aef-4b9db1c66b66-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p\" (UID: \"9e034e93-c690-4225-9aef-4b9db1c66b66\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" Jul 21 01:28:13.833902 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.833883 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzrnc\" (UniqueName: \"kubernetes.io/projected/9e034e93-c690-4225-9aef-4b9db1c66b66-kube-api-access-vzrnc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p\" (UID: \"9e034e93-c690-4225-9aef-4b9db1c66b66\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" Jul 21 01:28:13.899858 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:13.899766 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" Jul 21 01:28:14.029709 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:14.029684 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p"] Jul 21 01:28:14.031777 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:28:14.031747 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e034e93_c690_4225_9aef_4b9db1c66b66.slice/crio-9465c17972733ec315e1804afec946a2a6889212d6e7005003e8723f3ceb908f WatchSource:0}: Error finding container 9465c17972733ec315e1804afec946a2a6889212d6e7005003e8723f3ceb908f: Status 404 returned error can't find the container with id 9465c17972733ec315e1804afec946a2a6889212d6e7005003e8723f3ceb908f Jul 21 01:28:14.476998 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:14.476961 2553 generic.go:356] "Generic (PLEG): container finished" podID="9e034e93-c690-4225-9aef-4b9db1c66b66" containerID="a12b8c8ec42d27e6debca2593fdd22b4bd20060971d1f6c61734837a5f707c35" exitCode=0 Jul 21 01:28:14.477415 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:14.477058 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" event={"ID":"9e034e93-c690-4225-9aef-4b9db1c66b66","Type":"ContainerDied","Data":"a12b8c8ec42d27e6debca2593fdd22b4bd20060971d1f6c61734837a5f707c35"} Jul 21 01:28:14.477415 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:14.477115 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" event={"ID":"9e034e93-c690-4225-9aef-4b9db1c66b66","Type":"ContainerStarted","Data":"9465c17972733ec315e1804afec946a2a6889212d6e7005003e8723f3ceb908f"} Jul 21 01:28:17.494563 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:17.494522 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-g2x2s" event={"ID":"fda886f4-8ea2-4550-b6a0-ada399d08b5b","Type":"ContainerStarted","Data":"d1aa1a842efe932d7e7be46d0ba60cf2c9c11bddd085df91ae0dba7a193b1a36"} Jul 21 01:28:17.495015 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:17.494579 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-g2x2s" Jul 21 01:28:17.496355 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:17.496330 2553 generic.go:356] "Generic (PLEG): container finished" podID="9e034e93-c690-4225-9aef-4b9db1c66b66" containerID="d7a4f695285b73996396a110933b291facbae0dd490a9d959ebc9c3de2c97abc" exitCode=0 Jul 21 01:28:17.496462 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:17.496391 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" event={"ID":"9e034e93-c690-4225-9aef-4b9db1c66b66","Type":"ContainerDied","Data":"d7a4f695285b73996396a110933b291facbae0dd490a9d959ebc9c3de2c97abc"} Jul 21 01:28:17.510377 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:17.510327 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-g2x2s" podStartSLOduration=1.848633484 podStartE2EDuration="5.510311231s" totalImagesPullingTime="3.661677747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:28:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:28:17.510211764 +0000 UTC m=+377.196860319" watchObservedRunningTime="2026-07-21 01:28:17.510311231 +0000 UTC m=+377.196959787" Jul 21 01:28:18.502825 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:18.502779 2553 generic.go:356] "Generic (PLEG): container finished" podID="9e034e93-c690-4225-9aef-4b9db1c66b66" containerID="d1a9c160207ebb5b2c6941d8357ea64a870c01a85d6a5968d30d970cdac2e112" exitCode=0 Jul 21 01:28:18.503204 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:18.502867 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" event={"ID":"9e034e93-c690-4225-9aef-4b9db1c66b66","Type":"ContainerDied","Data":"d1a9c160207ebb5b2c6941d8357ea64a870c01a85d6a5968d30d970cdac2e112"} Jul 21 01:28:19.639669 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:19.639645 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" Jul 21 01:28:19.773706 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:19.773625 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e034e93-c690-4225-9aef-4b9db1c66b66-bundle\") pod \"9e034e93-c690-4225-9aef-4b9db1c66b66\" (UID: \"9e034e93-c690-4225-9aef-4b9db1c66b66\") " Jul 21 01:28:19.773706 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:19.773664 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzrnc\" (UniqueName: \"kubernetes.io/projected/9e034e93-c690-4225-9aef-4b9db1c66b66-kube-api-access-vzrnc\") pod \"9e034e93-c690-4225-9aef-4b9db1c66b66\" (UID: \"9e034e93-c690-4225-9aef-4b9db1c66b66\") " Jul 21 01:28:19.773907 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:19.773743 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e034e93-c690-4225-9aef-4b9db1c66b66-util\") pod \"9e034e93-c690-4225-9aef-4b9db1c66b66\" (UID: \"9e034e93-c690-4225-9aef-4b9db1c66b66\") " Jul 21 01:28:19.774136 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:19.774111 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e034e93-c690-4225-9aef-4b9db1c66b66-bundle" (OuterVolumeSpecName: "bundle") pod "9e034e93-c690-4225-9aef-4b9db1c66b66" (UID: "9e034e93-c690-4225-9aef-4b9db1c66b66"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:28:19.775988 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:19.775959 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e034e93-c690-4225-9aef-4b9db1c66b66-kube-api-access-vzrnc" (OuterVolumeSpecName: "kube-api-access-vzrnc") pod "9e034e93-c690-4225-9aef-4b9db1c66b66" (UID: "9e034e93-c690-4225-9aef-4b9db1c66b66"). InnerVolumeSpecName "kube-api-access-vzrnc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:28:19.778755 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:19.778731 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e034e93-c690-4225-9aef-4b9db1c66b66-util" (OuterVolumeSpecName: "util") pod "9e034e93-c690-4225-9aef-4b9db1c66b66" (UID: "9e034e93-c690-4225-9aef-4b9db1c66b66"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:28:19.875053 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:19.875004 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e034e93-c690-4225-9aef-4b9db1c66b66-util\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:28:19.875053 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:19.875047 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e034e93-c690-4225-9aef-4b9db1c66b66-bundle\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:28:19.875053 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:19.875058 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzrnc\" (UniqueName: \"kubernetes.io/projected/9e034e93-c690-4225-9aef-4b9db1c66b66-kube-api-access-vzrnc\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:28:20.516097 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:20.516051 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" event={"ID":"9e034e93-c690-4225-9aef-4b9db1c66b66","Type":"ContainerDied","Data":"9465c17972733ec315e1804afec946a2a6889212d6e7005003e8723f3ceb908f"} Jul 21 01:28:20.516262 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:20.516116 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9465c17972733ec315e1804afec946a2a6889212d6e7005003e8723f3ceb908f" Jul 21 01:28:20.516262 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:20.516070 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8km8p" Jul 21 01:28:23.505286 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:23.505254 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-g2x2s" Jul 21 01:28:26.201848 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.201813 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jcdv"] Jul 21 01:28:26.202223 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.202097 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e034e93-c690-4225-9aef-4b9db1c66b66" containerName="extract" Jul 21 01:28:26.202223 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.202108 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e034e93-c690-4225-9aef-4b9db1c66b66" containerName="extract" Jul 21 01:28:26.202223 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.202118 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e034e93-c690-4225-9aef-4b9db1c66b66" containerName="pull" Jul 21 01:28:26.202223 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.202122 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e034e93-c690-4225-9aef-4b9db1c66b66" containerName="pull" Jul 21 01:28:26.202223 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.202137 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e034e93-c690-4225-9aef-4b9db1c66b66" containerName="util" Jul 21 01:28:26.202223 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.202142 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e034e93-c690-4225-9aef-4b9db1c66b66" containerName="util" Jul 21 01:28:26.202223 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.202192 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e034e93-c690-4225-9aef-4b9db1c66b66" containerName="extract" Jul 21 01:28:26.206204 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.206184 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jcdv" Jul 21 01:28:26.208965 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.208939 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 21 01:28:26.210104 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.210087 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-4hm9w\"" Jul 21 01:28:26.210206 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.210092 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 21 01:28:26.214824 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.214777 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jcdv"] Jul 21 01:28:26.227112 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.227085 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eecc3d5a-da40-425f-8b56-9af604cc9411-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7jcdv\" (UID: \"eecc3d5a-da40-425f-8b56-9af604cc9411\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jcdv" Jul 21 01:28:26.227229 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.227123 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mspsv\" (UniqueName: \"kubernetes.io/projected/eecc3d5a-da40-425f-8b56-9af604cc9411-kube-api-access-mspsv\") pod \"openshift-lws-operator-fd8ccff4c-7jcdv\" (UID: \"eecc3d5a-da40-425f-8b56-9af604cc9411\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jcdv" Jul 21 01:28:26.327492 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.327451 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eecc3d5a-da40-425f-8b56-9af604cc9411-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7jcdv\" (UID: \"eecc3d5a-da40-425f-8b56-9af604cc9411\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jcdv" Jul 21 01:28:26.327688 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.327501 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mspsv\" (UniqueName: \"kubernetes.io/projected/eecc3d5a-da40-425f-8b56-9af604cc9411-kube-api-access-mspsv\") pod \"openshift-lws-operator-fd8ccff4c-7jcdv\" (UID: \"eecc3d5a-da40-425f-8b56-9af604cc9411\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jcdv" Jul 21 01:28:26.327877 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.327857 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eecc3d5a-da40-425f-8b56-9af604cc9411-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7jcdv\" (UID: \"eecc3d5a-da40-425f-8b56-9af604cc9411\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jcdv" Jul 21 01:28:26.336132 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.336112 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mspsv\" (UniqueName: \"kubernetes.io/projected/eecc3d5a-da40-425f-8b56-9af604cc9411-kube-api-access-mspsv\") pod \"openshift-lws-operator-fd8ccff4c-7jcdv\" (UID: \"eecc3d5a-da40-425f-8b56-9af604cc9411\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jcdv" Jul 21 01:28:26.515963 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.515933 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jcdv" Jul 21 01:28:26.652039 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:26.652006 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jcdv"] Jul 21 01:28:26.655034 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:28:26.655006 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeecc3d5a_da40_425f_8b56_9af604cc9411.slice/crio-7f939458ba7ef74ffad2c3a6fdf55171222c74e98879f8e9c42a46283e7a1644 WatchSource:0}: Error finding container 7f939458ba7ef74ffad2c3a6fdf55171222c74e98879f8e9c42a46283e7a1644: Status 404 returned error can't find the container with id 7f939458ba7ef74ffad2c3a6fdf55171222c74e98879f8e9c42a46283e7a1644 Jul 21 01:28:27.549119 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:27.549072 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jcdv" event={"ID":"eecc3d5a-da40-425f-8b56-9af604cc9411","Type":"ContainerStarted","Data":"7f939458ba7ef74ffad2c3a6fdf55171222c74e98879f8e9c42a46283e7a1644"} Jul 21 01:28:29.560082 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:29.560047 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jcdv" event={"ID":"eecc3d5a-da40-425f-8b56-9af604cc9411","Type":"ContainerStarted","Data":"06d20f92ee78396729533cfd2852a7ca84212864cd8033e9d86910157f15db53"} Jul 21 01:28:29.592007 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:29.591945 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jcdv" podStartSLOduration=1.247758866 podStartE2EDuration="3.591925701s" totalImagesPullingTime="2.344166835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:28:29.590254788 +0000 UTC m=+389.276903430" watchObservedRunningTime="2026-07-21 01:28:29.591925701 +0000 UTC m=+389.278574258" Jul 21 01:28:33.043329 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.043294 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm"] Jul 21 01:28:33.054324 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.054296 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" Jul 21 01:28:33.056003 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.055977 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm"] Jul 21 01:28:33.057015 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.056991 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 21 01:28:33.057192 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.057170 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 21 01:28:33.058365 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.058347 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rhfhq\"" Jul 21 01:28:33.091158 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.091124 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h54d9\" (UniqueName: \"kubernetes.io/projected/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-kube-api-access-h54d9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm\" (UID: \"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" Jul 21 01:28:33.091325 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.091178 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm\" (UID: \"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" Jul 21 01:28:33.091325 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.091201 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm\" (UID: \"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" Jul 21 01:28:33.192568 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.192532 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h54d9\" (UniqueName: \"kubernetes.io/projected/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-kube-api-access-h54d9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm\" (UID: \"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" Jul 21 01:28:33.192772 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.192579 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm\" (UID: \"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" Jul 21 01:28:33.192772 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.192692 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm\" (UID: \"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" Jul 21 01:28:33.193067 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.193046 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm\" (UID: \"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" Jul 21 01:28:33.193130 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.193086 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm\" (UID: \"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" Jul 21 01:28:33.201215 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.201188 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h54d9\" (UniqueName: \"kubernetes.io/projected/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-kube-api-access-h54d9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm\" (UID: \"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" Jul 21 01:28:33.364989 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.364901 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" Jul 21 01:28:33.513112 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.513037 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm"] Jul 21 01:28:33.515873 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:28:33.515844 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f8397a2_f1d4_4a63_b6e5_d686b84d26e7.slice/crio-ab7218b43f0f12b70236d2db3518a0d0f689eb061a884eff80e1e7c89826b1e6 WatchSource:0}: Error finding container ab7218b43f0f12b70236d2db3518a0d0f689eb061a884eff80e1e7c89826b1e6: Status 404 returned error can't find the container with id ab7218b43f0f12b70236d2db3518a0d0f689eb061a884eff80e1e7c89826b1e6 Jul 21 01:28:33.579732 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.579696 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" event={"ID":"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7","Type":"ContainerStarted","Data":"205e0a4a3e3d7dde9f37227ac0bff76f870ac2a19144fc60a211ee7670291b8f"} Jul 21 01:28:33.579902 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:33.579758 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" event={"ID":"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7","Type":"ContainerStarted","Data":"ab7218b43f0f12b70236d2db3518a0d0f689eb061a884eff80e1e7c89826b1e6"} Jul 21 01:28:34.585872 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:34.585837 2553 generic.go:356] "Generic (PLEG): container finished" podID="3f8397a2-f1d4-4a63-b6e5-d686b84d26e7" containerID="205e0a4a3e3d7dde9f37227ac0bff76f870ac2a19144fc60a211ee7670291b8f" exitCode=0 Jul 21 01:28:34.586272 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:34.585924 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" event={"ID":"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7","Type":"ContainerDied","Data":"205e0a4a3e3d7dde9f37227ac0bff76f870ac2a19144fc60a211ee7670291b8f"} Jul 21 01:28:35.592016 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:35.591976 2553 generic.go:356] "Generic (PLEG): container finished" podID="3f8397a2-f1d4-4a63-b6e5-d686b84d26e7" containerID="8710bae5fb7bd276a56418b1d96bfd581f7409e5951000be9b3ab21890a57a27" exitCode=0 Jul 21 01:28:35.592422 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:35.592055 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" event={"ID":"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7","Type":"ContainerDied","Data":"8710bae5fb7bd276a56418b1d96bfd581f7409e5951000be9b3ab21890a57a27"} Jul 21 01:28:36.598735 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:36.598696 2553 generic.go:356] "Generic (PLEG): container finished" podID="3f8397a2-f1d4-4a63-b6e5-d686b84d26e7" containerID="007be638c524d3e171aea2a7a6b76c4ca5cdf917123140d99ac794085211c98d" exitCode=0 Jul 21 01:28:36.599144 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:36.598752 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" event={"ID":"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7","Type":"ContainerDied","Data":"007be638c524d3e171aea2a7a6b76c4ca5cdf917123140d99ac794085211c98d"} Jul 21 01:28:37.729857 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:37.729834 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" Jul 21 01:28:37.834925 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:37.834891 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h54d9\" (UniqueName: \"kubernetes.io/projected/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-kube-api-access-h54d9\") pod \"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7\" (UID: \"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7\") " Jul 21 01:28:37.835122 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:37.834936 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-bundle\") pod \"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7\" (UID: \"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7\") " Jul 21 01:28:37.835122 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:37.834959 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-util\") pod \"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7\" (UID: \"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7\") " Jul 21 01:28:37.835626 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:37.835598 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-bundle" (OuterVolumeSpecName: "bundle") pod "3f8397a2-f1d4-4a63-b6e5-d686b84d26e7" (UID: "3f8397a2-f1d4-4a63-b6e5-d686b84d26e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:28:37.837149 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:37.837124 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-kube-api-access-h54d9" (OuterVolumeSpecName: "kube-api-access-h54d9") pod "3f8397a2-f1d4-4a63-b6e5-d686b84d26e7" (UID: "3f8397a2-f1d4-4a63-b6e5-d686b84d26e7"). InnerVolumeSpecName "kube-api-access-h54d9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:28:37.840603 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:37.840570 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-util" (OuterVolumeSpecName: "util") pod "3f8397a2-f1d4-4a63-b6e5-d686b84d26e7" (UID: "3f8397a2-f1d4-4a63-b6e5-d686b84d26e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:28:37.936203 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:37.936107 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-util\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:28:37.936203 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:37.936150 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h54d9\" (UniqueName: \"kubernetes.io/projected/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-kube-api-access-h54d9\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:28:37.936203 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:37.936162 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f8397a2-f1d4-4a63-b6e5-d686b84d26e7-bundle\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:28:38.609536 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:38.609508 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" Jul 21 01:28:38.609719 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:38.609503 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxpgrm" event={"ID":"3f8397a2-f1d4-4a63-b6e5-d686b84d26e7","Type":"ContainerDied","Data":"ab7218b43f0f12b70236d2db3518a0d0f689eb061a884eff80e1e7c89826b1e6"} Jul 21 01:28:38.609719 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:38.609638 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab7218b43f0f12b70236d2db3518a0d0f689eb061a884eff80e1e7c89826b1e6" Jul 21 01:28:45.121996 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.121964 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g"] Jul 21 01:28:45.122649 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.122251 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f8397a2-f1d4-4a63-b6e5-d686b84d26e7" containerName="util" Jul 21 01:28:45.122649 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.122261 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f8397a2-f1d4-4a63-b6e5-d686b84d26e7" containerName="util" Jul 21 01:28:45.122649 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.122271 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f8397a2-f1d4-4a63-b6e5-d686b84d26e7" containerName="extract" Jul 21 01:28:45.122649 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.122276 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f8397a2-f1d4-4a63-b6e5-d686b84d26e7" containerName="extract" Jul 21 01:28:45.122649 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.122288 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f8397a2-f1d4-4a63-b6e5-d686b84d26e7" containerName="pull" Jul 21 01:28:45.122649 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.122293 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f8397a2-f1d4-4a63-b6e5-d686b84d26e7" containerName="pull" Jul 21 01:28:45.122649 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.122355 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f8397a2-f1d4-4a63-b6e5-d686b84d26e7" containerName="extract" Jul 21 01:28:45.124458 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.124438 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.127204 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.127182 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 21 01:28:45.127344 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.127286 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6gbcd\"" Jul 21 01:28:45.127344 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.127286 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 21 01:28:45.127344 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.127320 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 21 01:28:45.127516 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.127371 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 21 01:28:45.140101 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.140073 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g"] Jul 21 01:28:45.201258 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.199958 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f19a9334-decc-46cd-8d77-9c85d5f2e5d5-manifests\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-6tp6g\" (UID: \"f19a9334-decc-46cd-8d77-9c85d5f2e5d5\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.201258 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.200020 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f19a9334-decc-46cd-8d77-9c85d5f2e5d5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-6tp6g\" (UID: \"f19a9334-decc-46cd-8d77-9c85d5f2e5d5\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.201258 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.200076 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f19a9334-decc-46cd-8d77-9c85d5f2e5d5-tmp\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-6tp6g\" (UID: \"f19a9334-decc-46cd-8d77-9c85d5f2e5d5\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.201258 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.200117 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f19a9334-decc-46cd-8d77-9c85d5f2e5d5-webhook-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-6tp6g\" (UID: \"f19a9334-decc-46cd-8d77-9c85d5f2e5d5\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.201258 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.200166 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm86f\" (UniqueName: \"kubernetes.io/projected/f19a9334-decc-46cd-8d77-9c85d5f2e5d5-kube-api-access-jm86f\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-6tp6g\" (UID: \"f19a9334-decc-46cd-8d77-9c85d5f2e5d5\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.301398 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.301359 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f19a9334-decc-46cd-8d77-9c85d5f2e5d5-tmp\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-6tp6g\" (UID: \"f19a9334-decc-46cd-8d77-9c85d5f2e5d5\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.301586 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.301410 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f19a9334-decc-46cd-8d77-9c85d5f2e5d5-webhook-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-6tp6g\" (UID: \"f19a9334-decc-46cd-8d77-9c85d5f2e5d5\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.301586 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.301453 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm86f\" (UniqueName: \"kubernetes.io/projected/f19a9334-decc-46cd-8d77-9c85d5f2e5d5-kube-api-access-jm86f\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-6tp6g\" (UID: \"f19a9334-decc-46cd-8d77-9c85d5f2e5d5\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.301586 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.301510 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f19a9334-decc-46cd-8d77-9c85d5f2e5d5-manifests\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-6tp6g\" (UID: \"f19a9334-decc-46cd-8d77-9c85d5f2e5d5\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.301586 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.301544 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f19a9334-decc-46cd-8d77-9c85d5f2e5d5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-6tp6g\" (UID: \"f19a9334-decc-46cd-8d77-9c85d5f2e5d5\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.301964 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.301935 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f19a9334-decc-46cd-8d77-9c85d5f2e5d5-manifests\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-6tp6g\" (UID: \"f19a9334-decc-46cd-8d77-9c85d5f2e5d5\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.303883 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.303859 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f19a9334-decc-46cd-8d77-9c85d5f2e5d5-tmp\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-6tp6g\" (UID: \"f19a9334-decc-46cd-8d77-9c85d5f2e5d5\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.304230 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.304197 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f19a9334-decc-46cd-8d77-9c85d5f2e5d5-webhook-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-6tp6g\" (UID: \"f19a9334-decc-46cd-8d77-9c85d5f2e5d5\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.304341 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.304247 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f19a9334-decc-46cd-8d77-9c85d5f2e5d5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-6tp6g\" (UID: \"f19a9334-decc-46cd-8d77-9c85d5f2e5d5\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.311082 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.311058 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm86f\" (UniqueName: \"kubernetes.io/projected/f19a9334-decc-46cd-8d77-9c85d5f2e5d5-kube-api-access-jm86f\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-6tp6g\" (UID: \"f19a9334-decc-46cd-8d77-9c85d5f2e5d5\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.435279 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.435199 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:45.579298 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.579268 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g"] Jul 21 01:28:45.583361 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:28:45.583333 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19a9334_decc_46cd_8d77_9c85d5f2e5d5.slice/crio-591d1a28e27c865ab5f8080a57ba885b1c858e387fa355d8dd833570afb21037 WatchSource:0}: Error finding container 591d1a28e27c865ab5f8080a57ba885b1c858e387fa355d8dd833570afb21037: Status 404 returned error can't find the container with id 591d1a28e27c865ab5f8080a57ba885b1c858e387fa355d8dd833570afb21037 Jul 21 01:28:45.641814 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:45.641764 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" event={"ID":"f19a9334-decc-46cd-8d77-9c85d5f2e5d5","Type":"ContainerStarted","Data":"591d1a28e27c865ab5f8080a57ba885b1c858e387fa355d8dd833570afb21037"} Jul 21 01:28:49.664246 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:49.664202 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" event={"ID":"f19a9334-decc-46cd-8d77-9c85d5f2e5d5","Type":"ContainerStarted","Data":"b4b73285ce7f5a63dabd9952b364d570f02f7bb4e1872f4f7dfbb1c56322a25e"} Jul 21 01:28:50.672653 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:50.672619 2553 generic.go:356] "Generic (PLEG): container finished" podID="f19a9334-decc-46cd-8d77-9c85d5f2e5d5" containerID="b4b73285ce7f5a63dabd9952b364d570f02f7bb4e1872f4f7dfbb1c56322a25e" exitCode=0 Jul 21 01:28:50.673158 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:50.672669 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" event={"ID":"f19a9334-decc-46cd-8d77-9c85d5f2e5d5","Type":"ContainerDied","Data":"b4b73285ce7f5a63dabd9952b364d570f02f7bb4e1872f4f7dfbb1c56322a25e"} Jul 21 01:28:51.679561 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:51.679526 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" event={"ID":"f19a9334-decc-46cd-8d77-9c85d5f2e5d5","Type":"ContainerStarted","Data":"7b83088013699a7513aa2ec0609efc3ca349b5ac7134c84845dea1e0d2c25a42"} Jul 21 01:28:51.679992 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:51.679629 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:28:51.708449 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:28:51.703720 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" podStartSLOduration=2.244900731 podStartE2EDuration="6.703702547s" totalImagesPullingTime="3.435897309s" totalInitContainerRuntime="1.022904507s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:28:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:28:51.7003513 +0000 UTC m=+411.386999856" watchObservedRunningTime="2026-07-21 01:28:51.703702547 +0000 UTC m=+411.390351103" Jul 21 01:29:02.686433 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:02.686396 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-6tp6g" Jul 21 01:29:04.896382 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:04.896346 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9"] Jul 21 01:29:04.905898 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:04.905873 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9" Jul 21 01:29:04.908914 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:04.908890 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 21 01:29:04.909052 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:04.908890 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 21 01:29:04.909424 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:04.909403 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dl5td\"" Jul 21 01:29:04.909521 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:04.909497 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9"] Jul 21 01:29:05.073986 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.073954 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gkrj\" (UniqueName: \"kubernetes.io/projected/ee9bc36f-5a20-4a59-87b4-c31d365326d6-kube-api-access-5gkrj\") pod \"kube-auth-proxy-545dd4bbd9-j2kp9\" (UID: \"ee9bc36f-5a20-4a59-87b4-c31d365326d6\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9" Jul 21 01:29:05.074148 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.073995 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee9bc36f-5a20-4a59-87b4-c31d365326d6-tls-certs\") pod \"kube-auth-proxy-545dd4bbd9-j2kp9\" (UID: \"ee9bc36f-5a20-4a59-87b4-c31d365326d6\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9" Jul 21 01:29:05.074148 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.074125 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee9bc36f-5a20-4a59-87b4-c31d365326d6-tmp\") pod \"kube-auth-proxy-545dd4bbd9-j2kp9\" (UID: \"ee9bc36f-5a20-4a59-87b4-c31d365326d6\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9" Jul 21 01:29:05.163654 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.163573 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-khdgr"] Jul 21 01:29:05.166968 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.166953 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-khdgr" Jul 21 01:29:05.170417 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.170395 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cfvzh\"" Jul 21 01:29:05.170587 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.170567 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 21 01:29:05.175332 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.175307 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee9bc36f-5a20-4a59-87b4-c31d365326d6-tmp\") pod \"kube-auth-proxy-545dd4bbd9-j2kp9\" (UID: \"ee9bc36f-5a20-4a59-87b4-c31d365326d6\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9" Jul 21 01:29:05.175422 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.175355 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gkrj\" (UniqueName: \"kubernetes.io/projected/ee9bc36f-5a20-4a59-87b4-c31d365326d6-kube-api-access-5gkrj\") pod \"kube-auth-proxy-545dd4bbd9-j2kp9\" (UID: \"ee9bc36f-5a20-4a59-87b4-c31d365326d6\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9" Jul 21 01:29:05.175422 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.175389 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee9bc36f-5a20-4a59-87b4-c31d365326d6-tls-certs\") pod \"kube-auth-proxy-545dd4bbd9-j2kp9\" (UID: \"ee9bc36f-5a20-4a59-87b4-c31d365326d6\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9" Jul 21 01:29:05.177646 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.177629 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee9bc36f-5a20-4a59-87b4-c31d365326d6-tmp\") pod \"kube-auth-proxy-545dd4bbd9-j2kp9\" (UID: \"ee9bc36f-5a20-4a59-87b4-c31d365326d6\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9" Jul 21 01:29:05.177979 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.177959 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee9bc36f-5a20-4a59-87b4-c31d365326d6-tls-certs\") pod \"kube-auth-proxy-545dd4bbd9-j2kp9\" (UID: \"ee9bc36f-5a20-4a59-87b4-c31d365326d6\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9" Jul 21 01:29:05.188620 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.188593 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-khdgr"] Jul 21 01:29:05.197673 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.197647 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gkrj\" (UniqueName: \"kubernetes.io/projected/ee9bc36f-5a20-4a59-87b4-c31d365326d6-kube-api-access-5gkrj\") pod \"kube-auth-proxy-545dd4bbd9-j2kp9\" (UID: \"ee9bc36f-5a20-4a59-87b4-c31d365326d6\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9" Jul 21 01:29:05.217213 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.217189 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9" Jul 21 01:29:05.276999 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.276962 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9df12abe-28a2-4998-b63f-fe5b60e5aead-cert\") pod \"odh-model-controller-7998c67dc4-khdgr\" (UID: \"9df12abe-28a2-4998-b63f-fe5b60e5aead\") " pod="opendatahub/odh-model-controller-7998c67dc4-khdgr" Jul 21 01:29:05.277139 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.277060 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrkmn\" (UniqueName: \"kubernetes.io/projected/9df12abe-28a2-4998-b63f-fe5b60e5aead-kube-api-access-jrkmn\") pod \"odh-model-controller-7998c67dc4-khdgr\" (UID: \"9df12abe-28a2-4998-b63f-fe5b60e5aead\") " pod="opendatahub/odh-model-controller-7998c67dc4-khdgr" Jul 21 01:29:05.366928 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.366898 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9"] Jul 21 01:29:05.371425 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:29:05.371398 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee9bc36f_5a20_4a59_87b4_c31d365326d6.slice/crio-386637d1940a3c2db32d2afcdb62b137c871e0f1cbef76be857908e4c6b6007b WatchSource:0}: Error finding container 386637d1940a3c2db32d2afcdb62b137c871e0f1cbef76be857908e4c6b6007b: Status 404 returned error can't find the container with id 386637d1940a3c2db32d2afcdb62b137c871e0f1cbef76be857908e4c6b6007b Jul 21 01:29:05.378087 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.378056 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrkmn\" (UniqueName: \"kubernetes.io/projected/9df12abe-28a2-4998-b63f-fe5b60e5aead-kube-api-access-jrkmn\") pod \"odh-model-controller-7998c67dc4-khdgr\" (UID: \"9df12abe-28a2-4998-b63f-fe5b60e5aead\") " pod="opendatahub/odh-model-controller-7998c67dc4-khdgr" Jul 21 01:29:05.378204 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.378152 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9df12abe-28a2-4998-b63f-fe5b60e5aead-cert\") pod \"odh-model-controller-7998c67dc4-khdgr\" (UID: \"9df12abe-28a2-4998-b63f-fe5b60e5aead\") " pod="opendatahub/odh-model-controller-7998c67dc4-khdgr" Jul 21 01:29:05.378293 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:29:05.378274 2553 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 21 01:29:05.378426 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:29:05.378337 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df12abe-28a2-4998-b63f-fe5b60e5aead-cert podName:9df12abe-28a2-4998-b63f-fe5b60e5aead nodeName:}" failed. No retries permitted until 2026-07-21 01:29:05.878317668 +0000 UTC m=+425.564966214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9df12abe-28a2-4998-b63f-fe5b60e5aead-cert") pod "odh-model-controller-7998c67dc4-khdgr" (UID: "9df12abe-28a2-4998-b63f-fe5b60e5aead") : secret "odh-model-controller-webhook-cert" not found Jul 21 01:29:05.388212 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.388183 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrkmn\" (UniqueName: \"kubernetes.io/projected/9df12abe-28a2-4998-b63f-fe5b60e5aead-kube-api-access-jrkmn\") pod \"odh-model-controller-7998c67dc4-khdgr\" (UID: \"9df12abe-28a2-4998-b63f-fe5b60e5aead\") " pod="opendatahub/odh-model-controller-7998c67dc4-khdgr" Jul 21 01:29:05.743946 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.743911 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9" event={"ID":"ee9bc36f-5a20-4a59-87b4-c31d365326d6","Type":"ContainerStarted","Data":"386637d1940a3c2db32d2afcdb62b137c871e0f1cbef76be857908e4c6b6007b"} Jul 21 01:29:05.882877 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.882843 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9df12abe-28a2-4998-b63f-fe5b60e5aead-cert\") pod \"odh-model-controller-7998c67dc4-khdgr\" (UID: \"9df12abe-28a2-4998-b63f-fe5b60e5aead\") " pod="opendatahub/odh-model-controller-7998c67dc4-khdgr" Jul 21 01:29:05.885319 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:05.885300 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9df12abe-28a2-4998-b63f-fe5b60e5aead-cert\") pod \"odh-model-controller-7998c67dc4-khdgr\" (UID: \"9df12abe-28a2-4998-b63f-fe5b60e5aead\") " pod="opendatahub/odh-model-controller-7998c67dc4-khdgr" Jul 21 01:29:06.077718 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.077599 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-khdgr" Jul 21 01:29:06.171626 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.171592 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5jp44"] Jul 21 01:29:06.175460 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.175435 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5jp44" Jul 21 01:29:06.179147 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.179119 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-9zz77\"" Jul 21 01:29:06.179567 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.179546 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 21 01:29:06.181456 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.181268 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-58mwv"] Jul 21 01:29:06.185154 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.185122 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62ae8016-3970-4793-99e1-db4a3e3b8b25-tls-certs\") pod \"model-serving-api-54d89bd5fc-5jp44\" (UID: \"62ae8016-3970-4793-99e1-db4a3e3b8b25\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jp44" Jul 21 01:29:06.185277 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.185209 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhfhw\" (UniqueName: \"kubernetes.io/projected/62ae8016-3970-4793-99e1-db4a3e3b8b25-kube-api-access-hhfhw\") pod \"model-serving-api-54d89bd5fc-5jp44\" (UID: \"62ae8016-3970-4793-99e1-db4a3e3b8b25\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jp44" Jul 21 01:29:06.185477 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.185449 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.188479 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.188040 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 21 01:29:06.188479 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.188136 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5jp44"] Jul 21 01:29:06.188479 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.188341 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dfmk2\"" Jul 21 01:29:06.188479 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.188348 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 21 01:29:06.188479 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.188384 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 21 01:29:06.188832 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.188635 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 21 01:29:06.197422 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.197396 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-58mwv"] Jul 21 01:29:06.245650 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.245623 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-khdgr"] Jul 21 01:29:06.251575 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:29:06.251524 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df12abe_28a2_4998_b63f_fe5b60e5aead.slice/crio-10361956c4e1cad10f56ee287250293cf909275ed328acabecb9d2dcfa5fbbc1 WatchSource:0}: Error finding container 10361956c4e1cad10f56ee287250293cf909275ed328acabecb9d2dcfa5fbbc1: Status 404 returned error can't find the container with id 10361956c4e1cad10f56ee287250293cf909275ed328acabecb9d2dcfa5fbbc1 Jul 21 01:29:06.286069 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.286027 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhfhw\" (UniqueName: \"kubernetes.io/projected/62ae8016-3970-4793-99e1-db4a3e3b8b25-kube-api-access-hhfhw\") pod \"model-serving-api-54d89bd5fc-5jp44\" (UID: \"62ae8016-3970-4793-99e1-db4a3e3b8b25\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jp44" Jul 21 01:29:06.286200 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.286112 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62ae8016-3970-4793-99e1-db4a3e3b8b25-tls-certs\") pod \"model-serving-api-54d89bd5fc-5jp44\" (UID: \"62ae8016-3970-4793-99e1-db4a3e3b8b25\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jp44" Jul 21 01:29:06.288985 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.288960 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62ae8016-3970-4793-99e1-db4a3e3b8b25-tls-certs\") pod \"model-serving-api-54d89bd5fc-5jp44\" (UID: \"62ae8016-3970-4793-99e1-db4a3e3b8b25\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jp44" Jul 21 01:29:06.295472 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.295442 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhfhw\" (UniqueName: \"kubernetes.io/projected/62ae8016-3970-4793-99e1-db4a3e3b8b25-kube-api-access-hhfhw\") pod \"model-serving-api-54d89bd5fc-5jp44\" (UID: \"62ae8016-3970-4793-99e1-db4a3e3b8b25\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jp44" Jul 21 01:29:06.387046 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.386953 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-cacerts\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.387046 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.387022 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.387266 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.387127 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.387266 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.387172 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.387266 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.387207 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6rqc\" (UniqueName: \"kubernetes.io/projected/81e9b972-884c-4b67-8026-8397c63d1ee0-kube-api-access-r6rqc\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.387266 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.387253 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-token\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.387446 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.387325 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81e9b972-884c-4b67-8026-8397c63d1ee0-local-certs\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.487692 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.487658 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81e9b972-884c-4b67-8026-8397c63d1ee0-local-certs\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.487692 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.487690 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-cacerts\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.487963 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.487718 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.487963 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.487753 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.487963 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.487770 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.487963 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.487787 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6rqc\" (UniqueName: \"kubernetes.io/projected/81e9b972-884c-4b67-8026-8397c63d1ee0-kube-api-access-r6rqc\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.487963 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.487852 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-token\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.488488 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.488457 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.490275 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.490250 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81e9b972-884c-4b67-8026-8397c63d1ee0-local-certs\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.490390 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.490326 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-cacerts\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.490462 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.490443 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.490503 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.490470 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.496269 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.496240 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6rqc\" (UniqueName: \"kubernetes.io/projected/81e9b972-884c-4b67-8026-8397c63d1ee0-kube-api-access-r6rqc\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.496346 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.496275 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-token\") pod \"istiod-openshift-gateway-7574459656-58mwv\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.509709 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.509679 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5jp44" Jul 21 01:29:06.518491 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.518469 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:06.672646 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:29:06.672323 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ae8016_3970_4793_99e1_db4a3e3b8b25.slice/crio-040eedf0418ad68e4d092014aad3a4a8f1edde4392c95fc833fecae043455e6d WatchSource:0}: Error finding container 040eedf0418ad68e4d092014aad3a4a8f1edde4392c95fc833fecae043455e6d: Status 404 returned error can't find the container with id 040eedf0418ad68e4d092014aad3a4a8f1edde4392c95fc833fecae043455e6d Jul 21 01:29:06.672954 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.672877 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5jp44"] Jul 21 01:29:06.689305 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.689277 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-58mwv"] Jul 21 01:29:06.691423 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:29:06.691399 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e9b972_884c_4b67_8026_8397c63d1ee0.slice/crio-688f1fe7f102a27a903030f07e64bd01184bb495f8b9d594c625221ae7982bd4 WatchSource:0}: Error finding container 688f1fe7f102a27a903030f07e64bd01184bb495f8b9d594c625221ae7982bd4: Status 404 returned error can't find the container with id 688f1fe7f102a27a903030f07e64bd01184bb495f8b9d594c625221ae7982bd4 Jul 21 01:29:06.751999 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.751962 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-khdgr" event={"ID":"9df12abe-28a2-4998-b63f-fe5b60e5aead","Type":"ContainerStarted","Data":"10361956c4e1cad10f56ee287250293cf909275ed328acabecb9d2dcfa5fbbc1"} Jul 21 01:29:06.753317 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.753286 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5jp44" event={"ID":"62ae8016-3970-4793-99e1-db4a3e3b8b25","Type":"ContainerStarted","Data":"040eedf0418ad68e4d092014aad3a4a8f1edde4392c95fc833fecae043455e6d"} Jul 21 01:29:06.754678 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:06.754650 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" event={"ID":"81e9b972-884c-4b67-8026-8397c63d1ee0","Type":"ContainerStarted","Data":"688f1fe7f102a27a903030f07e64bd01184bb495f8b9d594c625221ae7982bd4"} Jul 21 01:29:11.144437 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:11.144404 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:29:11.144753 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:11.144465 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:29:11.792521 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:11.792475 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9" event={"ID":"ee9bc36f-5a20-4a59-87b4-c31d365326d6","Type":"ContainerStarted","Data":"60a205c9b6ece7206f15cdf6f0f2467c7a3923f71db33e607b14d8b86a40df37"} Jul 21 01:29:11.794090 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:11.794063 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5jp44" event={"ID":"62ae8016-3970-4793-99e1-db4a3e3b8b25","Type":"ContainerStarted","Data":"820a995da96290dbd9c2aa23c815c3967a08cd37d908173c939f0c115dc149ac"} Jul 21 01:29:11.794232 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:11.794117 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-5jp44" Jul 21 01:29:11.795638 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:11.795616 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" event={"ID":"81e9b972-884c-4b67-8026-8397c63d1ee0","Type":"ContainerStarted","Data":"ea105d6bd040305dce196385ec09f0daf1b98762beff2039ed3641d28f464c12"} Jul 21 01:29:11.795749 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:11.795718 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:11.797047 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:11.797026 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-khdgr" event={"ID":"9df12abe-28a2-4998-b63f-fe5b60e5aead","Type":"ContainerStarted","Data":"bda13fd1ead4b23c26a53ef86b7d2be7ed2f384e32d3c4e4e8e0636c6690d882"} Jul 21 01:29:11.797166 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:11.797154 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-khdgr" Jul 21 01:29:11.857948 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:11.857895 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" podStartSLOduration=1.407301313 podStartE2EDuration="5.857875516s" totalImagesPullingTime="4.450574203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:29:11.857498856 +0000 UTC m=+431.544147412" watchObservedRunningTime="2026-07-21 01:29:11.857875516 +0000 UTC m=+431.544524070" Jul 21 01:29:11.859824 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:11.859756 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-j2kp9" podStartSLOduration=2.157792118 podStartE2EDuration="7.859741975s" totalImagesPullingTime="5.701949857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:29:11.819450375 +0000 UTC m=+431.506098931" watchObservedRunningTime="2026-07-21 01:29:11.859741975 +0000 UTC m=+431.546390529" Jul 21 01:29:11.885791 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:11.885719 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-khdgr" podStartSLOduration=1.987975244 podStartE2EDuration="6.88569611s" totalImagesPullingTime="4.897720866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:29:11.883033269 +0000 UTC m=+431.569681830" watchObservedRunningTime="2026-07-21 01:29:11.88569611 +0000 UTC m=+431.572344667" Jul 21 01:29:11.917897 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:11.917834 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-5jp44" podStartSLOduration=1.4582736139999999 podStartE2EDuration="5.917786018s" totalImagesPullingTime="4.459512404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:29:11.915714125 +0000 UTC m=+431.602362676" watchObservedRunningTime="2026-07-21 01:29:11.917786018 +0000 UTC m=+431.604434574" Jul 21 01:29:12.692592 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.692558 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s"] Jul 21 01:29:12.696325 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.696301 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.699156 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.699135 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-96mtz\"" Jul 21 01:29:12.711452 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.711427 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s"] Jul 21 01:29:12.744147 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.744118 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b38387d-1fd0-4053-9a05-16b7bd7c3462-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.744290 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.744155 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cqd8\" (UniqueName: \"kubernetes.io/projected/1b38387d-1fd0-4053-9a05-16b7bd7c3462-kube-api-access-5cqd8\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.744290 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.744183 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b38387d-1fd0-4053-9a05-16b7bd7c3462-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.744383 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.744284 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b38387d-1fd0-4053-9a05-16b7bd7c3462-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.744383 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.744309 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b38387d-1fd0-4053-9a05-16b7bd7c3462-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.744383 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.744337 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b38387d-1fd0-4053-9a05-16b7bd7c3462-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.744483 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.744409 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b38387d-1fd0-4053-9a05-16b7bd7c3462-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.744483 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.744466 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b38387d-1fd0-4053-9a05-16b7bd7c3462-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.744546 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.744505 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b38387d-1fd0-4053-9a05-16b7bd7c3462-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.804150 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.804123 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:12.845950 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.845922 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b38387d-1fd0-4053-9a05-16b7bd7c3462-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.846120 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.845994 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b38387d-1fd0-4053-9a05-16b7bd7c3462-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.846120 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.846094 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b38387d-1fd0-4053-9a05-16b7bd7c3462-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.846244 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.846165 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b38387d-1fd0-4053-9a05-16b7bd7c3462-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.846244 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.846204 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cqd8\" (UniqueName: \"kubernetes.io/projected/1b38387d-1fd0-4053-9a05-16b7bd7c3462-kube-api-access-5cqd8\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.846341 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.846277 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b38387d-1fd0-4053-9a05-16b7bd7c3462-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.846419 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.846401 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b38387d-1fd0-4053-9a05-16b7bd7c3462-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.846476 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.846441 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b38387d-1fd0-4053-9a05-16b7bd7c3462-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.846525 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.846491 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b38387d-1fd0-4053-9a05-16b7bd7c3462-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.846580 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.846497 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b38387d-1fd0-4053-9a05-16b7bd7c3462-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.846784 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.846760 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b38387d-1fd0-4053-9a05-16b7bd7c3462-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.847085 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.847053 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b38387d-1fd0-4053-9a05-16b7bd7c3462-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.847190 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.847105 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b38387d-1fd0-4053-9a05-16b7bd7c3462-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.847630 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.847607 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b38387d-1fd0-4053-9a05-16b7bd7c3462-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.848565 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.848539 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b38387d-1fd0-4053-9a05-16b7bd7c3462-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.848646 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.848630 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b38387d-1fd0-4053-9a05-16b7bd7c3462-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.861038 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.861009 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cqd8\" (UniqueName: \"kubernetes.io/projected/1b38387d-1fd0-4053-9a05-16b7bd7c3462-kube-api-access-5cqd8\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:12.861370 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:12.861354 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b38387d-1fd0-4053-9a05-16b7bd7c3462-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6787h68s\" (UID: \"1b38387d-1fd0-4053-9a05-16b7bd7c3462\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:13.007143 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:13.007111 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:13.162985 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:13.162959 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s"] Jul 21 01:29:13.165134 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:29:13.165093 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b38387d_1fd0_4053_9a05_16b7bd7c3462.slice/crio-b1e7431aae1f33d01d62c6c31c1531a7f45c2ae2e38c19a2982194def29742b8 WatchSource:0}: Error finding container b1e7431aae1f33d01d62c6c31c1531a7f45c2ae2e38c19a2982194def29742b8: Status 404 returned error can't find the container with id b1e7431aae1f33d01d62c6c31c1531a7f45c2ae2e38c19a2982194def29742b8 Jul 21 01:29:13.809812 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:13.809766 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" event={"ID":"1b38387d-1fd0-4053-9a05-16b7bd7c3462","Type":"ContainerStarted","Data":"b1e7431aae1f33d01d62c6c31c1531a7f45c2ae2e38c19a2982194def29742b8"} Jul 21 01:29:15.471927 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.471890 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm"] Jul 21 01:29:15.478851 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.478790 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm" Jul 21 01:29:15.482227 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.482204 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 21 01:29:15.482825 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.482785 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-b89gw\"" Jul 21 01:29:15.499071 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.499042 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm"] Jul 21 01:29:15.510292 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.510268 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc"] Jul 21 01:29:15.514325 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.514305 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc" Jul 21 01:29:15.517203 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.517180 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 21 01:29:15.517320 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.517277 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-f6t4z\"" Jul 21 01:29:15.527123 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.527023 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc"] Jul 21 01:29:15.576371 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.576298 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnbl6\" (UniqueName: \"kubernetes.io/projected/b52c61c1-a6aa-417e-9d4f-37030b5f3f8e-kube-api-access-mnbl6\") pod \"kserve-controller-manager-d6f4b65b8-fzhsm\" (UID: \"b52c61c1-a6aa-417e-9d4f-37030b5f3f8e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm" Jul 21 01:29:15.576557 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.576431 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b52c61c1-a6aa-417e-9d4f-37030b5f3f8e-cert\") pod \"kserve-controller-manager-d6f4b65b8-fzhsm\" (UID: \"b52c61c1-a6aa-417e-9d4f-37030b5f3f8e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm" Jul 21 01:29:15.576557 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.576523 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/532f1f78-aa89-40b8-95ad-6f6ec02d2c4b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r5qkc\" (UID: \"532f1f78-aa89-40b8-95ad-6f6ec02d2c4b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc" Jul 21 01:29:15.576659 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.576581 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfncn\" (UniqueName: \"kubernetes.io/projected/532f1f78-aa89-40b8-95ad-6f6ec02d2c4b-kube-api-access-zfncn\") pod \"llmisvc-controller-manager-777c6bd7d5-r5qkc\" (UID: \"532f1f78-aa89-40b8-95ad-6f6ec02d2c4b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc" Jul 21 01:29:15.677883 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.677843 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfncn\" (UniqueName: \"kubernetes.io/projected/532f1f78-aa89-40b8-95ad-6f6ec02d2c4b-kube-api-access-zfncn\") pod \"llmisvc-controller-manager-777c6bd7d5-r5qkc\" (UID: \"532f1f78-aa89-40b8-95ad-6f6ec02d2c4b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc" Jul 21 01:29:15.678074 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.677905 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnbl6\" (UniqueName: \"kubernetes.io/projected/b52c61c1-a6aa-417e-9d4f-37030b5f3f8e-kube-api-access-mnbl6\") pod \"kserve-controller-manager-d6f4b65b8-fzhsm\" (UID: \"b52c61c1-a6aa-417e-9d4f-37030b5f3f8e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm" Jul 21 01:29:15.678074 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.677953 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b52c61c1-a6aa-417e-9d4f-37030b5f3f8e-cert\") pod \"kserve-controller-manager-d6f4b65b8-fzhsm\" (UID: \"b52c61c1-a6aa-417e-9d4f-37030b5f3f8e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm" Jul 21 01:29:15.678074 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.678006 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/532f1f78-aa89-40b8-95ad-6f6ec02d2c4b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r5qkc\" (UID: \"532f1f78-aa89-40b8-95ad-6f6ec02d2c4b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc" Jul 21 01:29:15.681354 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.681321 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/532f1f78-aa89-40b8-95ad-6f6ec02d2c4b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r5qkc\" (UID: \"532f1f78-aa89-40b8-95ad-6f6ec02d2c4b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc" Jul 21 01:29:15.683559 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.683510 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b52c61c1-a6aa-417e-9d4f-37030b5f3f8e-cert\") pod \"kserve-controller-manager-d6f4b65b8-fzhsm\" (UID: \"b52c61c1-a6aa-417e-9d4f-37030b5f3f8e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm" Jul 21 01:29:15.695078 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.695024 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnbl6\" (UniqueName: \"kubernetes.io/projected/b52c61c1-a6aa-417e-9d4f-37030b5f3f8e-kube-api-access-mnbl6\") pod \"kserve-controller-manager-d6f4b65b8-fzhsm\" (UID: \"b52c61c1-a6aa-417e-9d4f-37030b5f3f8e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm" Jul 21 01:29:15.696224 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.696194 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfncn\" (UniqueName: \"kubernetes.io/projected/532f1f78-aa89-40b8-95ad-6f6ec02d2c4b-kube-api-access-zfncn\") pod \"llmisvc-controller-manager-777c6bd7d5-r5qkc\" (UID: \"532f1f78-aa89-40b8-95ad-6f6ec02d2c4b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc" Jul 21 01:29:15.790768 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.790722 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm" Jul 21 01:29:15.827609 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.827582 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc" Jul 21 01:29:15.879734 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.879700 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:29:15.879902 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.879778 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:29:15.879902 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.879847 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:29:15.987852 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:15.986620 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm"] Jul 21 01:29:15.988164 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:29:15.988127 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb52c61c1_a6aa_417e_9d4f_37030b5f3f8e.slice/crio-46b1cd68de59b12841fb2d31fe26fd3ab0c0949786f04e757151befbc2ce2fd1 WatchSource:0}: Error finding container 46b1cd68de59b12841fb2d31fe26fd3ab0c0949786f04e757151befbc2ce2fd1: Status 404 returned error can't find the container with id 46b1cd68de59b12841fb2d31fe26fd3ab0c0949786f04e757151befbc2ce2fd1 Jul 21 01:29:16.025171 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.025133 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc"] Jul 21 01:29:16.026910 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:29:16.026876 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod532f1f78_aa89_40b8_95ad_6f6ec02d2c4b.slice/crio-9cd4457facd7893779cf059626061fe4f8677a5872b85d214c5ab9e51f103af8 WatchSource:0}: Error finding container 9cd4457facd7893779cf059626061fe4f8677a5872b85d214c5ab9e51f103af8: Status 404 returned error can't find the container with id 9cd4457facd7893779cf059626061fe4f8677a5872b85d214c5ab9e51f103af8 Jul 21 01:29:16.324932 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.324896 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-58mwv"] Jul 21 01:29:16.325139 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.325084 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" podUID="81e9b972-884c-4b67-8026-8397c63d1ee0" containerName="discovery" containerID="cri-o://ea105d6bd040305dce196385ec09f0daf1b98762beff2039ed3641d28f464c12" gracePeriod=30 Jul 21 01:29:16.569790 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.569762 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:16.687609 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.687533 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-cacerts\") pod \"81e9b972-884c-4b67-8026-8397c63d1ee0\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " Jul 21 01:29:16.687760 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.687620 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81e9b972-884c-4b67-8026-8397c63d1ee0-local-certs\") pod \"81e9b972-884c-4b67-8026-8397c63d1ee0\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " Jul 21 01:29:16.687760 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.687674 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-csr-ca-configmap\") pod \"81e9b972-884c-4b67-8026-8397c63d1ee0\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " Jul 21 01:29:16.687760 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.687725 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-kubeconfig\") pod \"81e9b972-884c-4b67-8026-8397c63d1ee0\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " Jul 21 01:29:16.687936 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.687883 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6rqc\" (UniqueName: \"kubernetes.io/projected/81e9b972-884c-4b67-8026-8397c63d1ee0-kube-api-access-r6rqc\") pod \"81e9b972-884c-4b67-8026-8397c63d1ee0\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " Jul 21 01:29:16.687936 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.687919 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-token\") pod \"81e9b972-884c-4b67-8026-8397c63d1ee0\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " Jul 21 01:29:16.688038 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.687948 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-csr-dns-cert\") pod \"81e9b972-884c-4b67-8026-8397c63d1ee0\" (UID: \"81e9b972-884c-4b67-8026-8397c63d1ee0\") " Jul 21 01:29:16.688491 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.688459 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "81e9b972-884c-4b67-8026-8397c63d1ee0" (UID: "81e9b972-884c-4b67-8026-8397c63d1ee0"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:29:16.690937 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.690905 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81e9b972-884c-4b67-8026-8397c63d1ee0-kube-api-access-r6rqc" (OuterVolumeSpecName: "kube-api-access-r6rqc") pod "81e9b972-884c-4b67-8026-8397c63d1ee0" (UID: "81e9b972-884c-4b67-8026-8397c63d1ee0"). InnerVolumeSpecName "kube-api-access-r6rqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:29:16.691376 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.691348 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "81e9b972-884c-4b67-8026-8397c63d1ee0" (UID: "81e9b972-884c-4b67-8026-8397c63d1ee0"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 01:29:16.692171 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.691910 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-token" (OuterVolumeSpecName: "istio-token") pod "81e9b972-884c-4b67-8026-8397c63d1ee0" (UID: "81e9b972-884c-4b67-8026-8397c63d1ee0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:29:16.692394 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.692323 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81e9b972-884c-4b67-8026-8397c63d1ee0-local-certs" (OuterVolumeSpecName: "local-certs") pod "81e9b972-884c-4b67-8026-8397c63d1ee0" (UID: "81e9b972-884c-4b67-8026-8397c63d1ee0"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:29:16.692511 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.692475 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "81e9b972-884c-4b67-8026-8397c63d1ee0" (UID: "81e9b972-884c-4b67-8026-8397c63d1ee0"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 01:29:16.692679 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.692583 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-cacerts" (OuterVolumeSpecName: "cacerts") pod "81e9b972-884c-4b67-8026-8397c63d1ee0" (UID: "81e9b972-884c-4b67-8026-8397c63d1ee0"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 01:29:16.789738 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.789689 2553 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-csr-ca-configmap\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:29:16.789738 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.789724 2553 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-kubeconfig\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:29:16.789738 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.789733 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6rqc\" (UniqueName: \"kubernetes.io/projected/81e9b972-884c-4b67-8026-8397c63d1ee0-kube-api-access-r6rqc\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:29:16.789738 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.789744 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:29:16.790191 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.789760 2553 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-istio-csr-dns-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:29:16.790191 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.789770 2553 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81e9b972-884c-4b67-8026-8397c63d1ee0-cacerts\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:29:16.790191 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.789814 2553 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81e9b972-884c-4b67-8026-8397c63d1ee0-local-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:29:16.828305 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.828248 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm" event={"ID":"b52c61c1-a6aa-417e-9d4f-37030b5f3f8e","Type":"ContainerStarted","Data":"46b1cd68de59b12841fb2d31fe26fd3ab0c0949786f04e757151befbc2ce2fd1"} Jul 21 01:29:16.830986 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.830958 2553 generic.go:356] "Generic (PLEG): container finished" podID="81e9b972-884c-4b67-8026-8397c63d1ee0" containerID="ea105d6bd040305dce196385ec09f0daf1b98762beff2039ed3641d28f464c12" exitCode=0 Jul 21 01:29:16.831166 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.831070 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" Jul 21 01:29:16.840897 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.840233 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc" event={"ID":"532f1f78-aa89-40b8-95ad-6f6ec02d2c4b","Type":"ContainerStarted","Data":"9cd4457facd7893779cf059626061fe4f8677a5872b85d214c5ab9e51f103af8"} Jul 21 01:29:16.840897 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.840298 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" event={"ID":"81e9b972-884c-4b67-8026-8397c63d1ee0","Type":"ContainerDied","Data":"ea105d6bd040305dce196385ec09f0daf1b98762beff2039ed3641d28f464c12"} Jul 21 01:29:16.840897 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.840330 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-58mwv" event={"ID":"81e9b972-884c-4b67-8026-8397c63d1ee0","Type":"ContainerDied","Data":"688f1fe7f102a27a903030f07e64bd01184bb495f8b9d594c625221ae7982bd4"} Jul 21 01:29:16.840897 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.840369 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" event={"ID":"1b38387d-1fd0-4053-9a05-16b7bd7c3462","Type":"ContainerStarted","Data":"9e998b9d33a3ce5e087947514fd03cad9bfcced456cec202be1e3a1e11e1b3cb"} Jul 21 01:29:16.840897 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.840404 2553 scope.go:117] "RemoveContainer" containerID="ea105d6bd040305dce196385ec09f0daf1b98762beff2039ed3641d28f464c12" Jul 21 01:29:16.860309 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.860052 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" podStartSLOduration=2.147880688 podStartE2EDuration="4.860033209s" totalImagesPullingTime="2.712152521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:29:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:29:16.859328683 +0000 UTC m=+436.545977251" watchObservedRunningTime="2026-07-21 01:29:16.860033209 +0000 UTC m=+436.546681765" Jul 21 01:29:16.874357 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.874324 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-58mwv"] Jul 21 01:29:16.878830 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.878789 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-58mwv"] Jul 21 01:29:16.947621 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.947592 2553 scope.go:117] "RemoveContainer" containerID="ea105d6bd040305dce196385ec09f0daf1b98762beff2039ed3641d28f464c12" Jul 21 01:29:16.948025 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:29:16.947991 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea105d6bd040305dce196385ec09f0daf1b98762beff2039ed3641d28f464c12\": container with ID starting with ea105d6bd040305dce196385ec09f0daf1b98762beff2039ed3641d28f464c12 not found: ID does not exist" containerID="ea105d6bd040305dce196385ec09f0daf1b98762beff2039ed3641d28f464c12" Jul 21 01:29:16.948108 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:16.948042 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea105d6bd040305dce196385ec09f0daf1b98762beff2039ed3641d28f464c12"} err="failed to get container status \"ea105d6bd040305dce196385ec09f0daf1b98762beff2039ed3641d28f464c12\": rpc error: code = NotFound desc = could not find container \"ea105d6bd040305dce196385ec09f0daf1b98762beff2039ed3641d28f464c12\": container with ID starting with ea105d6bd040305dce196385ec09f0daf1b98762beff2039ed3641d28f464c12 not found: ID does not exist" Jul 21 01:29:17.007870 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:17.007837 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:17.013503 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:17.013475 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:17.841482 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:17.841438 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:17.842514 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:17.842489 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6787h68s" Jul 21 01:29:18.836653 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:18.836615 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81e9b972-884c-4b67-8026-8397c63d1ee0" path="/var/lib/kubelet/pods/81e9b972-884c-4b67-8026-8397c63d1ee0/volumes" Jul 21 01:29:18.848262 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:18.848220 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm" event={"ID":"b52c61c1-a6aa-417e-9d4f-37030b5f3f8e","Type":"ContainerStarted","Data":"4bfd5868f147474e6fb6e38899e67c6c1053e72741cf8a4bb389f6a147fe8eda"} Jul 21 01:29:18.866405 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:18.866351 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm" podStartSLOduration=1.597351231 podStartE2EDuration="3.866335498s" totalImagesPullingTime="2.268984267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:29:18.865010283 +0000 UTC m=+438.551658837" watchObservedRunningTime="2026-07-21 01:29:18.866335498 +0000 UTC m=+438.552984049" Jul 21 01:29:19.854873 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:19.854835 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc" event={"ID":"532f1f78-aa89-40b8-95ad-6f6ec02d2c4b","Type":"ContainerStarted","Data":"f65653964a0290eb6056cb165eaa3f020601bf799d638520f7afe6b3258fa064"} Jul 21 01:29:19.855311 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:19.855111 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm" Jul 21 01:29:19.855311 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:19.855153 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc" Jul 21 01:29:19.872645 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:19.872597 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc" podStartSLOduration=1.6578228990000001 podStartE2EDuration="4.872583884s" totalImagesPullingTime="3.214760985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:29:19.871735259 +0000 UTC m=+439.558383819" watchObservedRunningTime="2026-07-21 01:29:19.872583884 +0000 UTC m=+439.559232440" Jul 21 01:29:22.804410 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:22.804326 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-khdgr" Jul 21 01:29:22.806414 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:22.806394 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-5jp44" Jul 21 01:29:50.862482 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:50.862453 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r5qkc" Jul 21 01:29:50.865680 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:29:50.865660 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fzhsm" Jul 21 01:30:05.807851 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:05.807819 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-klzgj"] Jul 21 01:30:05.808231 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:05.808159 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81e9b972-884c-4b67-8026-8397c63d1ee0" containerName="discovery" Jul 21 01:30:05.808231 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:05.808169 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="81e9b972-884c-4b67-8026-8397c63d1ee0" containerName="discovery" Jul 21 01:30:05.808308 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:05.808244 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="81e9b972-884c-4b67-8026-8397c63d1ee0" containerName="discovery" Jul 21 01:30:05.811749 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:05.811723 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-klzgj" Jul 21 01:30:05.814452 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:05.814423 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 21 01:30:05.815681 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:05.815656 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-t72hn\"" Jul 21 01:30:05.815681 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:05.815656 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 21 01:30:05.823177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:05.823148 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-klzgj"] Jul 21 01:30:05.929413 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:05.929378 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcd9s\" (UniqueName: \"kubernetes.io/projected/8c1896e6-215a-4a8b-8c47-04d36f5f6f77-kube-api-access-bcd9s\") pod \"kuadrant-operator-catalog-klzgj\" (UID: \"8c1896e6-215a-4a8b-8c47-04d36f5f6f77\") " pod="kuadrant-system/kuadrant-operator-catalog-klzgj" Jul 21 01:30:06.030816 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:06.030774 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcd9s\" (UniqueName: \"kubernetes.io/projected/8c1896e6-215a-4a8b-8c47-04d36f5f6f77-kube-api-access-bcd9s\") pod \"kuadrant-operator-catalog-klzgj\" (UID: \"8c1896e6-215a-4a8b-8c47-04d36f5f6f77\") " pod="kuadrant-system/kuadrant-operator-catalog-klzgj" Jul 21 01:30:06.039280 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:06.039242 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcd9s\" (UniqueName: \"kubernetes.io/projected/8c1896e6-215a-4a8b-8c47-04d36f5f6f77-kube-api-access-bcd9s\") pod \"kuadrant-operator-catalog-klzgj\" (UID: \"8c1896e6-215a-4a8b-8c47-04d36f5f6f77\") " pod="kuadrant-system/kuadrant-operator-catalog-klzgj" Jul 21 01:30:06.123842 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:06.123732 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-klzgj" Jul 21 01:30:06.180448 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:06.180409 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-klzgj"] Jul 21 01:30:06.256823 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:06.256781 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-klzgj"] Jul 21 01:30:06.259586 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:30:06.259555 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c1896e6_215a_4a8b_8c47_04d36f5f6f77.slice/crio-5bdf68460068bab35fb3ddc16e2c60dd756e5df3473e89814719b694503f22f1 WatchSource:0}: Error finding container 5bdf68460068bab35fb3ddc16e2c60dd756e5df3473e89814719b694503f22f1: Status 404 returned error can't find the container with id 5bdf68460068bab35fb3ddc16e2c60dd756e5df3473e89814719b694503f22f1 Jul 21 01:30:06.390735 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:06.390658 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tmfxb"] Jul 21 01:30:06.394056 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:06.394038 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tmfxb" Jul 21 01:30:06.401640 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:06.401518 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tmfxb"] Jul 21 01:30:06.536510 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:06.536475 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stnm8\" (UniqueName: \"kubernetes.io/projected/f8c628e1-1592-4759-8bf5-1add00a1fe7f-kube-api-access-stnm8\") pod \"kuadrant-operator-catalog-tmfxb\" (UID: \"f8c628e1-1592-4759-8bf5-1add00a1fe7f\") " pod="kuadrant-system/kuadrant-operator-catalog-tmfxb" Jul 21 01:30:06.638016 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:06.637970 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stnm8\" (UniqueName: \"kubernetes.io/projected/f8c628e1-1592-4759-8bf5-1add00a1fe7f-kube-api-access-stnm8\") pod \"kuadrant-operator-catalog-tmfxb\" (UID: \"f8c628e1-1592-4759-8bf5-1add00a1fe7f\") " pod="kuadrant-system/kuadrant-operator-catalog-tmfxb" Jul 21 01:30:06.647140 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:06.647071 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stnm8\" (UniqueName: \"kubernetes.io/projected/f8c628e1-1592-4759-8bf5-1add00a1fe7f-kube-api-access-stnm8\") pod \"kuadrant-operator-catalog-tmfxb\" (UID: \"f8c628e1-1592-4759-8bf5-1add00a1fe7f\") " pod="kuadrant-system/kuadrant-operator-catalog-tmfxb" Jul 21 01:30:06.704252 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:06.704215 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tmfxb" Jul 21 01:30:06.850283 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:06.850259 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tmfxb"] Jul 21 01:30:06.855835 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:30:06.855791 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c628e1_1592_4759_8bf5_1add00a1fe7f.slice/crio-39fd5a427e7b8bd0d495cbc252e0eaebc7281c21b276e191cd5e932fc576fa76 WatchSource:0}: Error finding container 39fd5a427e7b8bd0d495cbc252e0eaebc7281c21b276e191cd5e932fc576fa76: Status 404 returned error can't find the container with id 39fd5a427e7b8bd0d495cbc252e0eaebc7281c21b276e191cd5e932fc576fa76 Jul 21 01:30:07.076589 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:07.076555 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tmfxb" event={"ID":"f8c628e1-1592-4759-8bf5-1add00a1fe7f","Type":"ContainerStarted","Data":"39fd5a427e7b8bd0d495cbc252e0eaebc7281c21b276e191cd5e932fc576fa76"} Jul 21 01:30:07.077821 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:07.077771 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-klzgj" event={"ID":"8c1896e6-215a-4a8b-8c47-04d36f5f6f77","Type":"ContainerStarted","Data":"5bdf68460068bab35fb3ddc16e2c60dd756e5df3473e89814719b694503f22f1"} Jul 21 01:30:09.090516 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:09.090467 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tmfxb" event={"ID":"f8c628e1-1592-4759-8bf5-1add00a1fe7f","Type":"ContainerStarted","Data":"1ecdcc12b1b9407a2d34aed27d0fa57d009530346f5bd5289e004dcd97bcd5c7"} Jul 21 01:30:09.091875 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:09.091853 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-klzgj" event={"ID":"8c1896e6-215a-4a8b-8c47-04d36f5f6f77","Type":"ContainerStarted","Data":"ea8c6155827bce495fc30656ca510845d1b1831d91fa4177982c8832c977df87"} Jul 21 01:30:09.091970 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:09.091939 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-klzgj" podUID="8c1896e6-215a-4a8b-8c47-04d36f5f6f77" containerName="registry-server" containerID="cri-o://ea8c6155827bce495fc30656ca510845d1b1831d91fa4177982c8832c977df87" gracePeriod=2 Jul 21 01:30:09.108033 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:09.107992 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tmfxb" podStartSLOduration=1.628574569 podStartE2EDuration="3.107978079s" totalImagesPullingTime="1.47940351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:30:09.106231528 +0000 UTC m=+488.792880083" watchObservedRunningTime="2026-07-21 01:30:09.107978079 +0000 UTC m=+488.794626635" Jul 21 01:30:09.122301 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:09.122251 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-klzgj" podStartSLOduration=2.049358734 podStartE2EDuration="4.122231464s" totalImagesPullingTime="2.07287273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:30:09.120774061 +0000 UTC m=+488.807422618" watchObservedRunningTime="2026-07-21 01:30:09.122231464 +0000 UTC m=+488.808880020" Jul 21 01:30:09.338309 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:09.338280 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-klzgj" Jul 21 01:30:09.472085 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:09.472001 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcd9s\" (UniqueName: \"kubernetes.io/projected/8c1896e6-215a-4a8b-8c47-04d36f5f6f77-kube-api-access-bcd9s\") pod \"8c1896e6-215a-4a8b-8c47-04d36f5f6f77\" (UID: \"8c1896e6-215a-4a8b-8c47-04d36f5f6f77\") " Jul 21 01:30:09.474314 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:09.474290 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c1896e6-215a-4a8b-8c47-04d36f5f6f77-kube-api-access-bcd9s" (OuterVolumeSpecName: "kube-api-access-bcd9s") pod "8c1896e6-215a-4a8b-8c47-04d36f5f6f77" (UID: "8c1896e6-215a-4a8b-8c47-04d36f5f6f77"). InnerVolumeSpecName "kube-api-access-bcd9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:30:09.573049 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:09.573012 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcd9s\" (UniqueName: \"kubernetes.io/projected/8c1896e6-215a-4a8b-8c47-04d36f5f6f77-kube-api-access-bcd9s\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:10.098549 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:10.098517 2553 generic.go:356] "Generic (PLEG): container finished" podID="8c1896e6-215a-4a8b-8c47-04d36f5f6f77" containerID="ea8c6155827bce495fc30656ca510845d1b1831d91fa4177982c8832c977df87" exitCode=0 Jul 21 01:30:10.098976 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:10.098569 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-klzgj" Jul 21 01:30:10.098976 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:10.098607 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-klzgj" event={"ID":"8c1896e6-215a-4a8b-8c47-04d36f5f6f77","Type":"ContainerDied","Data":"ea8c6155827bce495fc30656ca510845d1b1831d91fa4177982c8832c977df87"} Jul 21 01:30:10.098976 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:10.098654 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-klzgj" event={"ID":"8c1896e6-215a-4a8b-8c47-04d36f5f6f77","Type":"ContainerDied","Data":"5bdf68460068bab35fb3ddc16e2c60dd756e5df3473e89814719b694503f22f1"} Jul 21 01:30:10.098976 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:10.098675 2553 scope.go:117] "RemoveContainer" containerID="ea8c6155827bce495fc30656ca510845d1b1831d91fa4177982c8832c977df87" Jul 21 01:30:10.108216 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:10.108199 2553 scope.go:117] "RemoveContainer" containerID="ea8c6155827bce495fc30656ca510845d1b1831d91fa4177982c8832c977df87" Jul 21 01:30:10.108480 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:30:10.108462 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea8c6155827bce495fc30656ca510845d1b1831d91fa4177982c8832c977df87\": container with ID starting with ea8c6155827bce495fc30656ca510845d1b1831d91fa4177982c8832c977df87 not found: ID does not exist" containerID="ea8c6155827bce495fc30656ca510845d1b1831d91fa4177982c8832c977df87" Jul 21 01:30:10.108531 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:10.108489 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea8c6155827bce495fc30656ca510845d1b1831d91fa4177982c8832c977df87"} err="failed to get container status \"ea8c6155827bce495fc30656ca510845d1b1831d91fa4177982c8832c977df87\": rpc error: code = NotFound desc = could not find container \"ea8c6155827bce495fc30656ca510845d1b1831d91fa4177982c8832c977df87\": container with ID starting with ea8c6155827bce495fc30656ca510845d1b1831d91fa4177982c8832c977df87 not found: ID does not exist" Jul 21 01:30:10.120584 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:10.120559 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-klzgj"] Jul 21 01:30:10.124907 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:10.124887 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-klzgj"] Jul 21 01:30:10.835137 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:10.835107 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c1896e6-215a-4a8b-8c47-04d36f5f6f77" path="/var/lib/kubelet/pods/8c1896e6-215a-4a8b-8c47-04d36f5f6f77/volumes" Jul 21 01:30:12.040104 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.040071 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58cc6599c8-l998m"] Jul 21 01:30:12.040657 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.040627 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c1896e6-215a-4a8b-8c47-04d36f5f6f77" containerName="registry-server" Jul 21 01:30:12.040657 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.040650 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c1896e6-215a-4a8b-8c47-04d36f5f6f77" containerName="registry-server" Jul 21 01:30:12.040792 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.040731 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c1896e6-215a-4a8b-8c47-04d36f5f6f77" containerName="registry-server" Jul 21 01:30:12.045427 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.045403 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.055672 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.055645 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58cc6599c8-l998m"] Jul 21 01:30:12.196611 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.196572 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/433961d5-047d-4f2b-ab9e-52a632247bad-console-config\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.196611 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.196614 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5jlk\" (UniqueName: \"kubernetes.io/projected/433961d5-047d-4f2b-ab9e-52a632247bad-kube-api-access-p5jlk\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.196931 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.196645 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/433961d5-047d-4f2b-ab9e-52a632247bad-console-serving-cert\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.196931 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.196732 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/433961d5-047d-4f2b-ab9e-52a632247bad-service-ca\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.196931 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.196773 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/433961d5-047d-4f2b-ab9e-52a632247bad-console-oauth-config\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.196931 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.196819 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/433961d5-047d-4f2b-ab9e-52a632247bad-trusted-ca-bundle\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.196931 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.196866 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/433961d5-047d-4f2b-ab9e-52a632247bad-oauth-serving-cert\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.298028 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.297932 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/433961d5-047d-4f2b-ab9e-52a632247bad-console-oauth-config\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.298028 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.297975 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/433961d5-047d-4f2b-ab9e-52a632247bad-trusted-ca-bundle\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.298028 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.298016 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/433961d5-047d-4f2b-ab9e-52a632247bad-oauth-serving-cert\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.298295 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.298082 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/433961d5-047d-4f2b-ab9e-52a632247bad-console-config\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.298295 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.298209 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5jlk\" (UniqueName: \"kubernetes.io/projected/433961d5-047d-4f2b-ab9e-52a632247bad-kube-api-access-p5jlk\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.298295 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.298279 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/433961d5-047d-4f2b-ab9e-52a632247bad-console-serving-cert\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.298423 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.298327 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/433961d5-047d-4f2b-ab9e-52a632247bad-service-ca\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.298869 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.298841 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/433961d5-047d-4f2b-ab9e-52a632247bad-oauth-serving-cert\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.298980 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.298958 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/433961d5-047d-4f2b-ab9e-52a632247bad-console-config\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.299021 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.298965 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/433961d5-047d-4f2b-ab9e-52a632247bad-service-ca\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.299205 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.299188 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/433961d5-047d-4f2b-ab9e-52a632247bad-trusted-ca-bundle\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.301337 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.301316 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/433961d5-047d-4f2b-ab9e-52a632247bad-console-oauth-config\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.301429 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.301320 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/433961d5-047d-4f2b-ab9e-52a632247bad-console-serving-cert\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.306537 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.306517 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5jlk\" (UniqueName: \"kubernetes.io/projected/433961d5-047d-4f2b-ab9e-52a632247bad-kube-api-access-p5jlk\") pod \"console-58cc6599c8-l998m\" (UID: \"433961d5-047d-4f2b-ab9e-52a632247bad\") " pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.357180 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.357145 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:12.497901 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:12.497876 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58cc6599c8-l998m"] Jul 21 01:30:12.499723 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:30:12.499682 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433961d5_047d_4f2b_ab9e_52a632247bad.slice/crio-c44e0ba299ed40e8be1daaedeb5b7251de4ea6b51bf054c64836bea2bb5fe3c2 WatchSource:0}: Error finding container c44e0ba299ed40e8be1daaedeb5b7251de4ea6b51bf054c64836bea2bb5fe3c2: Status 404 returned error can't find the container with id c44e0ba299ed40e8be1daaedeb5b7251de4ea6b51bf054c64836bea2bb5fe3c2 Jul 21 01:30:13.115606 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:13.115569 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cc6599c8-l998m" event={"ID":"433961d5-047d-4f2b-ab9e-52a632247bad","Type":"ContainerStarted","Data":"7f8a91f1bf80a6c799bbe3c9cd85b95c6a442d3d940d6be3881c845d33a8c39a"} Jul 21 01:30:13.116037 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:13.115617 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cc6599c8-l998m" event={"ID":"433961d5-047d-4f2b-ab9e-52a632247bad","Type":"ContainerStarted","Data":"c44e0ba299ed40e8be1daaedeb5b7251de4ea6b51bf054c64836bea2bb5fe3c2"} Jul 21 01:30:13.134890 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:13.134843 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58cc6599c8-l998m" podStartSLOduration=1.134827567 podStartE2EDuration="1.134827567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:30:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:30:13.133198773 +0000 UTC m=+492.819847328" watchObservedRunningTime="2026-07-21 01:30:13.134827567 +0000 UTC m=+492.821476121" Jul 21 01:30:16.704887 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:16.704853 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tmfxb" Jul 21 01:30:16.705270 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:16.705173 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tmfxb" Jul 21 01:30:16.728487 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:16.728461 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tmfxb" Jul 21 01:30:17.157559 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:17.157527 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tmfxb" Jul 21 01:30:20.764669 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:20.764634 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp"] Jul 21 01:30:20.768580 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:20.768557 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" Jul 21 01:30:20.771282 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:20.771258 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z6sgp\"" Jul 21 01:30:20.776762 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:20.776676 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp"] Jul 21 01:30:20.868648 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:20.868620 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxl9r\" (UniqueName: \"kubernetes.io/projected/d259804e-7ec4-4b58-86fa-884a71977fc6-kube-api-access-gxl9r\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp\" (UID: \"d259804e-7ec4-4b58-86fa-884a71977fc6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" Jul 21 01:30:20.868880 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:20.868768 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d259804e-7ec4-4b58-86fa-884a71977fc6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp\" (UID: \"d259804e-7ec4-4b58-86fa-884a71977fc6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" Jul 21 01:30:20.868880 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:20.868822 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d259804e-7ec4-4b58-86fa-884a71977fc6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp\" (UID: \"d259804e-7ec4-4b58-86fa-884a71977fc6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" Jul 21 01:30:20.969891 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:20.969857 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d259804e-7ec4-4b58-86fa-884a71977fc6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp\" (UID: \"d259804e-7ec4-4b58-86fa-884a71977fc6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" Jul 21 01:30:20.970072 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:20.969899 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d259804e-7ec4-4b58-86fa-884a71977fc6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp\" (UID: \"d259804e-7ec4-4b58-86fa-884a71977fc6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" Jul 21 01:30:20.970072 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:20.969931 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxl9r\" (UniqueName: \"kubernetes.io/projected/d259804e-7ec4-4b58-86fa-884a71977fc6-kube-api-access-gxl9r\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp\" (UID: \"d259804e-7ec4-4b58-86fa-884a71977fc6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" Jul 21 01:30:20.970267 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:20.970241 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d259804e-7ec4-4b58-86fa-884a71977fc6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp\" (UID: \"d259804e-7ec4-4b58-86fa-884a71977fc6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" Jul 21 01:30:20.970308 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:20.970270 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d259804e-7ec4-4b58-86fa-884a71977fc6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp\" (UID: \"d259804e-7ec4-4b58-86fa-884a71977fc6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" Jul 21 01:30:20.979508 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:20.979480 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxl9r\" (UniqueName: \"kubernetes.io/projected/d259804e-7ec4-4b58-86fa-884a71977fc6-kube-api-access-gxl9r\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp\" (UID: \"d259804e-7ec4-4b58-86fa-884a71977fc6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" Jul 21 01:30:21.079722 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:21.079640 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" Jul 21 01:30:21.226260 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:21.226235 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp"] Jul 21 01:30:21.228136 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:30:21.228107 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd259804e_7ec4_4b58_86fa_884a71977fc6.slice/crio-b8e91fe9703307d698e52b0c6d9145d850540a630dfec628af927f5ac5d064e3 WatchSource:0}: Error finding container b8e91fe9703307d698e52b0c6d9145d850540a630dfec628af927f5ac5d064e3: Status 404 returned error can't find the container with id b8e91fe9703307d698e52b0c6d9145d850540a630dfec628af927f5ac5d064e3 Jul 21 01:30:21.571271 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:21.570495 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb"] Jul 21 01:30:21.575887 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:21.575862 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" Jul 21 01:30:21.579974 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:21.579949 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb"] Jul 21 01:30:21.676647 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:21.676560 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb\" (UID: \"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" Jul 21 01:30:21.676647 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:21.676593 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb\" (UID: \"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" Jul 21 01:30:21.676647 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:21.676615 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8jl2\" (UniqueName: \"kubernetes.io/projected/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-kube-api-access-m8jl2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb\" (UID: \"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" Jul 21 01:30:21.778036 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:21.778000 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb\" (UID: \"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" Jul 21 01:30:21.778036 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:21.778036 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb\" (UID: \"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" Jul 21 01:30:21.778445 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:21.778057 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8jl2\" (UniqueName: \"kubernetes.io/projected/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-kube-api-access-m8jl2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb\" (UID: \"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" Jul 21 01:30:21.778445 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:21.778402 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb\" (UID: \"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" Jul 21 01:30:21.778522 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:21.778462 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb\" (UID: \"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" Jul 21 01:30:21.788264 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:21.788236 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8jl2\" (UniqueName: \"kubernetes.io/projected/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-kube-api-access-m8jl2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb\" (UID: \"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" Jul 21 01:30:21.886571 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:21.886535 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" Jul 21 01:30:22.034412 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.034264 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb"] Jul 21 01:30:22.036997 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:30:22.036975 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda91016dc_76fe_4084_a1b2_b09cc6f2a4bb.slice/crio-82227a8fba612ef1ed30cb47056bb7e7a0788d6f1ed24628836e8d6c24b1e0e6 WatchSource:0}: Error finding container 82227a8fba612ef1ed30cb47056bb7e7a0788d6f1ed24628836e8d6c24b1e0e6: Status 404 returned error can't find the container with id 82227a8fba612ef1ed30cb47056bb7e7a0788d6f1ed24628836e8d6c24b1e0e6 Jul 21 01:30:22.162623 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.162592 2553 generic.go:356] "Generic (PLEG): container finished" podID="a91016dc-76fe-4084-a1b2-b09cc6f2a4bb" containerID="01b40989fc8e4de1a1551c771e6e7d64c3bc918ecbfafc0a02fd6d0f4b9d984b" exitCode=0 Jul 21 01:30:22.162740 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.162673 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" event={"ID":"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb","Type":"ContainerDied","Data":"01b40989fc8e4de1a1551c771e6e7d64c3bc918ecbfafc0a02fd6d0f4b9d984b"} Jul 21 01:30:22.162740 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.162722 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" event={"ID":"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb","Type":"ContainerStarted","Data":"82227a8fba612ef1ed30cb47056bb7e7a0788d6f1ed24628836e8d6c24b1e0e6"} Jul 21 01:30:22.164369 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.164342 2553 generic.go:356] "Generic (PLEG): container finished" podID="d259804e-7ec4-4b58-86fa-884a71977fc6" containerID="deed45c1a8b072cfc02d6be1f15c6e80bb35e9cfeebdb8d1e8f8223cb2ac39a8" exitCode=0 Jul 21 01:30:22.164495 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.164407 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" event={"ID":"d259804e-7ec4-4b58-86fa-884a71977fc6","Type":"ContainerDied","Data":"deed45c1a8b072cfc02d6be1f15c6e80bb35e9cfeebdb8d1e8f8223cb2ac39a8"} Jul 21 01:30:22.164495 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.164448 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" event={"ID":"d259804e-7ec4-4b58-86fa-884a71977fc6","Type":"ContainerStarted","Data":"b8e91fe9703307d698e52b0c6d9145d850540a630dfec628af927f5ac5d064e3"} Jul 21 01:30:22.169696 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.169675 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq"] Jul 21 01:30:22.173259 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.173241 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" Jul 21 01:30:22.181910 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.181887 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq"] Jul 21 01:30:22.282532 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.282495 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gslht\" (UniqueName: \"kubernetes.io/projected/716404c9-8285-4b94-9e70-a80fda11795c-kube-api-access-gslht\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq\" (UID: \"716404c9-8285-4b94-9e70-a80fda11795c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" Jul 21 01:30:22.282713 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.282551 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/716404c9-8285-4b94-9e70-a80fda11795c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq\" (UID: \"716404c9-8285-4b94-9e70-a80fda11795c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" Jul 21 01:30:22.282713 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.282683 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/716404c9-8285-4b94-9e70-a80fda11795c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq\" (UID: \"716404c9-8285-4b94-9e70-a80fda11795c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" Jul 21 01:30:22.357554 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.357503 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:22.357753 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.357585 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:22.362543 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.362519 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:22.383502 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.383466 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gslht\" (UniqueName: \"kubernetes.io/projected/716404c9-8285-4b94-9e70-a80fda11795c-kube-api-access-gslht\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq\" (UID: \"716404c9-8285-4b94-9e70-a80fda11795c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" Jul 21 01:30:22.383635 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.383508 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/716404c9-8285-4b94-9e70-a80fda11795c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq\" (UID: \"716404c9-8285-4b94-9e70-a80fda11795c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" Jul 21 01:30:22.383635 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.383547 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/716404c9-8285-4b94-9e70-a80fda11795c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq\" (UID: \"716404c9-8285-4b94-9e70-a80fda11795c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" Jul 21 01:30:22.383944 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.383927 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/716404c9-8285-4b94-9e70-a80fda11795c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq\" (UID: \"716404c9-8285-4b94-9e70-a80fda11795c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" Jul 21 01:30:22.383993 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.383958 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/716404c9-8285-4b94-9e70-a80fda11795c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq\" (UID: \"716404c9-8285-4b94-9e70-a80fda11795c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" Jul 21 01:30:22.391907 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.391875 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gslht\" (UniqueName: \"kubernetes.io/projected/716404c9-8285-4b94-9e70-a80fda11795c-kube-api-access-gslht\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq\" (UID: \"716404c9-8285-4b94-9e70-a80fda11795c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" Jul 21 01:30:22.501695 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.501671 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" Jul 21 01:30:22.570000 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.569968 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc"] Jul 21 01:30:22.574562 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.574539 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" Jul 21 01:30:22.581825 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.581770 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc"] Jul 21 01:30:22.667954 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.667931 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq"] Jul 21 01:30:22.670426 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:30:22.670397 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716404c9_8285_4b94_9e70_a80fda11795c.slice/crio-55445e97bc95c863959484c34744bb81a75c8e1c78059a44b61660cc40152f60 WatchSource:0}: Error finding container 55445e97bc95c863959484c34744bb81a75c8e1c78059a44b61660cc40152f60: Status 404 returned error can't find the container with id 55445e97bc95c863959484c34744bb81a75c8e1c78059a44b61660cc40152f60 Jul 21 01:30:22.686545 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.686524 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13c55319-0019-4c62-bedf-360bbe883528-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc\" (UID: \"13c55319-0019-4c62-bedf-360bbe883528\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" Jul 21 01:30:22.686607 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.686560 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13c55319-0019-4c62-bedf-360bbe883528-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc\" (UID: \"13c55319-0019-4c62-bedf-360bbe883528\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" Jul 21 01:30:22.686671 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.686656 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnldt\" (UniqueName: \"kubernetes.io/projected/13c55319-0019-4c62-bedf-360bbe883528-kube-api-access-wnldt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc\" (UID: \"13c55319-0019-4c62-bedf-360bbe883528\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" Jul 21 01:30:22.787783 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.787749 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnldt\" (UniqueName: \"kubernetes.io/projected/13c55319-0019-4c62-bedf-360bbe883528-kube-api-access-wnldt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc\" (UID: \"13c55319-0019-4c62-bedf-360bbe883528\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" Jul 21 01:30:22.788151 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.787840 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13c55319-0019-4c62-bedf-360bbe883528-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc\" (UID: \"13c55319-0019-4c62-bedf-360bbe883528\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" Jul 21 01:30:22.788151 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.787864 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13c55319-0019-4c62-bedf-360bbe883528-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc\" (UID: \"13c55319-0019-4c62-bedf-360bbe883528\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" Jul 21 01:30:22.788243 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.788173 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13c55319-0019-4c62-bedf-360bbe883528-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc\" (UID: \"13c55319-0019-4c62-bedf-360bbe883528\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" Jul 21 01:30:22.788243 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.788224 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13c55319-0019-4c62-bedf-360bbe883528-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc\" (UID: \"13c55319-0019-4c62-bedf-360bbe883528\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" Jul 21 01:30:22.797665 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.797639 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnldt\" (UniqueName: \"kubernetes.io/projected/13c55319-0019-4c62-bedf-360bbe883528-kube-api-access-wnldt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc\" (UID: \"13c55319-0019-4c62-bedf-360bbe883528\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" Jul 21 01:30:22.887130 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:22.887100 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" Jul 21 01:30:23.159178 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:23.159139 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc"] Jul 21 01:30:23.170440 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:23.170407 2553 generic.go:356] "Generic (PLEG): container finished" podID="716404c9-8285-4b94-9e70-a80fda11795c" containerID="2eaa3ee5551ec46159bed28220f12f7bbb4b02d1be99106ad7de31caed13d508" exitCode=0 Jul 21 01:30:23.170551 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:23.170488 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" event={"ID":"716404c9-8285-4b94-9e70-a80fda11795c","Type":"ContainerDied","Data":"2eaa3ee5551ec46159bed28220f12f7bbb4b02d1be99106ad7de31caed13d508"} Jul 21 01:30:23.170551 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:23.170541 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" event={"ID":"716404c9-8285-4b94-9e70-a80fda11795c","Type":"ContainerStarted","Data":"55445e97bc95c863959484c34744bb81a75c8e1c78059a44b61660cc40152f60"} Jul 21 01:30:23.172582 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:23.172549 2553 generic.go:356] "Generic (PLEG): container finished" podID="a91016dc-76fe-4084-a1b2-b09cc6f2a4bb" containerID="1f2b4e3f1f0467359a4212b9bf3a536e34fea26ff76ec86f3d559aadd2706ef2" exitCode=0 Jul 21 01:30:23.172682 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:23.172625 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" event={"ID":"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb","Type":"ContainerDied","Data":"1f2b4e3f1f0467359a4212b9bf3a536e34fea26ff76ec86f3d559aadd2706ef2"} Jul 21 01:30:23.174689 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:23.174668 2553 generic.go:356] "Generic (PLEG): container finished" podID="d259804e-7ec4-4b58-86fa-884a71977fc6" containerID="14196636b0e69fe0bcb4973aa1af89c72865aee2a622335ff5ad27b279142283" exitCode=0 Jul 21 01:30:23.174767 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:23.174707 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" event={"ID":"d259804e-7ec4-4b58-86fa-884a71977fc6","Type":"ContainerDied","Data":"14196636b0e69fe0bcb4973aa1af89c72865aee2a622335ff5ad27b279142283"} Jul 21 01:30:23.186268 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:23.186235 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58cc6599c8-l998m" Jul 21 01:30:23.191352 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:30:23.191329 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c55319_0019_4c62_bedf_360bbe883528.slice/crio-021497641a4312fad29cd38570ed3436f5ad63e65d921eaddf925d62122cec79 WatchSource:0}: Error finding container 021497641a4312fad29cd38570ed3436f5ad63e65d921eaddf925d62122cec79: Status 404 returned error can't find the container with id 021497641a4312fad29cd38570ed3436f5ad63e65d921eaddf925d62122cec79 Jul 21 01:30:23.236374 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:23.236341 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f9bf4b8df-crfv9"] Jul 21 01:30:24.182079 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:24.182049 2553 generic.go:356] "Generic (PLEG): container finished" podID="13c55319-0019-4c62-bedf-360bbe883528" containerID="a8df52124225413622bf5a5fc784413bf6c5761c4f3c6e625edce228f14fbdba" exitCode=0 Jul 21 01:30:24.182502 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:24.182143 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" event={"ID":"13c55319-0019-4c62-bedf-360bbe883528","Type":"ContainerDied","Data":"a8df52124225413622bf5a5fc784413bf6c5761c4f3c6e625edce228f14fbdba"} Jul 21 01:30:24.182502 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:24.182218 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" event={"ID":"13c55319-0019-4c62-bedf-360bbe883528","Type":"ContainerStarted","Data":"021497641a4312fad29cd38570ed3436f5ad63e65d921eaddf925d62122cec79"} Jul 21 01:30:24.184443 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:24.184422 2553 generic.go:356] "Generic (PLEG): container finished" podID="a91016dc-76fe-4084-a1b2-b09cc6f2a4bb" containerID="1e8b2b924f41a1e4e052ff26a88ee6776312e9ee7016a97576a47e9e375863a2" exitCode=0 Jul 21 01:30:24.184537 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:24.184481 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" event={"ID":"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb","Type":"ContainerDied","Data":"1e8b2b924f41a1e4e052ff26a88ee6776312e9ee7016a97576a47e9e375863a2"} Jul 21 01:30:24.186607 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:24.186585 2553 generic.go:356] "Generic (PLEG): container finished" podID="d259804e-7ec4-4b58-86fa-884a71977fc6" containerID="c7629923b554ff81ab429fb5fda98e17666d22032c8cd2bb79346ced86fb2e51" exitCode=0 Jul 21 01:30:24.186716 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:24.186610 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" event={"ID":"d259804e-7ec4-4b58-86fa-884a71977fc6","Type":"ContainerDied","Data":"c7629923b554ff81ab429fb5fda98e17666d22032c8cd2bb79346ced86fb2e51"} Jul 21 01:30:24.188503 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:24.188485 2553 generic.go:356] "Generic (PLEG): container finished" podID="716404c9-8285-4b94-9e70-a80fda11795c" containerID="c0bfb29f0bb72e9fedce45c2acd147ff14ec7e674e87c1634e3386f5fea3bc5b" exitCode=0 Jul 21 01:30:24.188589 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:24.188550 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" event={"ID":"716404c9-8285-4b94-9e70-a80fda11795c","Type":"ContainerDied","Data":"c0bfb29f0bb72e9fedce45c2acd147ff14ec7e674e87c1634e3386f5fea3bc5b"} Jul 21 01:30:25.195968 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.195878 2553 generic.go:356] "Generic (PLEG): container finished" podID="716404c9-8285-4b94-9e70-a80fda11795c" containerID="831fa4677163b909ab9e5af875b394754f55784cfaf02d376d1a5de308b29aeb" exitCode=0 Jul 21 01:30:25.196366 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.195975 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" event={"ID":"716404c9-8285-4b94-9e70-a80fda11795c","Type":"ContainerDied","Data":"831fa4677163b909ab9e5af875b394754f55784cfaf02d376d1a5de308b29aeb"} Jul 21 01:30:25.197737 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.197713 2553 generic.go:356] "Generic (PLEG): container finished" podID="13c55319-0019-4c62-bedf-360bbe883528" containerID="42bf2be01a24367ecac5f02b3604e9025221c15b1a7f78c0d4c5198e9270201a" exitCode=0 Jul 21 01:30:25.197862 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.197824 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" event={"ID":"13c55319-0019-4c62-bedf-360bbe883528","Type":"ContainerDied","Data":"42bf2be01a24367ecac5f02b3604e9025221c15b1a7f78c0d4c5198e9270201a"} Jul 21 01:30:25.363322 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.363294 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" Jul 21 01:30:25.426858 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.426834 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" Jul 21 01:30:25.517912 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.517884 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d259804e-7ec4-4b58-86fa-884a71977fc6-util\") pod \"d259804e-7ec4-4b58-86fa-884a71977fc6\" (UID: \"d259804e-7ec4-4b58-86fa-884a71977fc6\") " Jul 21 01:30:25.517912 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.517916 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d259804e-7ec4-4b58-86fa-884a71977fc6-bundle\") pod \"d259804e-7ec4-4b58-86fa-884a71977fc6\" (UID: \"d259804e-7ec4-4b58-86fa-884a71977fc6\") " Jul 21 01:30:25.518137 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.517944 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8jl2\" (UniqueName: \"kubernetes.io/projected/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-kube-api-access-m8jl2\") pod \"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb\" (UID: \"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb\") " Jul 21 01:30:25.518137 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.517992 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-bundle\") pod \"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb\" (UID: \"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb\") " Jul 21 01:30:25.518137 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.518020 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxl9r\" (UniqueName: \"kubernetes.io/projected/d259804e-7ec4-4b58-86fa-884a71977fc6-kube-api-access-gxl9r\") pod \"d259804e-7ec4-4b58-86fa-884a71977fc6\" (UID: \"d259804e-7ec4-4b58-86fa-884a71977fc6\") " Jul 21 01:30:25.518137 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.518050 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-util\") pod \"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb\" (UID: \"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb\") " Jul 21 01:30:25.518542 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.518517 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d259804e-7ec4-4b58-86fa-884a71977fc6-bundle" (OuterVolumeSpecName: "bundle") pod "d259804e-7ec4-4b58-86fa-884a71977fc6" (UID: "d259804e-7ec4-4b58-86fa-884a71977fc6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:30:25.518659 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.518517 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-bundle" (OuterVolumeSpecName: "bundle") pod "a91016dc-76fe-4084-a1b2-b09cc6f2a4bb" (UID: "a91016dc-76fe-4084-a1b2-b09cc6f2a4bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:30:25.520843 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.520811 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d259804e-7ec4-4b58-86fa-884a71977fc6-kube-api-access-gxl9r" (OuterVolumeSpecName: "kube-api-access-gxl9r") pod "d259804e-7ec4-4b58-86fa-884a71977fc6" (UID: "d259804e-7ec4-4b58-86fa-884a71977fc6"). InnerVolumeSpecName "kube-api-access-gxl9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:30:25.520926 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.520850 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-kube-api-access-m8jl2" (OuterVolumeSpecName: "kube-api-access-m8jl2") pod "a91016dc-76fe-4084-a1b2-b09cc6f2a4bb" (UID: "a91016dc-76fe-4084-a1b2-b09cc6f2a4bb"). InnerVolumeSpecName "kube-api-access-m8jl2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:30:25.523072 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.523054 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d259804e-7ec4-4b58-86fa-884a71977fc6-util" (OuterVolumeSpecName: "util") pod "d259804e-7ec4-4b58-86fa-884a71977fc6" (UID: "d259804e-7ec4-4b58-86fa-884a71977fc6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:30:25.524002 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.523982 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-util" (OuterVolumeSpecName: "util") pod "a91016dc-76fe-4084-a1b2-b09cc6f2a4bb" (UID: "a91016dc-76fe-4084-a1b2-b09cc6f2a4bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:30:25.621974 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.621941 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d259804e-7ec4-4b58-86fa-884a71977fc6-util\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:25.622130 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.621988 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d259804e-7ec4-4b58-86fa-884a71977fc6-bundle\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:25.622130 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.621999 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8jl2\" (UniqueName: \"kubernetes.io/projected/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-kube-api-access-m8jl2\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:25.622130 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.622009 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-bundle\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:25.622130 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.622018 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxl9r\" (UniqueName: \"kubernetes.io/projected/d259804e-7ec4-4b58-86fa-884a71977fc6-kube-api-access-gxl9r\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:25.622130 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:25.622025 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a91016dc-76fe-4084-a1b2-b09cc6f2a4bb-util\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:26.205335 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.205308 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" Jul 21 01:30:26.205335 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.205337 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp" event={"ID":"d259804e-7ec4-4b58-86fa-884a71977fc6","Type":"ContainerDied","Data":"b8e91fe9703307d698e52b0c6d9145d850540a630dfec628af927f5ac5d064e3"} Jul 21 01:30:26.205786 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.205386 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8e91fe9703307d698e52b0c6d9145d850540a630dfec628af927f5ac5d064e3" Jul 21 01:30:26.207688 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.207661 2553 generic.go:356] "Generic (PLEG): container finished" podID="13c55319-0019-4c62-bedf-360bbe883528" containerID="9f2354c13c1ebe30bca25125746cc1bb3aef68f4ff7251dcd4b391554e86229c" exitCode=0 Jul 21 01:30:26.207845 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.207733 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" event={"ID":"13c55319-0019-4c62-bedf-360bbe883528","Type":"ContainerDied","Data":"9f2354c13c1ebe30bca25125746cc1bb3aef68f4ff7251dcd4b391554e86229c"} Jul 21 01:30:26.209793 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.209775 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" Jul 21 01:30:26.209935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.209816 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb" event={"ID":"a91016dc-76fe-4084-a1b2-b09cc6f2a4bb","Type":"ContainerDied","Data":"82227a8fba612ef1ed30cb47056bb7e7a0788d6f1ed24628836e8d6c24b1e0e6"} Jul 21 01:30:26.209935 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.209850 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82227a8fba612ef1ed30cb47056bb7e7a0788d6f1ed24628836e8d6c24b1e0e6" Jul 21 01:30:26.342174 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.342152 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" Jul 21 01:30:26.531504 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.531437 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gslht\" (UniqueName: \"kubernetes.io/projected/716404c9-8285-4b94-9e70-a80fda11795c-kube-api-access-gslht\") pod \"716404c9-8285-4b94-9e70-a80fda11795c\" (UID: \"716404c9-8285-4b94-9e70-a80fda11795c\") " Jul 21 01:30:26.531504 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.531493 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/716404c9-8285-4b94-9e70-a80fda11795c-bundle\") pod \"716404c9-8285-4b94-9e70-a80fda11795c\" (UID: \"716404c9-8285-4b94-9e70-a80fda11795c\") " Jul 21 01:30:26.531679 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.531567 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/716404c9-8285-4b94-9e70-a80fda11795c-util\") pod \"716404c9-8285-4b94-9e70-a80fda11795c\" (UID: \"716404c9-8285-4b94-9e70-a80fda11795c\") " Jul 21 01:30:26.532034 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.532003 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/716404c9-8285-4b94-9e70-a80fda11795c-bundle" (OuterVolumeSpecName: "bundle") pod "716404c9-8285-4b94-9e70-a80fda11795c" (UID: "716404c9-8285-4b94-9e70-a80fda11795c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:30:26.533690 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.533670 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716404c9-8285-4b94-9e70-a80fda11795c-kube-api-access-gslht" (OuterVolumeSpecName: "kube-api-access-gslht") pod "716404c9-8285-4b94-9e70-a80fda11795c" (UID: "716404c9-8285-4b94-9e70-a80fda11795c"). InnerVolumeSpecName "kube-api-access-gslht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:30:26.537203 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.537182 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/716404c9-8285-4b94-9e70-a80fda11795c-util" (OuterVolumeSpecName: "util") pod "716404c9-8285-4b94-9e70-a80fda11795c" (UID: "716404c9-8285-4b94-9e70-a80fda11795c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:30:26.632987 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.632957 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/716404c9-8285-4b94-9e70-a80fda11795c-bundle\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:26.632987 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.632982 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/716404c9-8285-4b94-9e70-a80fda11795c-util\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:26.632987 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:26.632992 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gslht\" (UniqueName: \"kubernetes.io/projected/716404c9-8285-4b94-9e70-a80fda11795c-kube-api-access-gslht\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:27.217244 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:27.217156 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" Jul 21 01:30:27.217585 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:27.217156 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq" event={"ID":"716404c9-8285-4b94-9e70-a80fda11795c","Type":"ContainerDied","Data":"55445e97bc95c863959484c34744bb81a75c8e1c78059a44b61660cc40152f60"} Jul 21 01:30:27.217585 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:27.217281 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55445e97bc95c863959484c34744bb81a75c8e1c78059a44b61660cc40152f60" Jul 21 01:30:27.353743 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:27.353715 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" Jul 21 01:30:27.540822 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:27.540766 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13c55319-0019-4c62-bedf-360bbe883528-bundle\") pod \"13c55319-0019-4c62-bedf-360bbe883528\" (UID: \"13c55319-0019-4c62-bedf-360bbe883528\") " Jul 21 01:30:27.540990 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:27.540844 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13c55319-0019-4c62-bedf-360bbe883528-util\") pod \"13c55319-0019-4c62-bedf-360bbe883528\" (UID: \"13c55319-0019-4c62-bedf-360bbe883528\") " Jul 21 01:30:27.540990 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:27.540917 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnldt\" (UniqueName: \"kubernetes.io/projected/13c55319-0019-4c62-bedf-360bbe883528-kube-api-access-wnldt\") pod \"13c55319-0019-4c62-bedf-360bbe883528\" (UID: \"13c55319-0019-4c62-bedf-360bbe883528\") " Jul 21 01:30:27.541522 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:27.541486 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13c55319-0019-4c62-bedf-360bbe883528-bundle" (OuterVolumeSpecName: "bundle") pod "13c55319-0019-4c62-bedf-360bbe883528" (UID: "13c55319-0019-4c62-bedf-360bbe883528"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:30:27.543150 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:27.543127 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13c55319-0019-4c62-bedf-360bbe883528-kube-api-access-wnldt" (OuterVolumeSpecName: "kube-api-access-wnldt") pod "13c55319-0019-4c62-bedf-360bbe883528" (UID: "13c55319-0019-4c62-bedf-360bbe883528"). InnerVolumeSpecName "kube-api-access-wnldt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:30:27.545871 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:27.545850 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13c55319-0019-4c62-bedf-360bbe883528-util" (OuterVolumeSpecName: "util") pod "13c55319-0019-4c62-bedf-360bbe883528" (UID: "13c55319-0019-4c62-bedf-360bbe883528"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:30:27.641786 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:27.641748 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13c55319-0019-4c62-bedf-360bbe883528-bundle\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:27.641786 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:27.641778 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13c55319-0019-4c62-bedf-360bbe883528-util\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:27.641786 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:27.641788 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnldt\" (UniqueName: \"kubernetes.io/projected/13c55319-0019-4c62-bedf-360bbe883528-kube-api-access-wnldt\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:28.226328 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:28.226297 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" event={"ID":"13c55319-0019-4c62-bedf-360bbe883528","Type":"ContainerDied","Data":"021497641a4312fad29cd38570ed3436f5ad63e65d921eaddf925d62122cec79"} Jul 21 01:30:28.226674 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:28.226345 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="021497641a4312fad29cd38570ed3436f5ad63e65d921eaddf925d62122cec79" Jul 21 01:30:28.226674 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:28.226364 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc" Jul 21 01:30:28.259098 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:30:28.259068 2553 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c55319_0019_4c62_bedf_360bbe883528.slice\": RecentStats: unable to find data in memory cache]" Jul 21 01:30:37.152690 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.152656 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m"] Jul 21 01:30:37.153219 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153199 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d259804e-7ec4-4b58-86fa-884a71977fc6" containerName="pull" Jul 21 01:30:37.153314 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153222 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d259804e-7ec4-4b58-86fa-884a71977fc6" containerName="pull" Jul 21 01:30:37.153314 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153235 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a91016dc-76fe-4084-a1b2-b09cc6f2a4bb" containerName="pull" Jul 21 01:30:37.153314 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153243 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a91016dc-76fe-4084-a1b2-b09cc6f2a4bb" containerName="pull" Jul 21 01:30:37.153314 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153255 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716404c9-8285-4b94-9e70-a80fda11795c" containerName="pull" Jul 21 01:30:37.153314 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153263 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="716404c9-8285-4b94-9e70-a80fda11795c" containerName="pull" Jul 21 01:30:37.153314 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153275 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716404c9-8285-4b94-9e70-a80fda11795c" containerName="util" Jul 21 01:30:37.153314 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153283 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="716404c9-8285-4b94-9e70-a80fda11795c" containerName="util" Jul 21 01:30:37.153314 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153297 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d259804e-7ec4-4b58-86fa-884a71977fc6" containerName="util" Jul 21 01:30:37.153314 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153305 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d259804e-7ec4-4b58-86fa-884a71977fc6" containerName="util" Jul 21 01:30:37.153314 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153315 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716404c9-8285-4b94-9e70-a80fda11795c" containerName="extract" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153323 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="716404c9-8285-4b94-9e70-a80fda11795c" containerName="extract" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153333 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13c55319-0019-4c62-bedf-360bbe883528" containerName="util" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153343 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="13c55319-0019-4c62-bedf-360bbe883528" containerName="util" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153361 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d259804e-7ec4-4b58-86fa-884a71977fc6" containerName="extract" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153369 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d259804e-7ec4-4b58-86fa-884a71977fc6" containerName="extract" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153385 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a91016dc-76fe-4084-a1b2-b09cc6f2a4bb" containerName="util" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153393 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a91016dc-76fe-4084-a1b2-b09cc6f2a4bb" containerName="util" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153401 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13c55319-0019-4c62-bedf-360bbe883528" containerName="extract" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153409 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="13c55319-0019-4c62-bedf-360bbe883528" containerName="extract" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153421 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a91016dc-76fe-4084-a1b2-b09cc6f2a4bb" containerName="extract" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153428 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a91016dc-76fe-4084-a1b2-b09cc6f2a4bb" containerName="extract" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153441 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13c55319-0019-4c62-bedf-360bbe883528" containerName="pull" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153448 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="13c55319-0019-4c62-bedf-360bbe883528" containerName="pull" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153537 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a91016dc-76fe-4084-a1b2-b09cc6f2a4bb" containerName="extract" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153552 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="716404c9-8285-4b94-9e70-a80fda11795c" containerName="extract" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153561 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d259804e-7ec4-4b58-86fa-884a71977fc6" containerName="extract" Jul 21 01:30:37.153778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.153572 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="13c55319-0019-4c62-bedf-360bbe883528" containerName="extract" Jul 21 01:30:37.158264 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.158242 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:30:37.161165 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.161145 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kfnjv\"" Jul 21 01:30:37.169525 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.169502 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m"] Jul 21 01:30:37.212915 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.212882 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69mt7\" (UniqueName: \"kubernetes.io/projected/c6861f6f-9bad-4eb8-bdd2-2941c863885d-kube-api-access-69mt7\") pod \"limitador-operator-controller-manager-859d7b78bd-shm7m\" (UID: \"c6861f6f-9bad-4eb8-bdd2-2941c863885d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:30:37.314194 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.314149 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69mt7\" (UniqueName: \"kubernetes.io/projected/c6861f6f-9bad-4eb8-bdd2-2941c863885d-kube-api-access-69mt7\") pod \"limitador-operator-controller-manager-859d7b78bd-shm7m\" (UID: \"c6861f6f-9bad-4eb8-bdd2-2941c863885d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:30:37.325577 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.325550 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69mt7\" (UniqueName: \"kubernetes.io/projected/c6861f6f-9bad-4eb8-bdd2-2941c863885d-kube-api-access-69mt7\") pod \"limitador-operator-controller-manager-859d7b78bd-shm7m\" (UID: \"c6861f6f-9bad-4eb8-bdd2-2941c863885d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:30:37.469546 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.469458 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:30:37.607237 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:37.607211 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m"] Jul 21 01:30:37.609079 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:30:37.609034 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6861f6f_9bad_4eb8_bdd2_2941c863885d.slice/crio-a27b5f296ea83749d4bf1e46e1f770eb8b33a76e52dfe9dfc3d3ee69dd2ea628 WatchSource:0}: Error finding container a27b5f296ea83749d4bf1e46e1f770eb8b33a76e52dfe9dfc3d3ee69dd2ea628: Status 404 returned error can't find the container with id a27b5f296ea83749d4bf1e46e1f770eb8b33a76e52dfe9dfc3d3ee69dd2ea628 Jul 21 01:30:38.279758 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:38.279720 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" event={"ID":"c6861f6f-9bad-4eb8-bdd2-2941c863885d","Type":"ContainerStarted","Data":"a27b5f296ea83749d4bf1e46e1f770eb8b33a76e52dfe9dfc3d3ee69dd2ea628"} Jul 21 01:30:40.291242 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:40.291208 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" event={"ID":"c6861f6f-9bad-4eb8-bdd2-2941c863885d","Type":"ContainerStarted","Data":"891d7bf769c87b8f99ad18e9babb8efe4d038de62b1366efa723920003a1afae"} Jul 21 01:30:40.291645 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:40.291274 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:30:40.309456 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:40.309406 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" podStartSLOduration=1.5880635349999999 podStartE2EDuration="3.309389831s" totalImagesPullingTime="1.721326296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:30:40.307298841 +0000 UTC m=+519.993947396" watchObservedRunningTime="2026-07-21 01:30:40.309389831 +0000 UTC m=+519.996038467" Jul 21 01:30:41.023831 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:41.023788 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qmpr4"] Jul 21 01:30:41.027359 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:41.027342 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qmpr4" Jul 21 01:30:41.030564 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:41.030548 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mz29x\"" Jul 21 01:30:41.030827 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:41.030811 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 21 01:30:41.043168 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:41.043144 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qmpr4"] Jul 21 01:30:41.043312 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:41.043291 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k7s9\" (UniqueName: \"kubernetes.io/projected/7a5bdf0d-9e31-4b3a-bf49-898358287568-kube-api-access-6k7s9\") pod \"dns-operator-controller-manager-864dd78c4c-qmpr4\" (UID: \"7a5bdf0d-9e31-4b3a-bf49-898358287568\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qmpr4" Jul 21 01:30:41.143792 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:41.143756 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k7s9\" (UniqueName: \"kubernetes.io/projected/7a5bdf0d-9e31-4b3a-bf49-898358287568-kube-api-access-6k7s9\") pod \"dns-operator-controller-manager-864dd78c4c-qmpr4\" (UID: \"7a5bdf0d-9e31-4b3a-bf49-898358287568\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qmpr4" Jul 21 01:30:41.155662 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:41.155629 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k7s9\" (UniqueName: \"kubernetes.io/projected/7a5bdf0d-9e31-4b3a-bf49-898358287568-kube-api-access-6k7s9\") pod \"dns-operator-controller-manager-864dd78c4c-qmpr4\" (UID: \"7a5bdf0d-9e31-4b3a-bf49-898358287568\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qmpr4" Jul 21 01:30:41.337603 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:41.337509 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qmpr4" Jul 21 01:30:41.485401 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:41.485375 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qmpr4"] Jul 21 01:30:41.487362 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:30:41.487334 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5bdf0d_9e31_4b3a_bf49_898358287568.slice/crio-da2bb6960819ca46920d62b23087e9467c66583b009c894228a20d046a6d2e8b WatchSource:0}: Error finding container da2bb6960819ca46920d62b23087e9467c66583b009c894228a20d046a6d2e8b: Status 404 returned error can't find the container with id da2bb6960819ca46920d62b23087e9467c66583b009c894228a20d046a6d2e8b Jul 21 01:30:42.304485 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:42.304445 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qmpr4" event={"ID":"7a5bdf0d-9e31-4b3a-bf49-898358287568","Type":"ContainerStarted","Data":"da2bb6960819ca46920d62b23087e9467c66583b009c894228a20d046a6d2e8b"} Jul 21 01:30:44.318851 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:44.318789 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qmpr4" event={"ID":"7a5bdf0d-9e31-4b3a-bf49-898358287568","Type":"ContainerStarted","Data":"cba8df256ce04a7495ada0183201dbdd3313a78f1915faaaaf93df4cfc3184b9"} Jul 21 01:30:44.319281 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:44.318882 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qmpr4" Jul 21 01:30:44.337297 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:44.337247 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qmpr4" podStartSLOduration=2.207117485 podStartE2EDuration="4.337231311s" totalImagesPullingTime="2.130113826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:30:44.334887098 +0000 UTC m=+524.021535654" watchObservedRunningTime="2026-07-21 01:30:44.337231311 +0000 UTC m=+524.023879865" Jul 21 01:30:45.954866 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:45.954831 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9"] Jul 21 01:30:45.958594 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:45.958571 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:30:45.962046 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:45.962022 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pjmcg\"" Jul 21 01:30:45.975194 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:45.975168 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9"] Jul 21 01:30:45.979004 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:45.978974 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac7c9720-dd32-4a88-a216-8418eb93e8ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-djfl9\" (UID: \"ac7c9720-dd32-4a88-a216-8418eb93e8ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:30:45.979111 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:45.979051 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n87wb\" (UniqueName: \"kubernetes.io/projected/ac7c9720-dd32-4a88-a216-8418eb93e8ea-kube-api-access-n87wb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-djfl9\" (UID: \"ac7c9720-dd32-4a88-a216-8418eb93e8ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:30:46.079431 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:46.079400 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac7c9720-dd32-4a88-a216-8418eb93e8ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-djfl9\" (UID: \"ac7c9720-dd32-4a88-a216-8418eb93e8ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:30:46.079605 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:46.079461 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n87wb\" (UniqueName: \"kubernetes.io/projected/ac7c9720-dd32-4a88-a216-8418eb93e8ea-kube-api-access-n87wb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-djfl9\" (UID: \"ac7c9720-dd32-4a88-a216-8418eb93e8ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:30:46.079758 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:46.079738 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac7c9720-dd32-4a88-a216-8418eb93e8ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-djfl9\" (UID: \"ac7c9720-dd32-4a88-a216-8418eb93e8ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:30:46.091148 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:46.091123 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n87wb\" (UniqueName: \"kubernetes.io/projected/ac7c9720-dd32-4a88-a216-8418eb93e8ea-kube-api-access-n87wb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-djfl9\" (UID: \"ac7c9720-dd32-4a88-a216-8418eb93e8ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:30:46.268532 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:46.268493 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:30:46.418740 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:46.418715 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9"] Jul 21 01:30:46.420744 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:30:46.420712 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7c9720_dd32_4a88_a216_8418eb93e8ea.slice/crio-145de5863c44a10b09c072af60c75ce5c3291b3215c4e0e6c63f2ca0a5e7af49 WatchSource:0}: Error finding container 145de5863c44a10b09c072af60c75ce5c3291b3215c4e0e6c63f2ca0a5e7af49: Status 404 returned error can't find the container with id 145de5863c44a10b09c072af60c75ce5c3291b3215c4e0e6c63f2ca0a5e7af49 Jul 21 01:30:47.338729 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:47.338691 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" event={"ID":"ac7c9720-dd32-4a88-a216-8418eb93e8ea","Type":"ContainerStarted","Data":"145de5863c44a10b09c072af60c75ce5c3291b3215c4e0e6c63f2ca0a5e7af49"} Jul 21 01:30:48.267823 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.267761 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f9bf4b8df-crfv9" podUID="420eca03-9a40-4890-8ba9-6d462df430a4" containerName="console" containerID="cri-o://0fd2cc8248ab9e2fd7ef3c3b2ac449e298c9ff6875102c476463bd1176d630cd" gracePeriod=15 Jul 21 01:30:48.525920 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.525859 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:30:48.599392 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.599360 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/420eca03-9a40-4890-8ba9-6d462df430a4-console-serving-cert\") pod \"420eca03-9a40-4890-8ba9-6d462df430a4\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " Jul 21 01:30:48.599653 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.599426 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/420eca03-9a40-4890-8ba9-6d462df430a4-console-oauth-config\") pod \"420eca03-9a40-4890-8ba9-6d462df430a4\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " Jul 21 01:30:48.599653 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.599462 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzns9\" (UniqueName: \"kubernetes.io/projected/420eca03-9a40-4890-8ba9-6d462df430a4-kube-api-access-fzns9\") pod \"420eca03-9a40-4890-8ba9-6d462df430a4\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " Jul 21 01:30:48.599653 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.599490 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-console-config\") pod \"420eca03-9a40-4890-8ba9-6d462df430a4\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " Jul 21 01:30:48.599653 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.599507 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-service-ca\") pod \"420eca03-9a40-4890-8ba9-6d462df430a4\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " Jul 21 01:30:48.599653 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.599536 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-oauth-serving-cert\") pod \"420eca03-9a40-4890-8ba9-6d462df430a4\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " Jul 21 01:30:48.599653 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.599566 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-trusted-ca-bundle\") pod \"420eca03-9a40-4890-8ba9-6d462df430a4\" (UID: \"420eca03-9a40-4890-8ba9-6d462df430a4\") " Jul 21 01:30:48.600030 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.599949 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-console-config" (OuterVolumeSpecName: "console-config") pod "420eca03-9a40-4890-8ba9-6d462df430a4" (UID: "420eca03-9a40-4890-8ba9-6d462df430a4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:30:48.600030 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.599958 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-service-ca" (OuterVolumeSpecName: "service-ca") pod "420eca03-9a40-4890-8ba9-6d462df430a4" (UID: "420eca03-9a40-4890-8ba9-6d462df430a4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:30:48.600030 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.599965 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "420eca03-9a40-4890-8ba9-6d462df430a4" (UID: "420eca03-9a40-4890-8ba9-6d462df430a4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:30:48.600344 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.600152 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "420eca03-9a40-4890-8ba9-6d462df430a4" (UID: "420eca03-9a40-4890-8ba9-6d462df430a4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:30:48.601823 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.601767 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/420eca03-9a40-4890-8ba9-6d462df430a4-kube-api-access-fzns9" (OuterVolumeSpecName: "kube-api-access-fzns9") pod "420eca03-9a40-4890-8ba9-6d462df430a4" (UID: "420eca03-9a40-4890-8ba9-6d462df430a4"). InnerVolumeSpecName "kube-api-access-fzns9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:30:48.601823 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.601788 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/420eca03-9a40-4890-8ba9-6d462df430a4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "420eca03-9a40-4890-8ba9-6d462df430a4" (UID: "420eca03-9a40-4890-8ba9-6d462df430a4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 01:30:48.601963 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.601822 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/420eca03-9a40-4890-8ba9-6d462df430a4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "420eca03-9a40-4890-8ba9-6d462df430a4" (UID: "420eca03-9a40-4890-8ba9-6d462df430a4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 01:30:48.700412 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.700372 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-console-config\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:48.700412 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.700414 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-service-ca\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:48.700623 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.700430 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-oauth-serving-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:48.700623 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.700441 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420eca03-9a40-4890-8ba9-6d462df430a4-trusted-ca-bundle\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:48.700623 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.700449 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/420eca03-9a40-4890-8ba9-6d462df430a4-console-serving-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:48.700623 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.700460 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/420eca03-9a40-4890-8ba9-6d462df430a4-console-oauth-config\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:48.700623 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:48.700468 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzns9\" (UniqueName: \"kubernetes.io/projected/420eca03-9a40-4890-8ba9-6d462df430a4-kube-api-access-fzns9\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:30:49.351744 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.351711 2553 generic.go:356] "Generic (PLEG): container finished" podID="420eca03-9a40-4890-8ba9-6d462df430a4" containerID="0fd2cc8248ab9e2fd7ef3c3b2ac449e298c9ff6875102c476463bd1176d630cd" exitCode=0 Jul 21 01:30:49.351933 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.351757 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9bf4b8df-crfv9" Jul 21 01:30:49.351933 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.351764 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9bf4b8df-crfv9" event={"ID":"420eca03-9a40-4890-8ba9-6d462df430a4","Type":"ContainerDied","Data":"0fd2cc8248ab9e2fd7ef3c3b2ac449e298c9ff6875102c476463bd1176d630cd"} Jul 21 01:30:49.351933 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.351824 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9bf4b8df-crfv9" event={"ID":"420eca03-9a40-4890-8ba9-6d462df430a4","Type":"ContainerDied","Data":"9b50a97c1fa2519db526be256a75aa9d9d35fc628e0099d5bb3c4b116c88d5f4"} Jul 21 01:30:49.351933 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.351848 2553 scope.go:117] "RemoveContainer" containerID="0fd2cc8248ab9e2fd7ef3c3b2ac449e298c9ff6875102c476463bd1176d630cd" Jul 21 01:30:49.361421 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.361403 2553 scope.go:117] "RemoveContainer" containerID="0fd2cc8248ab9e2fd7ef3c3b2ac449e298c9ff6875102c476463bd1176d630cd" Jul 21 01:30:49.361680 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:30:49.361658 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fd2cc8248ab9e2fd7ef3c3b2ac449e298c9ff6875102c476463bd1176d630cd\": container with ID starting with 0fd2cc8248ab9e2fd7ef3c3b2ac449e298c9ff6875102c476463bd1176d630cd not found: ID does not exist" containerID="0fd2cc8248ab9e2fd7ef3c3b2ac449e298c9ff6875102c476463bd1176d630cd" Jul 21 01:30:49.361745 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.361688 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd2cc8248ab9e2fd7ef3c3b2ac449e298c9ff6875102c476463bd1176d630cd"} err="failed to get container status \"0fd2cc8248ab9e2fd7ef3c3b2ac449e298c9ff6875102c476463bd1176d630cd\": rpc error: code = NotFound desc = could not find container \"0fd2cc8248ab9e2fd7ef3c3b2ac449e298c9ff6875102c476463bd1176d630cd\": container with ID starting with 0fd2cc8248ab9e2fd7ef3c3b2ac449e298c9ff6875102c476463bd1176d630cd not found: ID does not exist" Jul 21 01:30:49.372179 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.372146 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f9bf4b8df-crfv9"] Jul 21 01:30:49.382939 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.382917 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f9bf4b8df-crfv9"] Jul 21 01:30:49.730557 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.730521 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m5nl9"] Jul 21 01:30:49.731133 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.731114 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="420eca03-9a40-4890-8ba9-6d462df430a4" containerName="console" Jul 21 01:30:49.731200 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.731136 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="420eca03-9a40-4890-8ba9-6d462df430a4" containerName="console" Jul 21 01:30:49.731260 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.731223 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="420eca03-9a40-4890-8ba9-6d462df430a4" containerName="console" Jul 21 01:30:49.736104 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.736084 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m5nl9" Jul 21 01:30:49.739004 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.738984 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xwhbf\"" Jul 21 01:30:49.744129 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.744073 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m5nl9"] Jul 21 01:30:49.809125 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.809082 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjzbh\" (UniqueName: \"kubernetes.io/projected/104697a2-70c6-44eb-9413-3c502c68c87c-kube-api-access-cjzbh\") pod \"authorino-operator-75cc8d5cb7-m5nl9\" (UID: \"104697a2-70c6-44eb-9413-3c502c68c87c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m5nl9" Jul 21 01:30:49.909876 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.909793 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjzbh\" (UniqueName: \"kubernetes.io/projected/104697a2-70c6-44eb-9413-3c502c68c87c-kube-api-access-cjzbh\") pod \"authorino-operator-75cc8d5cb7-m5nl9\" (UID: \"104697a2-70c6-44eb-9413-3c502c68c87c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m5nl9" Jul 21 01:30:49.918032 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:49.917998 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjzbh\" (UniqueName: \"kubernetes.io/projected/104697a2-70c6-44eb-9413-3c502c68c87c-kube-api-access-cjzbh\") pod \"authorino-operator-75cc8d5cb7-m5nl9\" (UID: \"104697a2-70c6-44eb-9413-3c502c68c87c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m5nl9" Jul 21 01:30:50.048490 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:50.048398 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m5nl9" Jul 21 01:30:50.182372 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:50.182345 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m5nl9"] Jul 21 01:30:50.184561 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:30:50.184528 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod104697a2_70c6_44eb_9413_3c502c68c87c.slice/crio-d7be78f56cb89737120dd4f3d4addfcb7632a05132e07b85117c0bd8c8df6cda WatchSource:0}: Error finding container d7be78f56cb89737120dd4f3d4addfcb7632a05132e07b85117c0bd8c8df6cda: Status 404 returned error can't find the container with id d7be78f56cb89737120dd4f3d4addfcb7632a05132e07b85117c0bd8c8df6cda Jul 21 01:30:50.358060 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:50.357973 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m5nl9" event={"ID":"104697a2-70c6-44eb-9413-3c502c68c87c","Type":"ContainerStarted","Data":"d7be78f56cb89737120dd4f3d4addfcb7632a05132e07b85117c0bd8c8df6cda"} Jul 21 01:30:50.838232 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:50.838194 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="420eca03-9a40-4890-8ba9-6d462df430a4" path="/var/lib/kubelet/pods/420eca03-9a40-4890-8ba9-6d462df430a4/volumes" Jul 21 01:30:51.299690 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:51.299653 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:30:54.385681 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:54.385642 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" event={"ID":"ac7c9720-dd32-4a88-a216-8418eb93e8ea","Type":"ContainerStarted","Data":"e4f9a100aac84334c14e33e246dbc2cbcecf0ff899f64c657f5228c28b88dbd6"} Jul 21 01:30:54.386174 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:54.385793 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:30:54.387105 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:54.387087 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m5nl9" event={"ID":"104697a2-70c6-44eb-9413-3c502c68c87c","Type":"ContainerStarted","Data":"d9e102a93339761a4638379bb677f98f121412726df7903d87eb62713dc8a7f5"} Jul 21 01:30:54.387211 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:54.387199 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m5nl9" Jul 21 01:30:54.408433 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:54.408381 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" podStartSLOduration=2.274877446 podStartE2EDuration="9.408367776s" totalImagesPullingTime="7.13349033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:30:54.405739047 +0000 UTC m=+534.092387618" watchObservedRunningTime="2026-07-21 01:30:54.408367776 +0000 UTC m=+534.095016331" Jul 21 01:30:54.423724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:54.423679 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m5nl9" podStartSLOduration=2.016490498 podStartE2EDuration="5.423665396s" totalImagesPullingTime="3.407174898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:30:54.423533678 +0000 UTC m=+534.110182234" watchObservedRunningTime="2026-07-21 01:30:54.423665396 +0000 UTC m=+534.110313951" Jul 21 01:30:55.327450 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:30:55.327418 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qmpr4" Jul 21 01:31:05.396505 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:05.396468 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m5nl9" Jul 21 01:31:05.396921 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:05.396545 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:31:06.846423 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:06.846387 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln"] Jul 21 01:31:06.851715 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:06.851696 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:06.865779 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:06.865751 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln"] Jul 21 01:31:06.965761 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:06.965723 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c618bfeb-0b7a-45ca-94ba-61c371c04947-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-t85ln\" (UID: \"c618bfeb-0b7a-45ca-94ba-61c371c04947\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:06.965961 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:06.965769 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68lfm\" (UniqueName: \"kubernetes.io/projected/c618bfeb-0b7a-45ca-94ba-61c371c04947-kube-api-access-68lfm\") pod \"kuadrant-operator-controller-manager-55467d9f7-t85ln\" (UID: \"c618bfeb-0b7a-45ca-94ba-61c371c04947\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:07.066402 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.066369 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c618bfeb-0b7a-45ca-94ba-61c371c04947-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-t85ln\" (UID: \"c618bfeb-0b7a-45ca-94ba-61c371c04947\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:07.066558 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.066409 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68lfm\" (UniqueName: \"kubernetes.io/projected/c618bfeb-0b7a-45ca-94ba-61c371c04947-kube-api-access-68lfm\") pod \"kuadrant-operator-controller-manager-55467d9f7-t85ln\" (UID: \"c618bfeb-0b7a-45ca-94ba-61c371c04947\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:07.066819 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.066782 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c618bfeb-0b7a-45ca-94ba-61c371c04947-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-t85ln\" (UID: \"c618bfeb-0b7a-45ca-94ba-61c371c04947\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:07.081346 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.081323 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68lfm\" (UniqueName: \"kubernetes.io/projected/c618bfeb-0b7a-45ca-94ba-61c371c04947-kube-api-access-68lfm\") pod \"kuadrant-operator-controller-manager-55467d9f7-t85ln\" (UID: \"c618bfeb-0b7a-45ca-94ba-61c371c04947\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:07.162688 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.162599 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:07.291763 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.291734 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln"] Jul 21 01:31:07.298059 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.298036 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln"] Jul 21 01:31:07.311489 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.311466 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9"] Jul 21 01:31:07.311689 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.311662 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" podUID="ac7c9720-dd32-4a88-a216-8418eb93e8ea" containerName="manager" containerID="cri-o://e4f9a100aac84334c14e33e246dbc2cbcecf0ff899f64c657f5228c28b88dbd6" gracePeriod=2 Jul 21 01:31:07.323372 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.323351 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9"] Jul 21 01:31:07.327111 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.327062 2553 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ac7c9720-dd32-4a88-a216-8418eb93e8ea\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-djfl9\": pods \"kuadrant-operator-controller-manager-8684c9ff49-djfl9\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:31:07.330351 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.330327 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd"] Jul 21 01:31:07.330936 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.330789 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac7c9720-dd32-4a88-a216-8418eb93e8ea" containerName="manager" Jul 21 01:31:07.330936 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.330829 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac7c9720-dd32-4a88-a216-8418eb93e8ea" containerName="manager" Jul 21 01:31:07.330936 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.330920 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac7c9720-dd32-4a88-a216-8418eb93e8ea" containerName="manager" Jul 21 01:31:07.335625 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.335597 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" Jul 21 01:31:07.342041 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.342008 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m"] Jul 21 01:31:07.342502 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.342247 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" podUID="c6861f6f-9bad-4eb8-bdd2-2941c863885d" containerName="manager" containerID="cri-o://891d7bf769c87b8f99ad18e9babb8efe4d038de62b1366efa723920003a1afae" gracePeriod=2 Jul 21 01:31:07.345113 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.345081 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm"] Jul 21 01:31:07.349617 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.349594 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" Jul 21 01:31:07.352945 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.352886 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd"] Jul 21 01:31:07.360076 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.359042 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m"] Jul 21 01:31:07.362832 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.362275 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm"] Jul 21 01:31:07.367813 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.367768 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cf2bw"] Jul 21 01:31:07.368172 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.368149 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6861f6f-9bad-4eb8-bdd2-2941c863885d" containerName="manager" Jul 21 01:31:07.368172 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.368172 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6861f6f-9bad-4eb8-bdd2-2941c863885d" containerName="manager" Jul 21 01:31:07.368319 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.368249 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6861f6f-9bad-4eb8-bdd2-2941c863885d" containerName="manager" Jul 21 01:31:07.371176 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.371044 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cf2bw" Jul 21 01:31:07.379465 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.379366 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-djfl9\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="ac7c9720-dd32-4a88-a216-8418eb93e8ea" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:31:07.381706 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.381675 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-djfl9\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="ac7c9720-dd32-4a88-a216-8418eb93e8ea" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:31:07.382572 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.382555 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cf2bw"] Jul 21 01:31:07.384201 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.384103 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-shm7m\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="c6861f6f-9bad-4eb8-bdd2-2941c863885d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:31:07.435087 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.435057 2553 log.go:32] "RunPodSandbox from runtime service failed" err=< Jul 21 01:31:07.435087 ip-10-0-132-244 kubenswrapper[2553]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-t85ln_kuadrant-system_c618bfeb-0b7a-45ca-94ba-61c371c04947_0(0509336d1aeea95e2b4437c8769afcb850c173fcd321a5c4f8b1c0c7ebd57c07): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-t85ln to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0509336d1aeea95e2b4437c8769afcb850c173fcd321a5c4f8b1c0c7ebd57c07" Netns:"/var/run/netns/43fdb9d4-749c-4272-98ba-bea263b5261e" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-t85ln;K8S_POD_INFRA_CONTAINER_ID=0509336d1aeea95e2b4437c8769afcb850c173fcd321a5c4f8b1c0c7ebd57c07;K8S_POD_UID=c618bfeb-0b7a-45ca-94ba-61c371c04947" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln/c618bfeb-0b7a-45ca-94ba-61c371c04947]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-t85ln in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-t85ln in out of cluster comm: status update failed for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln: pods "kuadrant-operator-controller-manager-55467d9f7-t85ln" not found Jul 21 01:31:07.435087 ip-10-0-132-244 kubenswrapper[2553]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 21 01:31:07.435087 ip-10-0-132-244 kubenswrapper[2553]: > Jul 21 01:31:07.435372 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.435112 2553 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jul 21 01:31:07.435372 ip-10-0-132-244 kubenswrapper[2553]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-t85ln_kuadrant-system_c618bfeb-0b7a-45ca-94ba-61c371c04947_0(0509336d1aeea95e2b4437c8769afcb850c173fcd321a5c4f8b1c0c7ebd57c07): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-t85ln to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0509336d1aeea95e2b4437c8769afcb850c173fcd321a5c4f8b1c0c7ebd57c07" Netns:"/var/run/netns/43fdb9d4-749c-4272-98ba-bea263b5261e" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-t85ln;K8S_POD_INFRA_CONTAINER_ID=0509336d1aeea95e2b4437c8769afcb850c173fcd321a5c4f8b1c0c7ebd57c07;K8S_POD_UID=c618bfeb-0b7a-45ca-94ba-61c371c04947" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln/c618bfeb-0b7a-45ca-94ba-61c371c04947]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-t85ln in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-t85ln in out of cluster comm: status update failed for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln: pods "kuadrant-operator-controller-manager-55467d9f7-t85ln" not found Jul 21 01:31:07.435372 ip-10-0-132-244 kubenswrapper[2553]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 21 01:31:07.435372 ip-10-0-132-244 kubenswrapper[2553]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:07.461975 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.461673 2553 generic.go:356] "Generic (PLEG): container finished" podID="c6861f6f-9bad-4eb8-bdd2-2941c863885d" containerID="891d7bf769c87b8f99ad18e9babb8efe4d038de62b1366efa723920003a1afae" exitCode=0 Jul 21 01:31:07.464054 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.464032 2553 generic.go:356] "Generic (PLEG): container finished" podID="ac7c9720-dd32-4a88-a216-8418eb93e8ea" containerID="e4f9a100aac84334c14e33e246dbc2cbcecf0ff899f64c657f5228c28b88dbd6" exitCode=0 Jul 21 01:31:07.464177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.464124 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:07.467181 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.467151 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-shm7m\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="c6861f6f-9bad-4eb8-bdd2-2941c863885d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:31:07.469410 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.469387 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-djfl9\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="ac7c9720-dd32-4a88-a216-8418eb93e8ea" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:31:07.470732 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.470711 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-5mpcd\" (UID: \"8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" Jul 21 01:31:07.470838 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.470759 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8qm2\" (UniqueName: \"kubernetes.io/projected/9a9bf05a-7d1b-498d-bb4e-1db37425c5e1-kube-api-access-d8qm2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jd5nm\" (UID: \"9a9bf05a-7d1b-498d-bb4e-1db37425c5e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" Jul 21 01:31:07.470934 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.470909 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxzzg\" (UniqueName: \"kubernetes.io/projected/8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8-kube-api-access-lxzzg\") pod \"kuadrant-operator-controller-manager-55467d9f7-5mpcd\" (UID: \"8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" Jul 21 01:31:07.470984 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.470969 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr2ck\" (UniqueName: \"kubernetes.io/projected/5d403120-e90e-44b3-8cc6-e0b0ec14743a-kube-api-access-lr2ck\") pod \"limitador-operator-controller-manager-859d7b78bd-cf2bw\" (UID: \"5d403120-e90e-44b3-8cc6-e0b0ec14743a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cf2bw" Jul 21 01:31:07.471034 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.471003 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a9bf05a-7d1b-498d-bb4e-1db37425c5e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jd5nm\" (UID: \"9a9bf05a-7d1b-498d-bb4e-1db37425c5e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" Jul 21 01:31:07.471606 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.471583 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-t85ln\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="c618bfeb-0b7a-45ca-94ba-61c371c04947" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:07.473954 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.473935 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:07.476267 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.476246 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-djfl9\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="ac7c9720-dd32-4a88-a216-8418eb93e8ea" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:31:07.478561 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.478539 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-t85ln\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="c618bfeb-0b7a-45ca-94ba-61c371c04947" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:07.480753 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.480730 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-shm7m\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="c6861f6f-9bad-4eb8-bdd2-2941c863885d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:31:07.573903 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.571350 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68lfm\" (UniqueName: \"kubernetes.io/projected/c618bfeb-0b7a-45ca-94ba-61c371c04947-kube-api-access-68lfm\") pod \"c618bfeb-0b7a-45ca-94ba-61c371c04947\" (UID: \"c618bfeb-0b7a-45ca-94ba-61c371c04947\") " Jul 21 01:31:07.573903 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.571442 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c618bfeb-0b7a-45ca-94ba-61c371c04947-extensions-socket-volume\") pod \"c618bfeb-0b7a-45ca-94ba-61c371c04947\" (UID: \"c618bfeb-0b7a-45ca-94ba-61c371c04947\") " Jul 21 01:31:07.573903 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.571661 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-5mpcd\" (UID: \"8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" Jul 21 01:31:07.573903 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.571704 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8qm2\" (UniqueName: \"kubernetes.io/projected/9a9bf05a-7d1b-498d-bb4e-1db37425c5e1-kube-api-access-d8qm2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jd5nm\" (UID: \"9a9bf05a-7d1b-498d-bb4e-1db37425c5e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" Jul 21 01:31:07.573903 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.571783 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxzzg\" (UniqueName: \"kubernetes.io/projected/8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8-kube-api-access-lxzzg\") pod \"kuadrant-operator-controller-manager-55467d9f7-5mpcd\" (UID: \"8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" Jul 21 01:31:07.573903 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.571865 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr2ck\" (UniqueName: \"kubernetes.io/projected/5d403120-e90e-44b3-8cc6-e0b0ec14743a-kube-api-access-lr2ck\") pod \"limitador-operator-controller-manager-859d7b78bd-cf2bw\" (UID: \"5d403120-e90e-44b3-8cc6-e0b0ec14743a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cf2bw" Jul 21 01:31:07.573903 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.571903 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a9bf05a-7d1b-498d-bb4e-1db37425c5e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jd5nm\" (UID: \"9a9bf05a-7d1b-498d-bb4e-1db37425c5e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" Jul 21 01:31:07.573903 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.572322 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a9bf05a-7d1b-498d-bb4e-1db37425c5e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jd5nm\" (UID: \"9a9bf05a-7d1b-498d-bb4e-1db37425c5e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" Jul 21 01:31:07.573903 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.573850 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-5mpcd\" (UID: \"8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" Jul 21 01:31:07.574559 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.574522 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c618bfeb-0b7a-45ca-94ba-61c371c04947-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c618bfeb-0b7a-45ca-94ba-61c371c04947" (UID: "c618bfeb-0b7a-45ca-94ba-61c371c04947"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:31:07.577415 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.577380 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c618bfeb-0b7a-45ca-94ba-61c371c04947-kube-api-access-68lfm" (OuterVolumeSpecName: "kube-api-access-68lfm") pod "c618bfeb-0b7a-45ca-94ba-61c371c04947" (UID: "c618bfeb-0b7a-45ca-94ba-61c371c04947"). InnerVolumeSpecName "kube-api-access-68lfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:31:07.587487 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.587438 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxzzg\" (UniqueName: \"kubernetes.io/projected/8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8-kube-api-access-lxzzg\") pod \"kuadrant-operator-controller-manager-55467d9f7-5mpcd\" (UID: \"8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" Jul 21 01:31:07.589417 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.589372 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr2ck\" (UniqueName: \"kubernetes.io/projected/5d403120-e90e-44b3-8cc6-e0b0ec14743a-kube-api-access-lr2ck\") pod \"limitador-operator-controller-manager-859d7b78bd-cf2bw\" (UID: \"5d403120-e90e-44b3-8cc6-e0b0ec14743a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cf2bw" Jul 21 01:31:07.590077 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.590054 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8qm2\" (UniqueName: \"kubernetes.io/projected/9a9bf05a-7d1b-498d-bb4e-1db37425c5e1-kube-api-access-d8qm2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jd5nm\" (UID: \"9a9bf05a-7d1b-498d-bb4e-1db37425c5e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" Jul 21 01:31:07.601577 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.601555 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:31:07.603486 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.603471 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:31:07.604249 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.604220 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-shm7m\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="c6861f6f-9bad-4eb8-bdd2-2941c863885d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:31:07.606499 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.606479 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-djfl9\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="ac7c9720-dd32-4a88-a216-8418eb93e8ea" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:31:07.608637 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.608620 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-t85ln\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="c618bfeb-0b7a-45ca-94ba-61c371c04947" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:07.610610 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.610592 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-djfl9\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="ac7c9720-dd32-4a88-a216-8418eb93e8ea" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:31:07.612504 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.612486 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-t85ln\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="c618bfeb-0b7a-45ca-94ba-61c371c04947" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:07.614384 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:07.614364 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-shm7m\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="c6861f6f-9bad-4eb8-bdd2-2941c863885d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:31:07.672495 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.672474 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69mt7\" (UniqueName: \"kubernetes.io/projected/c6861f6f-9bad-4eb8-bdd2-2941c863885d-kube-api-access-69mt7\") pod \"c6861f6f-9bad-4eb8-bdd2-2941c863885d\" (UID: \"c6861f6f-9bad-4eb8-bdd2-2941c863885d\") " Jul 21 01:31:07.672583 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.672501 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac7c9720-dd32-4a88-a216-8418eb93e8ea-extensions-socket-volume\") pod \"ac7c9720-dd32-4a88-a216-8418eb93e8ea\" (UID: \"ac7c9720-dd32-4a88-a216-8418eb93e8ea\") " Jul 21 01:31:07.672583 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.672571 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n87wb\" (UniqueName: \"kubernetes.io/projected/ac7c9720-dd32-4a88-a216-8418eb93e8ea-kube-api-access-n87wb\") pod \"ac7c9720-dd32-4a88-a216-8418eb93e8ea\" (UID: \"ac7c9720-dd32-4a88-a216-8418eb93e8ea\") " Jul 21 01:31:07.672780 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.672766 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c618bfeb-0b7a-45ca-94ba-61c371c04947-extensions-socket-volume\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:31:07.672845 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.672789 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68lfm\" (UniqueName: \"kubernetes.io/projected/c618bfeb-0b7a-45ca-94ba-61c371c04947-kube-api-access-68lfm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:31:07.672939 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.672920 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac7c9720-dd32-4a88-a216-8418eb93e8ea-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ac7c9720-dd32-4a88-a216-8418eb93e8ea" (UID: "ac7c9720-dd32-4a88-a216-8418eb93e8ea"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:31:07.674646 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.674628 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6861f6f-9bad-4eb8-bdd2-2941c863885d-kube-api-access-69mt7" (OuterVolumeSpecName: "kube-api-access-69mt7") pod "c6861f6f-9bad-4eb8-bdd2-2941c863885d" (UID: "c6861f6f-9bad-4eb8-bdd2-2941c863885d"). InnerVolumeSpecName "kube-api-access-69mt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:31:07.674692 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.674656 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac7c9720-dd32-4a88-a216-8418eb93e8ea-kube-api-access-n87wb" (OuterVolumeSpecName: "kube-api-access-n87wb") pod "ac7c9720-dd32-4a88-a216-8418eb93e8ea" (UID: "ac7c9720-dd32-4a88-a216-8418eb93e8ea"). InnerVolumeSpecName "kube-api-access-n87wb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:31:07.744130 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.744110 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" Jul 21 01:31:07.750623 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.750604 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" Jul 21 01:31:07.758154 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.758133 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cf2bw" Jul 21 01:31:07.773759 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.773734 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n87wb\" (UniqueName: \"kubernetes.io/projected/ac7c9720-dd32-4a88-a216-8418eb93e8ea-kube-api-access-n87wb\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:31:07.773759 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.773759 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69mt7\" (UniqueName: \"kubernetes.io/projected/c6861f6f-9bad-4eb8-bdd2-2941c863885d-kube-api-access-69mt7\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:31:07.773937 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.773768 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac7c9720-dd32-4a88-a216-8418eb93e8ea-extensions-socket-volume\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:31:07.902489 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:07.902413 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd"] Jul 21 01:31:07.907750 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:31:07.907715 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa535cb_e4e2_4d52_84d9_0ed354a4cbb8.slice/crio-3dc78539470bbc0efc8fa4ab3a6b9fd27df7089a614e6146d502e3700ccc0101 WatchSource:0}: Error finding container 3dc78539470bbc0efc8fa4ab3a6b9fd27df7089a614e6146d502e3700ccc0101: Status 404 returned error can't find the container with id 3dc78539470bbc0efc8fa4ab3a6b9fd27df7089a614e6146d502e3700ccc0101 Jul 21 01:31:08.141316 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.141233 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cf2bw"] Jul 21 01:31:08.142785 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:31:08.142754 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d403120_e90e_44b3_8cc6_e0b0ec14743a.slice/crio-c90be265a56eac031c023b30829545799c12473da3885de89ee3c2674f6fc62a WatchSource:0}: Error finding container c90be265a56eac031c023b30829545799c12473da3885de89ee3c2674f6fc62a: Status 404 returned error can't find the container with id c90be265a56eac031c023b30829545799c12473da3885de89ee3c2674f6fc62a Jul 21 01:31:08.144645 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.144623 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm"] Jul 21 01:31:08.146209 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:31:08.146178 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9bf05a_7d1b_498d_bb4e_1db37425c5e1.slice/crio-2df3d34480fdd29aae2608fc2bf2c8ad733cbdae537c48cd35e79676f1a56df0 WatchSource:0}: Error finding container 2df3d34480fdd29aae2608fc2bf2c8ad733cbdae537c48cd35e79676f1a56df0: Status 404 returned error can't find the container with id 2df3d34480fdd29aae2608fc2bf2c8ad733cbdae537c48cd35e79676f1a56df0 Jul 21 01:31:08.471907 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.471793 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" event={"ID":"9a9bf05a-7d1b-498d-bb4e-1db37425c5e1","Type":"ContainerStarted","Data":"2bdf26b0ddc6aea16324f39fd07965b75bd4523a62753ed5c327ccacf261588a"} Jul 21 01:31:08.471907 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.471872 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" event={"ID":"9a9bf05a-7d1b-498d-bb4e-1db37425c5e1","Type":"ContainerStarted","Data":"2df3d34480fdd29aae2608fc2bf2c8ad733cbdae537c48cd35e79676f1a56df0"} Jul 21 01:31:08.472114 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.472009 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" Jul 21 01:31:08.473467 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.473443 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" event={"ID":"8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8","Type":"ContainerStarted","Data":"e197b8a4c8a788250a1d02e12cd77198f0eed8bad2014d79e5443325ef05bfc0"} Jul 21 01:31:08.473605 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.473490 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" event={"ID":"8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8","Type":"ContainerStarted","Data":"3dc78539470bbc0efc8fa4ab3a6b9fd27df7089a614e6146d502e3700ccc0101"} Jul 21 01:31:08.473605 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.473517 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" Jul 21 01:31:08.474726 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:08.474698 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-shm7m\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="c6861f6f-9bad-4eb8-bdd2-2941c863885d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:31:08.474907 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.474893 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:31:08.474965 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.474949 2553 scope.go:117] "RemoveContainer" containerID="e4f9a100aac84334c14e33e246dbc2cbcecf0ff899f64c657f5228c28b88dbd6" Jul 21 01:31:08.480650 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.480617 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cf2bw" event={"ID":"5d403120-e90e-44b3-8cc6-e0b0ec14743a","Type":"ContainerStarted","Data":"168eaf3eed91ab1def1f4225b8012c7fd33c1afccb04be1718f518226defd501"} Jul 21 01:31:08.480753 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.480676 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cf2bw" event={"ID":"5d403120-e90e-44b3-8cc6-e0b0ec14743a","Type":"ContainerStarted","Data":"c90be265a56eac031c023b30829545799c12473da3885de89ee3c2674f6fc62a"} Jul 21 01:31:08.480753 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.480704 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cf2bw" Jul 21 01:31:08.482494 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.482476 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:08.482580 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.482504 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:31:08.486770 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.486754 2553 scope.go:117] "RemoveContainer" containerID="891d7bf769c87b8f99ad18e9babb8efe4d038de62b1366efa723920003a1afae" Jul 21 01:31:08.516626 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:08.516597 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-djfl9\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="ac7c9720-dd32-4a88-a216-8418eb93e8ea" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:31:08.516753 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.516664 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" podStartSLOduration=1.516646953 podStartE2EDuration="1.516646953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:31:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:31:08.514013432 +0000 UTC m=+548.200661984" watchObservedRunningTime="2026-07-21 01:31:08.516646953 +0000 UTC m=+548.203295509" Jul 21 01:31:08.519015 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:08.518991 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-t85ln\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="c618bfeb-0b7a-45ca-94ba-61c371c04947" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:08.561738 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.561679 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" podStartSLOduration=1.561663572 podStartE2EDuration="1.561663572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:31:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:31:08.558549284 +0000 UTC m=+548.245197842" watchObservedRunningTime="2026-07-21 01:31:08.561663572 +0000 UTC m=+548.248312128" Jul 21 01:31:08.593218 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:08.593178 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-djfl9\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="ac7c9720-dd32-4a88-a216-8418eb93e8ea" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-djfl9" Jul 21 01:31:08.593218 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.593185 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cf2bw" podStartSLOduration=1.593172099 podStartE2EDuration="1.593172099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:31:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:31:08.590410469 +0000 UTC m=+548.277059024" watchObservedRunningTime="2026-07-21 01:31:08.593172099 +0000 UTC m=+548.279820654" Jul 21 01:31:08.595387 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:08.595366 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-t85ln\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="c618bfeb-0b7a-45ca-94ba-61c371c04947" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t85ln" Jul 21 01:31:08.597712 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:08.597692 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-shm7m\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="c6861f6f-9bad-4eb8-bdd2-2941c863885d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shm7m" Jul 21 01:31:08.836354 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.836321 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac7c9720-dd32-4a88-a216-8418eb93e8ea" path="/var/lib/kubelet/pods/ac7c9720-dd32-4a88-a216-8418eb93e8ea/volumes" Jul 21 01:31:08.836660 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.836647 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c618bfeb-0b7a-45ca-94ba-61c371c04947" path="/var/lib/kubelet/pods/c618bfeb-0b7a-45ca-94ba-61c371c04947/volumes" Jul 21 01:31:08.836871 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:08.836859 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6861f6f-9bad-4eb8-bdd2-2941c863885d" path="/var/lib/kubelet/pods/c6861f6f-9bad-4eb8-bdd2-2941c863885d/volumes" Jul 21 01:31:19.492306 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.492271 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cf2bw" Jul 21 01:31:19.492885 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.492353 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" Jul 21 01:31:19.492885 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.492847 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" Jul 21 01:31:19.549097 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.549066 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm"] Jul 21 01:31:19.549295 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.549269 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" podUID="9a9bf05a-7d1b-498d-bb4e-1db37425c5e1" containerName="manager" containerID="cri-o://2bdf26b0ddc6aea16324f39fd07965b75bd4523a62753ed5c327ccacf261588a" gracePeriod=10 Jul 21 01:31:19.812610 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.812582 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" Jul 21 01:31:19.819463 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.819436 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z"] Jul 21 01:31:19.819949 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.819928 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9bf05a-7d1b-498d-bb4e-1db37425c5e1" containerName="manager" Jul 21 01:31:19.819949 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.819947 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9bf05a-7d1b-498d-bb4e-1db37425c5e1" containerName="manager" Jul 21 01:31:19.820146 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.820032 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a9bf05a-7d1b-498d-bb4e-1db37425c5e1" containerName="manager" Jul 21 01:31:19.823152 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.823132 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" Jul 21 01:31:19.838645 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.838595 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z"] Jul 21 01:31:19.888020 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.887991 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8qm2\" (UniqueName: \"kubernetes.io/projected/9a9bf05a-7d1b-498d-bb4e-1db37425c5e1-kube-api-access-d8qm2\") pod \"9a9bf05a-7d1b-498d-bb4e-1db37425c5e1\" (UID: \"9a9bf05a-7d1b-498d-bb4e-1db37425c5e1\") " Jul 21 01:31:19.888182 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.888063 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a9bf05a-7d1b-498d-bb4e-1db37425c5e1-extensions-socket-volume\") pod \"9a9bf05a-7d1b-498d-bb4e-1db37425c5e1\" (UID: \"9a9bf05a-7d1b-498d-bb4e-1db37425c5e1\") " Jul 21 01:31:19.888424 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.888403 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9bf05a-7d1b-498d-bb4e-1db37425c5e1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9a9bf05a-7d1b-498d-bb4e-1db37425c5e1" (UID: "9a9bf05a-7d1b-498d-bb4e-1db37425c5e1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:31:19.890165 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.890142 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a9bf05a-7d1b-498d-bb4e-1db37425c5e1-kube-api-access-d8qm2" (OuterVolumeSpecName: "kube-api-access-d8qm2") pod "9a9bf05a-7d1b-498d-bb4e-1db37425c5e1" (UID: "9a9bf05a-7d1b-498d-bb4e-1db37425c5e1"). InnerVolumeSpecName "kube-api-access-d8qm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:31:19.989343 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.989299 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs66z\" (UniqueName: \"kubernetes.io/projected/95a353db-0a0f-4bc8-8775-27bad0db5a66-kube-api-access-rs66z\") pod \"kuadrant-operator-controller-manager-86878c769f-n9r6z\" (UID: \"95a353db-0a0f-4bc8-8775-27bad0db5a66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" Jul 21 01:31:19.989549 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.989408 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95a353db-0a0f-4bc8-8775-27bad0db5a66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n9r6z\" (UID: \"95a353db-0a0f-4bc8-8775-27bad0db5a66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" Jul 21 01:31:19.989631 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.989547 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8qm2\" (UniqueName: \"kubernetes.io/projected/9a9bf05a-7d1b-498d-bb4e-1db37425c5e1-kube-api-access-d8qm2\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:31:19.989631 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:19.989565 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a9bf05a-7d1b-498d-bb4e-1db37425c5e1-extensions-socket-volume\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:31:20.090915 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.090813 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs66z\" (UniqueName: \"kubernetes.io/projected/95a353db-0a0f-4bc8-8775-27bad0db5a66-kube-api-access-rs66z\") pod \"kuadrant-operator-controller-manager-86878c769f-n9r6z\" (UID: \"95a353db-0a0f-4bc8-8775-27bad0db5a66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" Jul 21 01:31:20.090915 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.090871 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95a353db-0a0f-4bc8-8775-27bad0db5a66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n9r6z\" (UID: \"95a353db-0a0f-4bc8-8775-27bad0db5a66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" Jul 21 01:31:20.091242 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.091222 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95a353db-0a0f-4bc8-8775-27bad0db5a66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n9r6z\" (UID: \"95a353db-0a0f-4bc8-8775-27bad0db5a66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" Jul 21 01:31:20.100612 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.100576 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs66z\" (UniqueName: \"kubernetes.io/projected/95a353db-0a0f-4bc8-8775-27bad0db5a66-kube-api-access-rs66z\") pod \"kuadrant-operator-controller-manager-86878c769f-n9r6z\" (UID: \"95a353db-0a0f-4bc8-8775-27bad0db5a66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" Jul 21 01:31:20.133372 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.133341 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" Jul 21 01:31:20.274139 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.274116 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z"] Jul 21 01:31:20.277167 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:31:20.277132 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a353db_0a0f_4bc8_8775_27bad0db5a66.slice/crio-cf58e377272df5587b85cce53076118b0f5a6cad70f3d774c0219fcbf619a433 WatchSource:0}: Error finding container cf58e377272df5587b85cce53076118b0f5a6cad70f3d774c0219fcbf619a433: Status 404 returned error can't find the container with id cf58e377272df5587b85cce53076118b0f5a6cad70f3d774c0219fcbf619a433 Jul 21 01:31:20.554014 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.553981 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" event={"ID":"95a353db-0a0f-4bc8-8775-27bad0db5a66","Type":"ContainerStarted","Data":"0d8c8bfee149c5666c90d38652716b4b45fdf7fc3c67e3b89419cadeb849009f"} Jul 21 01:31:20.554535 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.554036 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" event={"ID":"95a353db-0a0f-4bc8-8775-27bad0db5a66","Type":"ContainerStarted","Data":"cf58e377272df5587b85cce53076118b0f5a6cad70f3d774c0219fcbf619a433"} Jul 21 01:31:20.554535 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.554181 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" Jul 21 01:31:20.555538 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.555511 2553 generic.go:356] "Generic (PLEG): container finished" podID="9a9bf05a-7d1b-498d-bb4e-1db37425c5e1" containerID="2bdf26b0ddc6aea16324f39fd07965b75bd4523a62753ed5c327ccacf261588a" exitCode=0 Jul 21 01:31:20.555670 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.555545 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" Jul 21 01:31:20.555670 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.555547 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" event={"ID":"9a9bf05a-7d1b-498d-bb4e-1db37425c5e1","Type":"ContainerDied","Data":"2bdf26b0ddc6aea16324f39fd07965b75bd4523a62753ed5c327ccacf261588a"} Jul 21 01:31:20.555773 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.555670 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm" event={"ID":"9a9bf05a-7d1b-498d-bb4e-1db37425c5e1","Type":"ContainerDied","Data":"2df3d34480fdd29aae2608fc2bf2c8ad733cbdae537c48cd35e79676f1a56df0"} Jul 21 01:31:20.555773 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.555694 2553 scope.go:117] "RemoveContainer" containerID="2bdf26b0ddc6aea16324f39fd07965b75bd4523a62753ed5c327ccacf261588a" Jul 21 01:31:20.565117 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.565097 2553 scope.go:117] "RemoveContainer" containerID="2bdf26b0ddc6aea16324f39fd07965b75bd4523a62753ed5c327ccacf261588a" Jul 21 01:31:20.565368 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:20.565352 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bdf26b0ddc6aea16324f39fd07965b75bd4523a62753ed5c327ccacf261588a\": container with ID starting with 2bdf26b0ddc6aea16324f39fd07965b75bd4523a62753ed5c327ccacf261588a not found: ID does not exist" containerID="2bdf26b0ddc6aea16324f39fd07965b75bd4523a62753ed5c327ccacf261588a" Jul 21 01:31:20.565407 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.565377 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bdf26b0ddc6aea16324f39fd07965b75bd4523a62753ed5c327ccacf261588a"} err="failed to get container status \"2bdf26b0ddc6aea16324f39fd07965b75bd4523a62753ed5c327ccacf261588a\": rpc error: code = NotFound desc = could not find container \"2bdf26b0ddc6aea16324f39fd07965b75bd4523a62753ed5c327ccacf261588a\": container with ID starting with 2bdf26b0ddc6aea16324f39fd07965b75bd4523a62753ed5c327ccacf261588a not found: ID does not exist" Jul 21 01:31:20.574595 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.574554 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" podStartSLOduration=1.574540968 podStartE2EDuration="1.574540968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:31:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:31:20.573658695 +0000 UTC m=+560.260307251" watchObservedRunningTime="2026-07-21 01:31:20.574540968 +0000 UTC m=+560.261189577" Jul 21 01:31:20.595568 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.595543 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm"] Jul 21 01:31:20.599764 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.599741 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd5nm"] Jul 21 01:31:20.836356 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:20.836277 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a9bf05a-7d1b-498d-bb4e-1db37425c5e1" path="/var/lib/kubelet/pods/9a9bf05a-7d1b-498d-bb4e-1db37425c5e1/volumes" Jul 21 01:31:31.565212 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:31.565175 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" Jul 21 01:31:31.617122 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:31.617085 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd"] Jul 21 01:31:31.617383 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:31.617334 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" podUID="8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8" containerName="manager" containerID="cri-o://e197b8a4c8a788250a1d02e12cd77198f0eed8bad2014d79e5443325ef05bfc0" gracePeriod=10 Jul 21 01:31:31.880681 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:31.880658 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" Jul 21 01:31:31.992949 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:31.992916 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxzzg\" (UniqueName: \"kubernetes.io/projected/8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8-kube-api-access-lxzzg\") pod \"8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8\" (UID: \"8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8\") " Jul 21 01:31:31.993123 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:31.993053 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8-extensions-socket-volume\") pod \"8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8\" (UID: \"8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8\") " Jul 21 01:31:31.993429 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:31.993392 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8" (UID: "8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:31:31.995124 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:31.995104 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8-kube-api-access-lxzzg" (OuterVolumeSpecName: "kube-api-access-lxzzg") pod "8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8" (UID: "8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8"). InnerVolumeSpecName "kube-api-access-lxzzg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:31:32.094404 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:32.094371 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxzzg\" (UniqueName: \"kubernetes.io/projected/8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8-kube-api-access-lxzzg\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:31:32.094404 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:32.094395 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8-extensions-socket-volume\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:31:32.628055 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:32.628022 2553 generic.go:356] "Generic (PLEG): container finished" podID="8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8" containerID="e197b8a4c8a788250a1d02e12cd77198f0eed8bad2014d79e5443325ef05bfc0" exitCode=0 Jul 21 01:31:32.628570 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:32.628069 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" Jul 21 01:31:32.628570 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:32.628109 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" event={"ID":"8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8","Type":"ContainerDied","Data":"e197b8a4c8a788250a1d02e12cd77198f0eed8bad2014d79e5443325ef05bfc0"} Jul 21 01:31:32.628570 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:32.628177 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd" event={"ID":"8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8","Type":"ContainerDied","Data":"3dc78539470bbc0efc8fa4ab3a6b9fd27df7089a614e6146d502e3700ccc0101"} Jul 21 01:31:32.628570 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:32.628212 2553 scope.go:117] "RemoveContainer" containerID="e197b8a4c8a788250a1d02e12cd77198f0eed8bad2014d79e5443325ef05bfc0" Jul 21 01:31:32.638294 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:32.638280 2553 scope.go:117] "RemoveContainer" containerID="e197b8a4c8a788250a1d02e12cd77198f0eed8bad2014d79e5443325ef05bfc0" Jul 21 01:31:32.638539 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:32.638520 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e197b8a4c8a788250a1d02e12cd77198f0eed8bad2014d79e5443325ef05bfc0\": container with ID starting with e197b8a4c8a788250a1d02e12cd77198f0eed8bad2014d79e5443325ef05bfc0 not found: ID does not exist" containerID="e197b8a4c8a788250a1d02e12cd77198f0eed8bad2014d79e5443325ef05bfc0" Jul 21 01:31:32.638583 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:32.638549 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e197b8a4c8a788250a1d02e12cd77198f0eed8bad2014d79e5443325ef05bfc0"} err="failed to get container status \"e197b8a4c8a788250a1d02e12cd77198f0eed8bad2014d79e5443325ef05bfc0\": rpc error: code = NotFound desc = could not find container \"e197b8a4c8a788250a1d02e12cd77198f0eed8bad2014d79e5443325ef05bfc0\": container with ID starting with e197b8a4c8a788250a1d02e12cd77198f0eed8bad2014d79e5443325ef05bfc0 not found: ID does not exist" Jul 21 01:31:32.651682 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:32.651654 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd"] Jul 21 01:31:32.659962 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:32.659938 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5mpcd"] Jul 21 01:31:32.835930 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:32.835902 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8" path="/var/lib/kubelet/pods/8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8/volumes" Jul 21 01:31:35.956040 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:35.956007 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx"] Jul 21 01:31:35.956414 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:35.956388 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8" containerName="manager" Jul 21 01:31:35.956414 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:35.956399 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8" containerName="manager" Jul 21 01:31:35.956497 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:35.956469 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fa535cb-e4e2-4d52-84d9-0ed354a4cbb8" containerName="manager" Jul 21 01:31:35.959282 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:35.959266 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:35.962174 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:35.962154 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-h7rss\"" Jul 21 01:31:35.971183 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:35.971161 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx"] Jul 21 01:31:36.030920 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.030889 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce470538-e0e7-402b-bf10-5f77b137c4ef-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.031067 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.030932 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce470538-e0e7-402b-bf10-5f77b137c4ef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.031067 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.030985 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce470538-e0e7-402b-bf10-5f77b137c4ef-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.031067 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.031007 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce470538-e0e7-402b-bf10-5f77b137c4ef-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.031067 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.031049 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce470538-e0e7-402b-bf10-5f77b137c4ef-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.031204 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.031086 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbrrp\" (UniqueName: \"kubernetes.io/projected/ce470538-e0e7-402b-bf10-5f77b137c4ef-kube-api-access-fbrrp\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.031204 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.031135 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce470538-e0e7-402b-bf10-5f77b137c4ef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.031204 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.031172 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce470538-e0e7-402b-bf10-5f77b137c4ef-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.031204 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.031190 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce470538-e0e7-402b-bf10-5f77b137c4ef-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.131867 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.131825 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce470538-e0e7-402b-bf10-5f77b137c4ef-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.131867 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.131872 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce470538-e0e7-402b-bf10-5f77b137c4ef-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.132132 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.131899 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce470538-e0e7-402b-bf10-5f77b137c4ef-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.132132 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.131921 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbrrp\" (UniqueName: \"kubernetes.io/projected/ce470538-e0e7-402b-bf10-5f77b137c4ef-kube-api-access-fbrrp\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.132132 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.131952 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce470538-e0e7-402b-bf10-5f77b137c4ef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.132132 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.132087 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce470538-e0e7-402b-bf10-5f77b137c4ef-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.132392 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.132139 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce470538-e0e7-402b-bf10-5f77b137c4ef-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.132392 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.132220 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce470538-e0e7-402b-bf10-5f77b137c4ef-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.132392 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.132225 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce470538-e0e7-402b-bf10-5f77b137c4ef-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.132392 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.132311 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce470538-e0e7-402b-bf10-5f77b137c4ef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.132598 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.132451 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce470538-e0e7-402b-bf10-5f77b137c4ef-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.132598 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.132490 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce470538-e0e7-402b-bf10-5f77b137c4ef-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.132598 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.132530 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce470538-e0e7-402b-bf10-5f77b137c4ef-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.132984 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.132963 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce470538-e0e7-402b-bf10-5f77b137c4ef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.134297 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.134274 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce470538-e0e7-402b-bf10-5f77b137c4ef-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.134504 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.134489 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce470538-e0e7-402b-bf10-5f77b137c4ef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.140531 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.140501 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce470538-e0e7-402b-bf10-5f77b137c4ef-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.140606 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.140568 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbrrp\" (UniqueName: \"kubernetes.io/projected/ce470538-e0e7-402b-bf10-5f77b137c4ef-kube-api-access-fbrrp\") pod \"maas-default-gateway-openshift-default-5896d4dd49-lxqcx\" (UID: \"ce470538-e0e7-402b-bf10-5f77b137c4ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.270026 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.269992 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:36.410750 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.410724 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx"] Jul 21 01:31:36.412612 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:31:36.412584 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce470538_e0e7_402b_bf10_5f77b137c4ef.slice/crio-6c17711ee4a3c4620282b82587ea3f7c4dbb453f342ff048d41552c324621224 WatchSource:0}: Error finding container 6c17711ee4a3c4620282b82587ea3f7c4dbb453f342ff048d41552c324621224: Status 404 returned error can't find the container with id 6c17711ee4a3c4620282b82587ea3f7c4dbb453f342ff048d41552c324621224 Jul 21 01:31:36.415231 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.415199 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:31:36.415341 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.415265 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:31:36.415341 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.415296 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:31:36.654625 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.654528 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" event={"ID":"ce470538-e0e7-402b-bf10-5f77b137c4ef","Type":"ContainerStarted","Data":"2864926a45c128a2097dec4e822417fabaa98031ad29458f92b17d51dc3eccbc"} Jul 21 01:31:36.654625 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.654590 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" event={"ID":"ce470538-e0e7-402b-bf10-5f77b137c4ef","Type":"ContainerStarted","Data":"6c17711ee4a3c4620282b82587ea3f7c4dbb453f342ff048d41552c324621224"} Jul 21 01:31:36.677436 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:36.677386 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" podStartSLOduration=1.677369278 podStartE2EDuration="1.677369278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:31:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:31:36.675416128 +0000 UTC m=+576.362064684" watchObservedRunningTime="2026-07-21 01:31:36.677369278 +0000 UTC m=+576.364017832" Jul 21 01:31:37.270753 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:37.270717 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:37.272467 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:37.272438 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-lxqcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 01:31:37.272590 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:37.272490 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" podUID="ce470538-e0e7-402b-bf10-5f77b137c4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 01:31:38.274456 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:38.274424 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:38.665926 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:38.665848 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:38.666868 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:38.666851 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:31:52.082459 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:52.082423 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-krwmr"] Jul 21 01:31:52.085480 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:52.085461 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-krwmr" Jul 21 01:31:52.088542 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:52.088515 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-87zpl\"" Jul 21 01:31:52.093960 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:52.093933 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-krwmr"] Jul 21 01:31:52.169496 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:52.169459 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjn5v\" (UniqueName: \"kubernetes.io/projected/94df4141-3ddd-4a32-ac4a-66d02834c297-kube-api-access-vjn5v\") pod \"authorino-58cd955675-krwmr\" (UID: \"94df4141-3ddd-4a32-ac4a-66d02834c297\") " pod="kuadrant-system/authorino-58cd955675-krwmr" Jul 21 01:31:52.270246 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:52.270213 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjn5v\" (UniqueName: \"kubernetes.io/projected/94df4141-3ddd-4a32-ac4a-66d02834c297-kube-api-access-vjn5v\") pod \"authorino-58cd955675-krwmr\" (UID: \"94df4141-3ddd-4a32-ac4a-66d02834c297\") " pod="kuadrant-system/authorino-58cd955675-krwmr" Jul 21 01:31:52.278519 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:52.278487 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjn5v\" (UniqueName: \"kubernetes.io/projected/94df4141-3ddd-4a32-ac4a-66d02834c297-kube-api-access-vjn5v\") pod \"authorino-58cd955675-krwmr\" (UID: \"94df4141-3ddd-4a32-ac4a-66d02834c297\") " pod="kuadrant-system/authorino-58cd955675-krwmr" Jul 21 01:31:52.397424 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:52.397331 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-krwmr" Jul 21 01:31:52.534447 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:52.534419 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-krwmr"] Jul 21 01:31:52.540961 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:31:52.540932 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94df4141_3ddd_4a32_ac4a_66d02834c297.slice/crio-56d81ba20f483c81194321e4dbc69f4c4e8eb6cf7bf73ffd9a44ffc0311bb19e WatchSource:0}: Error finding container 56d81ba20f483c81194321e4dbc69f4c4e8eb6cf7bf73ffd9a44ffc0311bb19e: Status 404 returned error can't find the container with id 56d81ba20f483c81194321e4dbc69f4c4e8eb6cf7bf73ffd9a44ffc0311bb19e Jul 21 01:31:52.752086 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:52.752046 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-krwmr" event={"ID":"94df4141-3ddd-4a32-ac4a-66d02834c297","Type":"ContainerStarted","Data":"56d81ba20f483c81194321e4dbc69f4c4e8eb6cf7bf73ffd9a44ffc0311bb19e"} Jul 21 01:31:56.783347 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:56.783307 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-krwmr" event={"ID":"94df4141-3ddd-4a32-ac4a-66d02834c297","Type":"ContainerStarted","Data":"725ae9664c6e0a6f3ef6be9d07ad275a13322427293bfe84a54d26c2258f29b1"} Jul 21 01:31:56.798754 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:56.798701 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-krwmr" podStartSLOduration=1.462154862 podStartE2EDuration="4.798686686s" totalImagesPullingTime="3.336531824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:31:56.798099974 +0000 UTC m=+596.484748529" watchObservedRunningTime="2026-07-21 01:31:56.798686686 +0000 UTC m=+596.485335240" Jul 21 01:31:57.149613 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:57.149529 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-krwmr"] Jul 21 01:31:58.794057 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:58.794005 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-krwmr" podUID="94df4141-3ddd-4a32-ac4a-66d02834c297" containerName="authorino" containerID="cri-o://725ae9664c6e0a6f3ef6be9d07ad275a13322427293bfe84a54d26c2258f29b1" gracePeriod=30 Jul 21 01:31:59.059947 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:59.059918 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-krwmr" Jul 21 01:31:59.129421 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:59.129379 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjn5v\" (UniqueName: \"kubernetes.io/projected/94df4141-3ddd-4a32-ac4a-66d02834c297-kube-api-access-vjn5v\") pod \"94df4141-3ddd-4a32-ac4a-66d02834c297\" (UID: \"94df4141-3ddd-4a32-ac4a-66d02834c297\") " Jul 21 01:31:59.131692 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:59.131664 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94df4141-3ddd-4a32-ac4a-66d02834c297-kube-api-access-vjn5v" (OuterVolumeSpecName: "kube-api-access-vjn5v") pod "94df4141-3ddd-4a32-ac4a-66d02834c297" (UID: "94df4141-3ddd-4a32-ac4a-66d02834c297"). InnerVolumeSpecName "kube-api-access-vjn5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:31:59.230152 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:59.230117 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjn5v\" (UniqueName: \"kubernetes.io/projected/94df4141-3ddd-4a32-ac4a-66d02834c297-kube-api-access-vjn5v\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:31:59.800630 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:59.800595 2553 generic.go:356] "Generic (PLEG): container finished" podID="94df4141-3ddd-4a32-ac4a-66d02834c297" containerID="725ae9664c6e0a6f3ef6be9d07ad275a13322427293bfe84a54d26c2258f29b1" exitCode=0 Jul 21 01:31:59.801139 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:59.800642 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-krwmr" Jul 21 01:31:59.801139 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:59.800680 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-krwmr" event={"ID":"94df4141-3ddd-4a32-ac4a-66d02834c297","Type":"ContainerDied","Data":"725ae9664c6e0a6f3ef6be9d07ad275a13322427293bfe84a54d26c2258f29b1"} Jul 21 01:31:59.801139 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:59.800722 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-krwmr" event={"ID":"94df4141-3ddd-4a32-ac4a-66d02834c297","Type":"ContainerDied","Data":"56d81ba20f483c81194321e4dbc69f4c4e8eb6cf7bf73ffd9a44ffc0311bb19e"} Jul 21 01:31:59.801139 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:59.800739 2553 scope.go:117] "RemoveContainer" containerID="725ae9664c6e0a6f3ef6be9d07ad275a13322427293bfe84a54d26c2258f29b1" Jul 21 01:31:59.810610 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:59.810592 2553 scope.go:117] "RemoveContainer" containerID="725ae9664c6e0a6f3ef6be9d07ad275a13322427293bfe84a54d26c2258f29b1" Jul 21 01:31:59.810887 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:31:59.810869 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"725ae9664c6e0a6f3ef6be9d07ad275a13322427293bfe84a54d26c2258f29b1\": container with ID starting with 725ae9664c6e0a6f3ef6be9d07ad275a13322427293bfe84a54d26c2258f29b1 not found: ID does not exist" containerID="725ae9664c6e0a6f3ef6be9d07ad275a13322427293bfe84a54d26c2258f29b1" Jul 21 01:31:59.810973 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:59.810897 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725ae9664c6e0a6f3ef6be9d07ad275a13322427293bfe84a54d26c2258f29b1"} err="failed to get container status \"725ae9664c6e0a6f3ef6be9d07ad275a13322427293bfe84a54d26c2258f29b1\": rpc error: code = NotFound desc = could not find container \"725ae9664c6e0a6f3ef6be9d07ad275a13322427293bfe84a54d26c2258f29b1\": container with ID starting with 725ae9664c6e0a6f3ef6be9d07ad275a13322427293bfe84a54d26c2258f29b1 not found: ID does not exist" Jul 21 01:31:59.821584 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:59.821562 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-krwmr"] Jul 21 01:31:59.830623 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:31:59.826649 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-krwmr"] Jul 21 01:32:00.745634 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:00.745602 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:32:00.750458 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:00.750440 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:32:00.752702 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:00.752681 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:32:00.757444 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:00.757425 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:32:00.835058 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:00.835025 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94df4141-3ddd-4a32-ac4a-66d02834c297" path="/var/lib/kubelet/pods/94df4141-3ddd-4a32-ac4a-66d02834c297/volumes" Jul 21 01:32:22.504973 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.504886 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wd8jk"] Jul 21 01:32:22.507578 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.505274 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94df4141-3ddd-4a32-ac4a-66d02834c297" containerName="authorino" Jul 21 01:32:22.507578 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.505285 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="94df4141-3ddd-4a32-ac4a-66d02834c297" containerName="authorino" Jul 21 01:32:22.507578 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.505343 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="94df4141-3ddd-4a32-ac4a-66d02834c297" containerName="authorino" Jul 21 01:32:22.508255 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.508240 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wd8jk" Jul 21 01:32:22.510870 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.510848 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-87zpl\"" Jul 21 01:32:22.517324 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.517290 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wd8jk"] Jul 21 01:32:22.642296 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.642251 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nlht\" (UniqueName: \"kubernetes.io/projected/1ad54c58-f130-42a2-96e6-90394d6baea8-kube-api-access-4nlht\") pod \"authorino-5d4b67c446-wd8jk\" (UID: \"1ad54c58-f130-42a2-96e6-90394d6baea8\") " pod="kuadrant-system/authorino-5d4b67c446-wd8jk" Jul 21 01:32:22.743765 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.743719 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nlht\" (UniqueName: \"kubernetes.io/projected/1ad54c58-f130-42a2-96e6-90394d6baea8-kube-api-access-4nlht\") pod \"authorino-5d4b67c446-wd8jk\" (UID: \"1ad54c58-f130-42a2-96e6-90394d6baea8\") " pod="kuadrant-system/authorino-5d4b67c446-wd8jk" Jul 21 01:32:22.756962 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.756887 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nlht\" (UniqueName: \"kubernetes.io/projected/1ad54c58-f130-42a2-96e6-90394d6baea8-kube-api-access-4nlht\") pod \"authorino-5d4b67c446-wd8jk\" (UID: \"1ad54c58-f130-42a2-96e6-90394d6baea8\") " pod="kuadrant-system/authorino-5d4b67c446-wd8jk" Jul 21 01:32:22.763224 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.763196 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wd8jk"] Jul 21 01:32:22.763522 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.763500 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wd8jk" Jul 21 01:32:22.790062 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.790032 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75c75b9687-xm45l"] Jul 21 01:32:22.795210 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.795186 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75c75b9687-xm45l" Jul 21 01:32:22.803593 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.803384 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75c75b9687-xm45l"] Jul 21 01:32:22.929099 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.929059 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wd8jk"] Jul 21 01:32:22.933499 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:32:22.933471 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ad54c58_f130_42a2_96e6_90394d6baea8.slice/crio-4ee058d23d0d05f0f73c1c98cb255f7d8fc46554db6be2076fab270dbf7c67f1 WatchSource:0}: Error finding container 4ee058d23d0d05f0f73c1c98cb255f7d8fc46554db6be2076fab270dbf7c67f1: Status 404 returned error can't find the container with id 4ee058d23d0d05f0f73c1c98cb255f7d8fc46554db6be2076fab270dbf7c67f1 Jul 21 01:32:22.946334 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:22.946305 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-777rl\" (UniqueName: \"kubernetes.io/projected/7d8466e0-e490-46c2-85d8-87c62e628c6e-kube-api-access-777rl\") pod \"authorino-75c75b9687-xm45l\" (UID: \"7d8466e0-e490-46c2-85d8-87c62e628c6e\") " pod="kuadrant-system/authorino-75c75b9687-xm45l" Jul 21 01:32:23.047690 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:23.047596 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-777rl\" (UniqueName: \"kubernetes.io/projected/7d8466e0-e490-46c2-85d8-87c62e628c6e-kube-api-access-777rl\") pod \"authorino-75c75b9687-xm45l\" (UID: \"7d8466e0-e490-46c2-85d8-87c62e628c6e\") " pod="kuadrant-system/authorino-75c75b9687-xm45l" Jul 21 01:32:23.065471 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:23.065435 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-777rl\" (UniqueName: \"kubernetes.io/projected/7d8466e0-e490-46c2-85d8-87c62e628c6e-kube-api-access-777rl\") pod \"authorino-75c75b9687-xm45l\" (UID: \"7d8466e0-e490-46c2-85d8-87c62e628c6e\") " pod="kuadrant-system/authorino-75c75b9687-xm45l" Jul 21 01:32:23.096721 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:23.096688 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75c75b9687-xm45l"] Jul 21 01:32:23.097005 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:23.096992 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75c75b9687-xm45l" Jul 21 01:32:23.243338 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:23.243310 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75c75b9687-xm45l"] Jul 21 01:32:23.245196 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:32:23.245165 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d8466e0_e490_46c2_85d8_87c62e628c6e.slice/crio-b8876bce8ee4901c82a55177cc28779c79ce9f247ef1f62c95cd830c2d5563e6 WatchSource:0}: Error finding container b8876bce8ee4901c82a55177cc28779c79ce9f247ef1f62c95cd830c2d5563e6: Status 404 returned error can't find the container with id b8876bce8ee4901c82a55177cc28779c79ce9f247ef1f62c95cd830c2d5563e6 Jul 21 01:32:23.930088 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:23.930061 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75c75b9687-xm45l" event={"ID":"7d8466e0-e490-46c2-85d8-87c62e628c6e","Type":"ContainerStarted","Data":"b8876bce8ee4901c82a55177cc28779c79ce9f247ef1f62c95cd830c2d5563e6"} Jul 21 01:32:23.931632 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:23.931609 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wd8jk" event={"ID":"1ad54c58-f130-42a2-96e6-90394d6baea8","Type":"ContainerStarted","Data":"8d7be486890c5d239b64bf07a616165b0c559323436c26bc0a71521bd6c346be"} Jul 21 01:32:23.931760 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:23.931640 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wd8jk" event={"ID":"1ad54c58-f130-42a2-96e6-90394d6baea8","Type":"ContainerStarted","Data":"4ee058d23d0d05f0f73c1c98cb255f7d8fc46554db6be2076fab270dbf7c67f1"} Jul 21 01:32:23.931760 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:23.931638 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-wd8jk" podUID="1ad54c58-f130-42a2-96e6-90394d6baea8" containerName="authorino" containerID="cri-o://8d7be486890c5d239b64bf07a616165b0c559323436c26bc0a71521bd6c346be" gracePeriod=30 Jul 21 01:32:23.953787 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:23.953733 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-wd8jk" podStartSLOduration=1.52605846 podStartE2EDuration="1.953715795s" totalImagesPullingTime="427.657335ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:32:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:32:23.95196666 +0000 UTC m=+623.638615215" watchObservedRunningTime="2026-07-21 01:32:23.953715795 +0000 UTC m=+623.640364349" Jul 21 01:32:24.195101 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.194997 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wd8jk" Jul 21 01:32:24.359705 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.359649 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nlht\" (UniqueName: \"kubernetes.io/projected/1ad54c58-f130-42a2-96e6-90394d6baea8-kube-api-access-4nlht\") pod \"1ad54c58-f130-42a2-96e6-90394d6baea8\" (UID: \"1ad54c58-f130-42a2-96e6-90394d6baea8\") " Jul 21 01:32:24.361962 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.361939 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad54c58-f130-42a2-96e6-90394d6baea8-kube-api-access-4nlht" (OuterVolumeSpecName: "kube-api-access-4nlht") pod "1ad54c58-f130-42a2-96e6-90394d6baea8" (UID: "1ad54c58-f130-42a2-96e6-90394d6baea8"). InnerVolumeSpecName "kube-api-access-4nlht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:32:24.460574 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.460499 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nlht\" (UniqueName: \"kubernetes.io/projected/1ad54c58-f130-42a2-96e6-90394d6baea8-kube-api-access-4nlht\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:32:24.938641 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.938606 2553 generic.go:356] "Generic (PLEG): container finished" podID="1ad54c58-f130-42a2-96e6-90394d6baea8" containerID="8d7be486890c5d239b64bf07a616165b0c559323436c26bc0a71521bd6c346be" exitCode=0 Jul 21 01:32:24.939106 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.938649 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wd8jk" Jul 21 01:32:24.939106 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.938694 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wd8jk" event={"ID":"1ad54c58-f130-42a2-96e6-90394d6baea8","Type":"ContainerDied","Data":"8d7be486890c5d239b64bf07a616165b0c559323436c26bc0a71521bd6c346be"} Jul 21 01:32:24.939106 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.938743 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wd8jk" event={"ID":"1ad54c58-f130-42a2-96e6-90394d6baea8","Type":"ContainerDied","Data":"4ee058d23d0d05f0f73c1c98cb255f7d8fc46554db6be2076fab270dbf7c67f1"} Jul 21 01:32:24.939106 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.938762 2553 scope.go:117] "RemoveContainer" containerID="8d7be486890c5d239b64bf07a616165b0c559323436c26bc0a71521bd6c346be" Jul 21 01:32:24.940550 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.940531 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75c75b9687-xm45l" event={"ID":"7d8466e0-e490-46c2-85d8-87c62e628c6e","Type":"ContainerStarted","Data":"774d879a2b44ca386369d9d5de3656591b62fe3f5fb960235d032d031fde01d5"} Jul 21 01:32:24.940650 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.940607 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75c75b9687-xm45l" podUID="7d8466e0-e490-46c2-85d8-87c62e628c6e" containerName="authorino" containerID="cri-o://774d879a2b44ca386369d9d5de3656591b62fe3f5fb960235d032d031fde01d5" gracePeriod=30 Jul 21 01:32:24.951318 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.949437 2553 scope.go:117] "RemoveContainer" containerID="8d7be486890c5d239b64bf07a616165b0c559323436c26bc0a71521bd6c346be" Jul 21 01:32:24.951873 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:32:24.951851 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d7be486890c5d239b64bf07a616165b0c559323436c26bc0a71521bd6c346be\": container with ID starting with 8d7be486890c5d239b64bf07a616165b0c559323436c26bc0a71521bd6c346be not found: ID does not exist" containerID="8d7be486890c5d239b64bf07a616165b0c559323436c26bc0a71521bd6c346be" Jul 21 01:32:24.952008 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.951883 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d7be486890c5d239b64bf07a616165b0c559323436c26bc0a71521bd6c346be"} err="failed to get container status \"8d7be486890c5d239b64bf07a616165b0c559323436c26bc0a71521bd6c346be\": rpc error: code = NotFound desc = could not find container \"8d7be486890c5d239b64bf07a616165b0c559323436c26bc0a71521bd6c346be\": container with ID starting with 8d7be486890c5d239b64bf07a616165b0c559323436c26bc0a71521bd6c346be not found: ID does not exist" Jul 21 01:32:24.956954 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.956900 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75c75b9687-xm45l" podStartSLOduration=2.285308828 podStartE2EDuration="2.956881322s" totalImagesPullingTime="671.572494ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:32:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:32:24.956506476 +0000 UTC m=+624.643155031" watchObservedRunningTime="2026-07-21 01:32:24.956881322 +0000 UTC m=+624.643529878" Jul 21 01:32:24.971697 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.971672 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wd8jk"] Jul 21 01:32:24.975830 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:24.975807 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wd8jk"] Jul 21 01:32:25.210637 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:25.210613 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75c75b9687-xm45l" Jul 21 01:32:25.368269 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:25.368184 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-777rl\" (UniqueName: \"kubernetes.io/projected/7d8466e0-e490-46c2-85d8-87c62e628c6e-kube-api-access-777rl\") pod \"7d8466e0-e490-46c2-85d8-87c62e628c6e\" (UID: \"7d8466e0-e490-46c2-85d8-87c62e628c6e\") " Jul 21 01:32:25.370420 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:25.370383 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d8466e0-e490-46c2-85d8-87c62e628c6e-kube-api-access-777rl" (OuterVolumeSpecName: "kube-api-access-777rl") pod "7d8466e0-e490-46c2-85d8-87c62e628c6e" (UID: "7d8466e0-e490-46c2-85d8-87c62e628c6e"). InnerVolumeSpecName "kube-api-access-777rl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:32:25.469036 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:25.469002 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-777rl\" (UniqueName: \"kubernetes.io/projected/7d8466e0-e490-46c2-85d8-87c62e628c6e-kube-api-access-777rl\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:32:25.948010 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:25.947978 2553 generic.go:356] "Generic (PLEG): container finished" podID="7d8466e0-e490-46c2-85d8-87c62e628c6e" containerID="774d879a2b44ca386369d9d5de3656591b62fe3f5fb960235d032d031fde01d5" exitCode=0 Jul 21 01:32:25.948474 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:25.948022 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75c75b9687-xm45l" Jul 21 01:32:25.948474 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:25.948062 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75c75b9687-xm45l" event={"ID":"7d8466e0-e490-46c2-85d8-87c62e628c6e","Type":"ContainerDied","Data":"774d879a2b44ca386369d9d5de3656591b62fe3f5fb960235d032d031fde01d5"} Jul 21 01:32:25.948474 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:25.948103 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75c75b9687-xm45l" event={"ID":"7d8466e0-e490-46c2-85d8-87c62e628c6e","Type":"ContainerDied","Data":"b8876bce8ee4901c82a55177cc28779c79ce9f247ef1f62c95cd830c2d5563e6"} Jul 21 01:32:25.948474 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:25.948124 2553 scope.go:117] "RemoveContainer" containerID="774d879a2b44ca386369d9d5de3656591b62fe3f5fb960235d032d031fde01d5" Jul 21 01:32:25.957260 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:25.957244 2553 scope.go:117] "RemoveContainer" containerID="774d879a2b44ca386369d9d5de3656591b62fe3f5fb960235d032d031fde01d5" Jul 21 01:32:25.957516 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:32:25.957496 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"774d879a2b44ca386369d9d5de3656591b62fe3f5fb960235d032d031fde01d5\": container with ID starting with 774d879a2b44ca386369d9d5de3656591b62fe3f5fb960235d032d031fde01d5 not found: ID does not exist" containerID="774d879a2b44ca386369d9d5de3656591b62fe3f5fb960235d032d031fde01d5" Jul 21 01:32:25.957558 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:25.957525 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"774d879a2b44ca386369d9d5de3656591b62fe3f5fb960235d032d031fde01d5"} err="failed to get container status \"774d879a2b44ca386369d9d5de3656591b62fe3f5fb960235d032d031fde01d5\": rpc error: code = NotFound desc = could not find container \"774d879a2b44ca386369d9d5de3656591b62fe3f5fb960235d032d031fde01d5\": container with ID starting with 774d879a2b44ca386369d9d5de3656591b62fe3f5fb960235d032d031fde01d5 not found: ID does not exist" Jul 21 01:32:25.970125 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:25.970104 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75c75b9687-xm45l"] Jul 21 01:32:25.973586 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:25.973564 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75c75b9687-xm45l"] Jul 21 01:32:26.842743 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:26.842699 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ad54c58-f130-42a2-96e6-90394d6baea8" path="/var/lib/kubelet/pods/1ad54c58-f130-42a2-96e6-90394d6baea8/volumes" Jul 21 01:32:26.843144 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:26.843123 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d8466e0-e490-46c2-85d8-87c62e628c6e" path="/var/lib/kubelet/pods/7d8466e0-e490-46c2-85d8-87c62e628c6e/volumes" Jul 21 01:32:31.079377 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.079338 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77d59447c9-jpzm7"] Jul 21 01:32:31.079755 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.079717 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d8466e0-e490-46c2-85d8-87c62e628c6e" containerName="authorino" Jul 21 01:32:31.079755 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.079727 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d8466e0-e490-46c2-85d8-87c62e628c6e" containerName="authorino" Jul 21 01:32:31.079755 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.079739 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad54c58-f130-42a2-96e6-90394d6baea8" containerName="authorino" Jul 21 01:32:31.079755 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.079744 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad54c58-f130-42a2-96e6-90394d6baea8" containerName="authorino" Jul 21 01:32:31.079921 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.079827 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d8466e0-e490-46c2-85d8-87c62e628c6e" containerName="authorino" Jul 21 01:32:31.079921 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.079837 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ad54c58-f130-42a2-96e6-90394d6baea8" containerName="authorino" Jul 21 01:32:31.084897 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.084867 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77d59447c9-jpzm7" Jul 21 01:32:31.087957 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.087746 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 21 01:32:31.088163 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.087980 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 21 01:32:31.088236 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.088166 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wj5n8\"" Jul 21 01:32:31.096087 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.096062 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77d59447c9-jpzm7"] Jul 21 01:32:31.218223 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.218185 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0632a1c9-5d59-4637-adf1-82ab71948667-webhook-cert\") pod \"maas-controller-77d59447c9-jpzm7\" (UID: \"0632a1c9-5d59-4637-adf1-82ab71948667\") " pod="opendatahub/maas-controller-77d59447c9-jpzm7" Jul 21 01:32:31.218394 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.218267 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47z4q\" (UniqueName: \"kubernetes.io/projected/0632a1c9-5d59-4637-adf1-82ab71948667-kube-api-access-47z4q\") pod \"maas-controller-77d59447c9-jpzm7\" (UID: \"0632a1c9-5d59-4637-adf1-82ab71948667\") " pod="opendatahub/maas-controller-77d59447c9-jpzm7" Jul 21 01:32:31.260870 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.260833 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bb6957b54-6r4f6"] Jul 21 01:32:31.263543 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.263528 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb6957b54-6r4f6" Jul 21 01:32:31.275138 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.275112 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb6957b54-6r4f6"] Jul 21 01:32:31.319731 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.319694 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0632a1c9-5d59-4637-adf1-82ab71948667-webhook-cert\") pod \"maas-controller-77d59447c9-jpzm7\" (UID: \"0632a1c9-5d59-4637-adf1-82ab71948667\") " pod="opendatahub/maas-controller-77d59447c9-jpzm7" Jul 21 01:32:31.319900 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.319758 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47z4q\" (UniqueName: \"kubernetes.io/projected/0632a1c9-5d59-4637-adf1-82ab71948667-kube-api-access-47z4q\") pod \"maas-controller-77d59447c9-jpzm7\" (UID: \"0632a1c9-5d59-4637-adf1-82ab71948667\") " pod="opendatahub/maas-controller-77d59447c9-jpzm7" Jul 21 01:32:31.322325 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.322302 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0632a1c9-5d59-4637-adf1-82ab71948667-webhook-cert\") pod \"maas-controller-77d59447c9-jpzm7\" (UID: \"0632a1c9-5d59-4637-adf1-82ab71948667\") " pod="opendatahub/maas-controller-77d59447c9-jpzm7" Jul 21 01:32:31.329589 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.329531 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47z4q\" (UniqueName: \"kubernetes.io/projected/0632a1c9-5d59-4637-adf1-82ab71948667-kube-api-access-47z4q\") pod \"maas-controller-77d59447c9-jpzm7\" (UID: \"0632a1c9-5d59-4637-adf1-82ab71948667\") " pod="opendatahub/maas-controller-77d59447c9-jpzm7" Jul 21 01:32:31.397778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.397740 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77d59447c9-jpzm7" Jul 21 01:32:31.421111 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.421078 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9932ec3d-848f-464c-8858-924a6bd4c937-webhook-cert\") pod \"maas-controller-6bb6957b54-6r4f6\" (UID: \"9932ec3d-848f-464c-8858-924a6bd4c937\") " pod="opendatahub/maas-controller-6bb6957b54-6r4f6" Jul 21 01:32:31.421289 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.421159 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9kq7\" (UniqueName: \"kubernetes.io/projected/9932ec3d-848f-464c-8858-924a6bd4c937-kube-api-access-n9kq7\") pod \"maas-controller-6bb6957b54-6r4f6\" (UID: \"9932ec3d-848f-464c-8858-924a6bd4c937\") " pod="opendatahub/maas-controller-6bb6957b54-6r4f6" Jul 21 01:32:31.522507 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.522473 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9kq7\" (UniqueName: \"kubernetes.io/projected/9932ec3d-848f-464c-8858-924a6bd4c937-kube-api-access-n9kq7\") pod \"maas-controller-6bb6957b54-6r4f6\" (UID: \"9932ec3d-848f-464c-8858-924a6bd4c937\") " pod="opendatahub/maas-controller-6bb6957b54-6r4f6" Jul 21 01:32:31.522687 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.522573 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9932ec3d-848f-464c-8858-924a6bd4c937-webhook-cert\") pod \"maas-controller-6bb6957b54-6r4f6\" (UID: \"9932ec3d-848f-464c-8858-924a6bd4c937\") " pod="opendatahub/maas-controller-6bb6957b54-6r4f6" Jul 21 01:32:31.525185 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.525159 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9932ec3d-848f-464c-8858-924a6bd4c937-webhook-cert\") pod \"maas-controller-6bb6957b54-6r4f6\" (UID: \"9932ec3d-848f-464c-8858-924a6bd4c937\") " pod="opendatahub/maas-controller-6bb6957b54-6r4f6" Jul 21 01:32:31.530523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.530495 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9kq7\" (UniqueName: \"kubernetes.io/projected/9932ec3d-848f-464c-8858-924a6bd4c937-kube-api-access-n9kq7\") pod \"maas-controller-6bb6957b54-6r4f6\" (UID: \"9932ec3d-848f-464c-8858-924a6bd4c937\") " pod="opendatahub/maas-controller-6bb6957b54-6r4f6" Jul 21 01:32:31.536168 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.536137 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77d59447c9-jpzm7"] Jul 21 01:32:31.537775 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:32:31.537750 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0632a1c9_5d59_4637_adf1_82ab71948667.slice/crio-4857664df09887f340224286299df1828de15ac53c924be8274c323e3059d09f WatchSource:0}: Error finding container 4857664df09887f340224286299df1828de15ac53c924be8274c323e3059d09f: Status 404 returned error can't find the container with id 4857664df09887f340224286299df1828de15ac53c924be8274c323e3059d09f Jul 21 01:32:31.574443 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.574418 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb6957b54-6r4f6" Jul 21 01:32:31.720614 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.717220 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb6957b54-6r4f6"] Jul 21 01:32:31.720614 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:32:31.717753 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9932ec3d_848f_464c_8858_924a6bd4c937.slice/crio-1b747c4d8bed04994ba60cca75a10f6ea248217e5d6279045e9626af5baaafe0 WatchSource:0}: Error finding container 1b747c4d8bed04994ba60cca75a10f6ea248217e5d6279045e9626af5baaafe0: Status 404 returned error can't find the container with id 1b747c4d8bed04994ba60cca75a10f6ea248217e5d6279045e9626af5baaafe0 Jul 21 01:32:31.984165 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.984115 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77d59447c9-jpzm7" event={"ID":"0632a1c9-5d59-4637-adf1-82ab71948667","Type":"ContainerStarted","Data":"4857664df09887f340224286299df1828de15ac53c924be8274c323e3059d09f"} Jul 21 01:32:31.985261 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:31.985232 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb6957b54-6r4f6" event={"ID":"9932ec3d-848f-464c-8858-924a6bd4c937","Type":"ContainerStarted","Data":"1b747c4d8bed04994ba60cca75a10f6ea248217e5d6279045e9626af5baaafe0"} Jul 21 01:32:35.005871 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:35.005832 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb6957b54-6r4f6" event={"ID":"9932ec3d-848f-464c-8858-924a6bd4c937","Type":"ContainerStarted","Data":"9078878eb48b592a51fcacf50fbc6b2bf185661df1de845b9c698a669a7f779a"} Jul 21 01:32:35.006328 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:35.005926 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bb6957b54-6r4f6" Jul 21 01:32:35.007360 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:35.007334 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77d59447c9-jpzm7" event={"ID":"0632a1c9-5d59-4637-adf1-82ab71948667","Type":"ContainerStarted","Data":"701f497df00320c27a2388e78acaee496d58dd26e65e9eedd11f940912539a2d"} Jul 21 01:32:35.007471 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:35.007380 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77d59447c9-jpzm7" Jul 21 01:32:35.028307 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:35.028260 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bb6957b54-6r4f6" podStartSLOduration=1.718171777 podStartE2EDuration="4.02824607s" totalImagesPullingTime="2.310074293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:32:35.025771361 +0000 UTC m=+634.712419916" watchObservedRunningTime="2026-07-21 01:32:35.02824607 +0000 UTC m=+634.714894650" Jul 21 01:32:35.048210 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:35.048146 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77d59447c9-jpzm7" podStartSLOduration=1.566312231 podStartE2EDuration="4.048129672s" totalImagesPullingTime="2.481817441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:32:35.046065018 +0000 UTC m=+634.732713574" watchObservedRunningTime="2026-07-21 01:32:35.048129672 +0000 UTC m=+634.734778226" Jul 21 01:32:46.014836 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:46.014783 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bb6957b54-6r4f6" Jul 21 01:32:46.015298 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:46.014971 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77d59447c9-jpzm7" Jul 21 01:32:46.076055 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:46.076016 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77d59447c9-jpzm7"] Jul 21 01:32:46.076301 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:46.076270 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-77d59447c9-jpzm7" podUID="0632a1c9-5d59-4637-adf1-82ab71948667" containerName="manager" containerID="cri-o://701f497df00320c27a2388e78acaee496d58dd26e65e9eedd11f940912539a2d" gracePeriod=30 Jul 21 01:32:46.331210 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:46.331184 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77d59447c9-jpzm7" Jul 21 01:32:46.352535 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:46.352506 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47z4q\" (UniqueName: \"kubernetes.io/projected/0632a1c9-5d59-4637-adf1-82ab71948667-kube-api-access-47z4q\") pod \"0632a1c9-5d59-4637-adf1-82ab71948667\" (UID: \"0632a1c9-5d59-4637-adf1-82ab71948667\") " Jul 21 01:32:46.352698 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:46.352544 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0632a1c9-5d59-4637-adf1-82ab71948667-webhook-cert\") pod \"0632a1c9-5d59-4637-adf1-82ab71948667\" (UID: \"0632a1c9-5d59-4637-adf1-82ab71948667\") " Jul 21 01:32:46.355020 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:46.354985 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0632a1c9-5d59-4637-adf1-82ab71948667-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0632a1c9-5d59-4637-adf1-82ab71948667" (UID: "0632a1c9-5d59-4637-adf1-82ab71948667"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 01:32:46.355020 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:46.355008 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0632a1c9-5d59-4637-adf1-82ab71948667-kube-api-access-47z4q" (OuterVolumeSpecName: "kube-api-access-47z4q") pod "0632a1c9-5d59-4637-adf1-82ab71948667" (UID: "0632a1c9-5d59-4637-adf1-82ab71948667"). InnerVolumeSpecName "kube-api-access-47z4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:32:46.453475 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:46.453442 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47z4q\" (UniqueName: \"kubernetes.io/projected/0632a1c9-5d59-4637-adf1-82ab71948667-kube-api-access-47z4q\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:32:46.453475 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:46.453473 2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0632a1c9-5d59-4637-adf1-82ab71948667-webhook-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:32:47.075580 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:47.075545 2553 generic.go:356] "Generic (PLEG): container finished" podID="0632a1c9-5d59-4637-adf1-82ab71948667" containerID="701f497df00320c27a2388e78acaee496d58dd26e65e9eedd11f940912539a2d" exitCode=0 Jul 21 01:32:47.076022 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:47.075586 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77d59447c9-jpzm7" Jul 21 01:32:47.076022 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:47.075632 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77d59447c9-jpzm7" event={"ID":"0632a1c9-5d59-4637-adf1-82ab71948667","Type":"ContainerDied","Data":"701f497df00320c27a2388e78acaee496d58dd26e65e9eedd11f940912539a2d"} Jul 21 01:32:47.076022 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:47.075678 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77d59447c9-jpzm7" event={"ID":"0632a1c9-5d59-4637-adf1-82ab71948667","Type":"ContainerDied","Data":"4857664df09887f340224286299df1828de15ac53c924be8274c323e3059d09f"} Jul 21 01:32:47.076022 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:47.075699 2553 scope.go:117] "RemoveContainer" containerID="701f497df00320c27a2388e78acaee496d58dd26e65e9eedd11f940912539a2d" Jul 21 01:32:47.085850 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:47.085687 2553 scope.go:117] "RemoveContainer" containerID="701f497df00320c27a2388e78acaee496d58dd26e65e9eedd11f940912539a2d" Jul 21 01:32:47.085995 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:32:47.085977 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"701f497df00320c27a2388e78acaee496d58dd26e65e9eedd11f940912539a2d\": container with ID starting with 701f497df00320c27a2388e78acaee496d58dd26e65e9eedd11f940912539a2d not found: ID does not exist" containerID="701f497df00320c27a2388e78acaee496d58dd26e65e9eedd11f940912539a2d" Jul 21 01:32:47.086038 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:47.086006 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"701f497df00320c27a2388e78acaee496d58dd26e65e9eedd11f940912539a2d"} err="failed to get container status \"701f497df00320c27a2388e78acaee496d58dd26e65e9eedd11f940912539a2d\": rpc error: code = NotFound desc = could not find container \"701f497df00320c27a2388e78acaee496d58dd26e65e9eedd11f940912539a2d\": container with ID starting with 701f497df00320c27a2388e78acaee496d58dd26e65e9eedd11f940912539a2d not found: ID does not exist" Jul 21 01:32:47.093944 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:47.093886 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77d59447c9-jpzm7"] Jul 21 01:32:47.101769 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:47.101747 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77d59447c9-jpzm7"] Jul 21 01:32:48.836189 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:32:48.836146 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0632a1c9-5d59-4637-adf1-82ab71948667" path="/var/lib/kubelet/pods/0632a1c9-5d59-4637-adf1-82ab71948667/volumes" Jul 21 01:33:07.105452 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.105410 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-krn4g"] Jul 21 01:33:07.105983 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.105869 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0632a1c9-5d59-4637-adf1-82ab71948667" containerName="manager" Jul 21 01:33:07.105983 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.105882 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0632a1c9-5d59-4637-adf1-82ab71948667" containerName="manager" Jul 21 01:33:07.105983 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.105964 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0632a1c9-5d59-4637-adf1-82ab71948667" containerName="manager" Jul 21 01:33:07.111679 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.111659 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-krn4g" Jul 21 01:33:07.115466 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.115432 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zktn2\"" Jul 21 01:33:07.115466 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.115463 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 21 01:33:07.121614 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.121586 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-krn4g"] Jul 21 01:33:07.243265 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.243224 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f6aab8f-ec51-4e02-9571-3d67f696da3f-plugins-config-volume\") pod \"payload-processing-5bf47cd988-krn4g\" (UID: \"8f6aab8f-ec51-4e02-9571-3d67f696da3f\") " pod="openshift-ingress/payload-processing-5bf47cd988-krn4g" Jul 21 01:33:07.243453 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.243298 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk72m\" (UniqueName: \"kubernetes.io/projected/8f6aab8f-ec51-4e02-9571-3d67f696da3f-kube-api-access-qk72m\") pod \"payload-processing-5bf47cd988-krn4g\" (UID: \"8f6aab8f-ec51-4e02-9571-3d67f696da3f\") " pod="openshift-ingress/payload-processing-5bf47cd988-krn4g" Jul 21 01:33:07.344118 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.344075 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f6aab8f-ec51-4e02-9571-3d67f696da3f-plugins-config-volume\") pod \"payload-processing-5bf47cd988-krn4g\" (UID: \"8f6aab8f-ec51-4e02-9571-3d67f696da3f\") " pod="openshift-ingress/payload-processing-5bf47cd988-krn4g" Jul 21 01:33:07.344341 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.344178 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk72m\" (UniqueName: \"kubernetes.io/projected/8f6aab8f-ec51-4e02-9571-3d67f696da3f-kube-api-access-qk72m\") pod \"payload-processing-5bf47cd988-krn4g\" (UID: \"8f6aab8f-ec51-4e02-9571-3d67f696da3f\") " pod="openshift-ingress/payload-processing-5bf47cd988-krn4g" Jul 21 01:33:07.344908 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.344880 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f6aab8f-ec51-4e02-9571-3d67f696da3f-plugins-config-volume\") pod \"payload-processing-5bf47cd988-krn4g\" (UID: \"8f6aab8f-ec51-4e02-9571-3d67f696da3f\") " pod="openshift-ingress/payload-processing-5bf47cd988-krn4g" Jul 21 01:33:07.352999 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.352974 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk72m\" (UniqueName: \"kubernetes.io/projected/8f6aab8f-ec51-4e02-9571-3d67f696da3f-kube-api-access-qk72m\") pod \"payload-processing-5bf47cd988-krn4g\" (UID: \"8f6aab8f-ec51-4e02-9571-3d67f696da3f\") " pod="openshift-ingress/payload-processing-5bf47cd988-krn4g" Jul 21 01:33:07.424031 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.423933 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-krn4g" Jul 21 01:33:07.575918 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.575885 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-krn4g"] Jul 21 01:33:07.578442 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:33:07.578408 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f6aab8f_ec51_4e02_9571_3d67f696da3f.slice/crio-59eabb61b4becc72dc73f14d6a80149073c88dc8efe7f21b66c685c9e0ebad4d WatchSource:0}: Error finding container 59eabb61b4becc72dc73f14d6a80149073c88dc8efe7f21b66c685c9e0ebad4d: Status 404 returned error can't find the container with id 59eabb61b4becc72dc73f14d6a80149073c88dc8efe7f21b66c685c9e0ebad4d Jul 21 01:33:07.581162 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:07.581139 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 01:33:08.200133 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:08.200095 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-krn4g" event={"ID":"8f6aab8f-ec51-4e02-9571-3d67f696da3f","Type":"ContainerStarted","Data":"59eabb61b4becc72dc73f14d6a80149073c88dc8efe7f21b66c685c9e0ebad4d"} Jul 21 01:33:10.214510 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:10.214467 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-krn4g" event={"ID":"8f6aab8f-ec51-4e02-9571-3d67f696da3f","Type":"ContainerStarted","Data":"fdfecf90931f45faf9554cd53f339c5d3215abb452ac9ba0921e9b4d4659ce8a"} Jul 21 01:33:10.214964 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:10.214558 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-krn4g" Jul 21 01:33:10.232469 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:10.232414 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-krn4g" podStartSLOduration=1.30233789 podStartE2EDuration="3.232396561s" totalImagesPullingTime="1.930058671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:33:10.231048881 +0000 UTC m=+669.917697447" watchObservedRunningTime="2026-07-21 01:33:10.232396561 +0000 UTC m=+669.919045115" Jul 21 01:33:15.244529 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:15.244489 2553 generic.go:356] "Generic (PLEG): container finished" podID="ce470538-e0e7-402b-bf10-5f77b137c4ef" containerID="2864926a45c128a2097dec4e822417fabaa98031ad29458f92b17d51dc3eccbc" exitCode=0 Jul 21 01:33:15.245003 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:15.244565 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" event={"ID":"ce470538-e0e7-402b-bf10-5f77b137c4ef","Type":"ContainerDied","Data":"2864926a45c128a2097dec4e822417fabaa98031ad29458f92b17d51dc3eccbc"} Jul 21 01:33:15.245003 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:15.244985 2553 scope.go:117] "RemoveContainer" containerID="2864926a45c128a2097dec4e822417fabaa98031ad29458f92b17d51dc3eccbc" Jul 21 01:33:15.245957 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:15.245932 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:33:15.246011 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:15.246000 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:33:15.246047 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:15.246034 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:33:16.256934 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:16.256875 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" event={"ID":"ce470538-e0e7-402b-bf10-5f77b137c4ef","Type":"ContainerStarted","Data":"18c1fcb862ee7ebe00cec23cf8d05f12f698664b5f4a8c896c8db5d262ee5841"} Jul 21 01:33:16.271038 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:16.270987 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:33:16.271243 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:16.271117 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-lxqcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 01:33:16.271243 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:16.271189 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" podUID="ce470538-e0e7-402b-bf10-5f77b137c4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 01:33:17.270886 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:17.270849 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-lxqcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 01:33:17.271398 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:17.270908 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" podUID="ce470538-e0e7-402b-bf10-5f77b137c4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 01:33:18.271268 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:18.271231 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-lxqcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 01:33:18.271670 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:18.271287 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" podUID="ce470538-e0e7-402b-bf10-5f77b137c4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 01:33:19.271277 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:19.271240 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-lxqcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 01:33:19.271815 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:19.271292 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" podUID="ce470538-e0e7-402b-bf10-5f77b137c4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 01:33:20.271428 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:20.271385 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-lxqcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 01:33:20.271899 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:20.271461 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" podUID="ce470538-e0e7-402b-bf10-5f77b137c4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 01:33:21.222995 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:21.222960 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-krn4g" Jul 21 01:33:21.274975 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:21.274944 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:33:21.275479 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:21.275463 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:33:21.276241 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:21.276221 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-lxqcx" Jul 21 01:33:27.491690 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.491643 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf"] Jul 21 01:33:27.495960 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.495936 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.498977 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.498947 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 21 01:33:27.498977 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.498945 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hv87n\"" Jul 21 01:33:27.499183 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.499044 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 21 01:33:27.499183 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.498946 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 21 01:33:27.506727 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.506698 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf"] Jul 21 01:33:27.548848 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.548791 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.549037 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.548877 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.549037 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.548898 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.549037 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.548985 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.549037 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.549018 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.549201 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.549040 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knndq\" (UniqueName: \"kubernetes.io/projected/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-kube-api-access-knndq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.650227 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.650192 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.650227 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.650230 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.650483 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.650312 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.650483 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.650341 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.650483 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.650470 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knndq\" (UniqueName: \"kubernetes.io/projected/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-kube-api-access-knndq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.650635 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.650525 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.650736 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.650715 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.650874 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.650854 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.650956 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.650887 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.653126 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.653098 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.653438 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.653419 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.658948 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.658921 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knndq\" (UniqueName: \"kubernetes.io/projected/e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5-kube-api-access-knndq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf\" (UID: \"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.808699 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.808606 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:27.960356 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:27.960318 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf"] Jul 21 01:33:27.961731 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:33:27.961702 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6f5d29a_9881_4ebd_9823_d2ef35e7e0b5.slice/crio-ed556db2d804fc469f04b0d6e3b9d9389dfbc251dc11d247ef3767d0e5878738 WatchSource:0}: Error finding container ed556db2d804fc469f04b0d6e3b9d9389dfbc251dc11d247ef3767d0e5878738: Status 404 returned error can't find the container with id ed556db2d804fc469f04b0d6e3b9d9389dfbc251dc11d247ef3767d0e5878738 Jul 21 01:33:28.338513 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:28.338465 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" event={"ID":"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5","Type":"ContainerStarted","Data":"ed556db2d804fc469f04b0d6e3b9d9389dfbc251dc11d247ef3767d0e5878738"} Jul 21 01:33:29.347629 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:29.347536 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" event={"ID":"e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5","Type":"ContainerStarted","Data":"9191e2927c238c29424976a1ad0ca36b09b19e9efb34a24ec8f9a80a31d9b9df"} Jul 21 01:33:29.367913 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:29.367857 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" podStartSLOduration=1.243420311 podStartE2EDuration="2.367835903s" totalImagesPullingTime="1.124415592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:33:29.366586738 +0000 UTC m=+689.053235295" watchObservedRunningTime="2026-07-21 01:33:29.367835903 +0000 UTC m=+689.054484462" Jul 21 01:33:37.809701 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:37.809664 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:37.810262 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:37.809724 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:37.822244 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:37.822217 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:38.413015 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:38.412986 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf" Jul 21 01:33:41.098207 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.098168 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv"] Jul 21 01:33:41.102432 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.102408 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.105187 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.105163 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 21 01:33:41.113097 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.113073 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv"] Jul 21 01:33:41.180873 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.180832 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c266739-af5e-4285-9183-f3ecbf29a66c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.181077 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.180889 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c266739-af5e-4285-9183-f3ecbf29a66c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.181077 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.180913 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c266739-af5e-4285-9183-f3ecbf29a66c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.181077 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.180941 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c266739-af5e-4285-9183-f3ecbf29a66c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.181077 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.180984 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b6l2\" (UniqueName: \"kubernetes.io/projected/0c266739-af5e-4285-9183-f3ecbf29a66c-kube-api-access-8b6l2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.181303 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.181118 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c266739-af5e-4285-9183-f3ecbf29a66c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.282587 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.282551 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c266739-af5e-4285-9183-f3ecbf29a66c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.282775 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.282596 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b6l2\" (UniqueName: \"kubernetes.io/projected/0c266739-af5e-4285-9183-f3ecbf29a66c-kube-api-access-8b6l2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.282775 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.282660 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c266739-af5e-4285-9183-f3ecbf29a66c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.282775 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.282683 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c266739-af5e-4285-9183-f3ecbf29a66c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.282775 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.282703 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c266739-af5e-4285-9183-f3ecbf29a66c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.282775 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.282718 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c266739-af5e-4285-9183-f3ecbf29a66c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.283108 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.282984 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c266739-af5e-4285-9183-f3ecbf29a66c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.283108 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.283099 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c266739-af5e-4285-9183-f3ecbf29a66c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.283193 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.283151 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c266739-af5e-4285-9183-f3ecbf29a66c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.285223 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.285198 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c266739-af5e-4285-9183-f3ecbf29a66c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.285482 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.285461 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c266739-af5e-4285-9183-f3ecbf29a66c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.291138 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.291111 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b6l2\" (UniqueName: \"kubernetes.io/projected/0c266739-af5e-4285-9183-f3ecbf29a66c-kube-api-access-8b6l2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fp6kv\" (UID: \"0c266739-af5e-4285-9183-f3ecbf29a66c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.413265 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.413172 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:41.559512 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:41.559481 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv"] Jul 21 01:33:41.560883 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:33:41.560846 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c266739_af5e_4285_9183_f3ecbf29a66c.slice/crio-437d9310f4355586391b68eb92a23b250a0f77ed66f4902dbd01875963bf820e WatchSource:0}: Error finding container 437d9310f4355586391b68eb92a23b250a0f77ed66f4902dbd01875963bf820e: Status 404 returned error can't find the container with id 437d9310f4355586391b68eb92a23b250a0f77ed66f4902dbd01875963bf820e Jul 21 01:33:42.432323 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:42.432288 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" event={"ID":"0c266739-af5e-4285-9183-f3ecbf29a66c","Type":"ContainerStarted","Data":"9661aae28cbf8f38bda7d00b45d3847a13ea0de6a50c402fa4a8f581d7472d4a"} Jul 21 01:33:42.432836 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:42.432342 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" event={"ID":"0c266739-af5e-4285-9183-f3ecbf29a66c","Type":"ContainerStarted","Data":"437d9310f4355586391b68eb92a23b250a0f77ed66f4902dbd01875963bf820e"} Jul 21 01:33:42.450489 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:42.450429 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" podStartSLOduration=1.258764898 podStartE2EDuration="1.450413999s" totalImagesPullingTime="191.649101ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:33:42.448252338 +0000 UTC m=+702.134900895" watchObservedRunningTime="2026-07-21 01:33:42.450413999 +0000 UTC m=+702.137062554" Jul 21 01:33:51.413497 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:51.413456 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:51.413952 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:51.413535 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:51.426464 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:51.426440 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:33:51.501637 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:33:51.501605 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fp6kv" Jul 21 01:35:53.241058 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:53.241023 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-784686956b-flxbc"] Jul 21 01:35:53.244702 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:53.244679 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-784686956b-flxbc" Jul 21 01:35:53.248743 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:53.248720 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 21 01:35:53.248895 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:53.248741 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-87zpl\"" Jul 21 01:35:53.261044 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:53.261020 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-784686956b-flxbc"] Jul 21 01:35:53.300727 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:53.300687 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50216fc0-4af4-45c3-a3c9-582df1698921-tls-cert\") pod \"authorino-784686956b-flxbc\" (UID: \"50216fc0-4af4-45c3-a3c9-582df1698921\") " pod="kuadrant-system/authorino-784686956b-flxbc" Jul 21 01:35:53.300907 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:53.300774 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhq8s\" (UniqueName: \"kubernetes.io/projected/50216fc0-4af4-45c3-a3c9-582df1698921-kube-api-access-fhq8s\") pod \"authorino-784686956b-flxbc\" (UID: \"50216fc0-4af4-45c3-a3c9-582df1698921\") " pod="kuadrant-system/authorino-784686956b-flxbc" Jul 21 01:35:53.401572 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:53.401533 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50216fc0-4af4-45c3-a3c9-582df1698921-tls-cert\") pod \"authorino-784686956b-flxbc\" (UID: \"50216fc0-4af4-45c3-a3c9-582df1698921\") " pod="kuadrant-system/authorino-784686956b-flxbc" Jul 21 01:35:53.401749 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:53.401611 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhq8s\" (UniqueName: \"kubernetes.io/projected/50216fc0-4af4-45c3-a3c9-582df1698921-kube-api-access-fhq8s\") pod \"authorino-784686956b-flxbc\" (UID: \"50216fc0-4af4-45c3-a3c9-582df1698921\") " pod="kuadrant-system/authorino-784686956b-flxbc" Jul 21 01:35:53.404308 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:53.404283 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50216fc0-4af4-45c3-a3c9-582df1698921-tls-cert\") pod \"authorino-784686956b-flxbc\" (UID: \"50216fc0-4af4-45c3-a3c9-582df1698921\") " pod="kuadrant-system/authorino-784686956b-flxbc" Jul 21 01:35:53.410497 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:53.410469 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhq8s\" (UniqueName: \"kubernetes.io/projected/50216fc0-4af4-45c3-a3c9-582df1698921-kube-api-access-fhq8s\") pod \"authorino-784686956b-flxbc\" (UID: \"50216fc0-4af4-45c3-a3c9-582df1698921\") " pod="kuadrant-system/authorino-784686956b-flxbc" Jul 21 01:35:53.554094 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:53.553994 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-784686956b-flxbc" Jul 21 01:35:53.697266 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:53.697241 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-784686956b-flxbc"] Jul 21 01:35:53.699653 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:35:53.699623 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50216fc0_4af4_45c3_a3c9_582df1698921.slice/crio-7276a53ae5b8dbaf4fbbcc2bf547cca57bd050440da527d9acb26d98e6af09be WatchSource:0}: Error finding container 7276a53ae5b8dbaf4fbbcc2bf547cca57bd050440da527d9acb26d98e6af09be: Status 404 returned error can't find the container with id 7276a53ae5b8dbaf4fbbcc2bf547cca57bd050440da527d9acb26d98e6af09be Jul 21 01:35:54.206613 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:54.206558 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-784686956b-flxbc" event={"ID":"50216fc0-4af4-45c3-a3c9-582df1698921","Type":"ContainerStarted","Data":"7276a53ae5b8dbaf4fbbcc2bf547cca57bd050440da527d9acb26d98e6af09be"} Jul 21 01:35:55.215098 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:55.215047 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-784686956b-flxbc" event={"ID":"50216fc0-4af4-45c3-a3c9-582df1698921","Type":"ContainerStarted","Data":"63d33b2b813d4d57add337b5756008140aa8d9c91c9d2e7b2997788acb678a38"} Jul 21 01:35:55.232519 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:35:55.232466 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-784686956b-flxbc" podStartSLOduration=1.789580334 podStartE2EDuration="2.23245022s" totalImagesPullingTime="442.869886ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:35:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:35:55.229570102 +0000 UTC m=+834.916218656" watchObservedRunningTime="2026-07-21 01:35:55.23245022 +0000 UTC m=+834.919098774" Jul 21 01:36:43.769920 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:43.769884 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb6957b54-6r4f6"] Jul 21 01:36:43.770527 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:43.770109 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6bb6957b54-6r4f6" podUID="9932ec3d-848f-464c-8858-924a6bd4c937" containerName="manager" containerID="cri-o://9078878eb48b592a51fcacf50fbc6b2bf185661df1de845b9c698a669a7f779a" gracePeriod=30 Jul 21 01:36:44.034504 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.034443 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb6957b54-6r4f6" Jul 21 01:36:44.093285 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.093257 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9932ec3d-848f-464c-8858-924a6bd4c937-webhook-cert\") pod \"9932ec3d-848f-464c-8858-924a6bd4c937\" (UID: \"9932ec3d-848f-464c-8858-924a6bd4c937\") " Jul 21 01:36:44.093482 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.093341 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9kq7\" (UniqueName: \"kubernetes.io/projected/9932ec3d-848f-464c-8858-924a6bd4c937-kube-api-access-n9kq7\") pod \"9932ec3d-848f-464c-8858-924a6bd4c937\" (UID: \"9932ec3d-848f-464c-8858-924a6bd4c937\") " Jul 21 01:36:44.095542 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.095506 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9932ec3d-848f-464c-8858-924a6bd4c937-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9932ec3d-848f-464c-8858-924a6bd4c937" (UID: "9932ec3d-848f-464c-8858-924a6bd4c937"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 01:36:44.095542 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.095528 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9932ec3d-848f-464c-8858-924a6bd4c937-kube-api-access-n9kq7" (OuterVolumeSpecName: "kube-api-access-n9kq7") pod "9932ec3d-848f-464c-8858-924a6bd4c937" (UID: "9932ec3d-848f-464c-8858-924a6bd4c937"). InnerVolumeSpecName "kube-api-access-n9kq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:36:44.194734 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.194699 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9kq7\" (UniqueName: \"kubernetes.io/projected/9932ec3d-848f-464c-8858-924a6bd4c937-kube-api-access-n9kq7\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:36:44.194734 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.194726 2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9932ec3d-848f-464c-8858-924a6bd4c937-webhook-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:36:44.504160 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.504120 2553 generic.go:356] "Generic (PLEG): container finished" podID="9932ec3d-848f-464c-8858-924a6bd4c937" containerID="9078878eb48b592a51fcacf50fbc6b2bf185661df1de845b9c698a669a7f779a" exitCode=0 Jul 21 01:36:44.504390 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.504170 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb6957b54-6r4f6" Jul 21 01:36:44.504390 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.504223 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb6957b54-6r4f6" event={"ID":"9932ec3d-848f-464c-8858-924a6bd4c937","Type":"ContainerDied","Data":"9078878eb48b592a51fcacf50fbc6b2bf185661df1de845b9c698a669a7f779a"} Jul 21 01:36:44.504390 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.504288 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb6957b54-6r4f6" event={"ID":"9932ec3d-848f-464c-8858-924a6bd4c937","Type":"ContainerDied","Data":"1b747c4d8bed04994ba60cca75a10f6ea248217e5d6279045e9626af5baaafe0"} Jul 21 01:36:44.504390 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.504319 2553 scope.go:117] "RemoveContainer" containerID="9078878eb48b592a51fcacf50fbc6b2bf185661df1de845b9c698a669a7f779a" Jul 21 01:36:44.514422 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.514404 2553 scope.go:117] "RemoveContainer" containerID="9078878eb48b592a51fcacf50fbc6b2bf185661df1de845b9c698a669a7f779a" Jul 21 01:36:44.514702 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:36:44.514685 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9078878eb48b592a51fcacf50fbc6b2bf185661df1de845b9c698a669a7f779a\": container with ID starting with 9078878eb48b592a51fcacf50fbc6b2bf185661df1de845b9c698a669a7f779a not found: ID does not exist" containerID="9078878eb48b592a51fcacf50fbc6b2bf185661df1de845b9c698a669a7f779a" Jul 21 01:36:44.514751 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.514713 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9078878eb48b592a51fcacf50fbc6b2bf185661df1de845b9c698a669a7f779a"} err="failed to get container status \"9078878eb48b592a51fcacf50fbc6b2bf185661df1de845b9c698a669a7f779a\": rpc error: code = NotFound desc = could not find container \"9078878eb48b592a51fcacf50fbc6b2bf185661df1de845b9c698a669a7f779a\": container with ID starting with 9078878eb48b592a51fcacf50fbc6b2bf185661df1de845b9c698a669a7f779a not found: ID does not exist" Jul 21 01:36:44.536401 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.536365 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb6957b54-6r4f6"] Jul 21 01:36:44.539033 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.539011 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bb6957b54-6r4f6"] Jul 21 01:36:44.836383 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:36:44.836302 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9932ec3d-848f-464c-8858-924a6bd4c937" path="/var/lib/kubelet/pods/9932ec3d-848f-464c-8858-924a6bd4c937/volumes" Jul 21 01:37:00.785409 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:37:00.785327 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:37:00.786569 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:37:00.786548 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:37:00.792468 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:37:00.792446 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:37:00.793480 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:37:00.793460 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:42:00.825541 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:00.825512 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:42:00.826790 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:00.826765 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:42:00.837140 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:00.837111 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:42:00.838456 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:00.838437 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:42:51.451352 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:51.451310 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z"] Jul 21 01:42:51.452277 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:51.451544 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" podUID="95a353db-0a0f-4bc8-8775-27bad0db5a66" containerName="manager" containerID="cri-o://0d8c8bfee149c5666c90d38652716b4b45fdf7fc3c67e3b89419cadeb849009f" gracePeriod=10 Jul 21 01:42:54.738094 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:54.738058 2553 generic.go:356] "Generic (PLEG): container finished" podID="95a353db-0a0f-4bc8-8775-27bad0db5a66" containerID="0d8c8bfee149c5666c90d38652716b4b45fdf7fc3c67e3b89419cadeb849009f" exitCode=0 Jul 21 01:42:54.738487 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:54.738144 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" event={"ID":"95a353db-0a0f-4bc8-8775-27bad0db5a66","Type":"ContainerDied","Data":"0d8c8bfee149c5666c90d38652716b4b45fdf7fc3c67e3b89419cadeb849009f"} Jul 21 01:42:54.825916 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:54.825885 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" Jul 21 01:42:54.871926 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:54.871876 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs66z\" (UniqueName: \"kubernetes.io/projected/95a353db-0a0f-4bc8-8775-27bad0db5a66-kube-api-access-rs66z\") pod \"95a353db-0a0f-4bc8-8775-27bad0db5a66\" (UID: \"95a353db-0a0f-4bc8-8775-27bad0db5a66\") " Jul 21 01:42:54.872128 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:54.872045 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95a353db-0a0f-4bc8-8775-27bad0db5a66-extensions-socket-volume\") pod \"95a353db-0a0f-4bc8-8775-27bad0db5a66\" (UID: \"95a353db-0a0f-4bc8-8775-27bad0db5a66\") " Jul 21 01:42:54.872407 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:54.872381 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95a353db-0a0f-4bc8-8775-27bad0db5a66-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "95a353db-0a0f-4bc8-8775-27bad0db5a66" (UID: "95a353db-0a0f-4bc8-8775-27bad0db5a66"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:42:54.874214 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:54.874185 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95a353db-0a0f-4bc8-8775-27bad0db5a66-kube-api-access-rs66z" (OuterVolumeSpecName: "kube-api-access-rs66z") pod "95a353db-0a0f-4bc8-8775-27bad0db5a66" (UID: "95a353db-0a0f-4bc8-8775-27bad0db5a66"). InnerVolumeSpecName "kube-api-access-rs66z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:42:54.973478 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:54.973390 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95a353db-0a0f-4bc8-8775-27bad0db5a66-extensions-socket-volume\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:42:54.973478 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:54.973421 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs66z\" (UniqueName: \"kubernetes.io/projected/95a353db-0a0f-4bc8-8775-27bad0db5a66-kube-api-access-rs66z\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:42:55.745239 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:55.745202 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" Jul 21 01:42:55.745239 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:55.745213 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z" event={"ID":"95a353db-0a0f-4bc8-8775-27bad0db5a66","Type":"ContainerDied","Data":"cf58e377272df5587b85cce53076118b0f5a6cad70f3d774c0219fcbf619a433"} Jul 21 01:42:55.745761 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:55.745318 2553 scope.go:117] "RemoveContainer" containerID="0d8c8bfee149c5666c90d38652716b4b45fdf7fc3c67e3b89419cadeb849009f" Jul 21 01:42:55.768911 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:55.768889 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z"] Jul 21 01:42:55.775212 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:55.775190 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9r6z"] Jul 21 01:42:56.835810 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:42:56.835777 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95a353db-0a0f-4bc8-8775-27bad0db5a66" path="/var/lib/kubelet/pods/95a353db-0a0f-4bc8-8775-27bad0db5a66/volumes" Jul 21 01:43:52.565585 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.565539 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b"] Jul 21 01:43:52.566110 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.565999 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9932ec3d-848f-464c-8858-924a6bd4c937" containerName="manager" Jul 21 01:43:52.566110 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.566011 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9932ec3d-848f-464c-8858-924a6bd4c937" containerName="manager" Jul 21 01:43:52.566110 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.566030 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95a353db-0a0f-4bc8-8775-27bad0db5a66" containerName="manager" Jul 21 01:43:52.566110 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.566036 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="95a353db-0a0f-4bc8-8775-27bad0db5a66" containerName="manager" Jul 21 01:43:52.566110 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.566103 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="95a353db-0a0f-4bc8-8775-27bad0db5a66" containerName="manager" Jul 21 01:43:52.566110 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.566111 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9932ec3d-848f-464c-8858-924a6bd4c937" containerName="manager" Jul 21 01:43:52.569188 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.569172 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b" Jul 21 01:43:52.571968 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.571946 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pjmcg\"" Jul 21 01:43:52.579737 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.579714 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b"] Jul 21 01:43:52.698961 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.698926 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40914193-ef9a-4964-a822-ab0888884c7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dk67b\" (UID: \"40914193-ef9a-4964-a822-ab0888884c7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b" Jul 21 01:43:52.699147 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.698991 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r4n4\" (UniqueName: \"kubernetes.io/projected/40914193-ef9a-4964-a822-ab0888884c7b-kube-api-access-9r4n4\") pod \"kuadrant-operator-controller-manager-86878c769f-dk67b\" (UID: \"40914193-ef9a-4964-a822-ab0888884c7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b" Jul 21 01:43:52.800273 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.800232 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r4n4\" (UniqueName: \"kubernetes.io/projected/40914193-ef9a-4964-a822-ab0888884c7b-kube-api-access-9r4n4\") pod \"kuadrant-operator-controller-manager-86878c769f-dk67b\" (UID: \"40914193-ef9a-4964-a822-ab0888884c7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b" Jul 21 01:43:52.800489 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.800326 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40914193-ef9a-4964-a822-ab0888884c7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dk67b\" (UID: \"40914193-ef9a-4964-a822-ab0888884c7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b" Jul 21 01:43:52.800670 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.800652 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40914193-ef9a-4964-a822-ab0888884c7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dk67b\" (UID: \"40914193-ef9a-4964-a822-ab0888884c7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b" Jul 21 01:43:52.814068 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.814039 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r4n4\" (UniqueName: \"kubernetes.io/projected/40914193-ef9a-4964-a822-ab0888884c7b-kube-api-access-9r4n4\") pod \"kuadrant-operator-controller-manager-86878c769f-dk67b\" (UID: \"40914193-ef9a-4964-a822-ab0888884c7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b" Jul 21 01:43:52.880140 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:52.880042 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b" Jul 21 01:43:53.029657 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:53.029628 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b"] Jul 21 01:43:53.030844 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:43:53.030816 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40914193_ef9a_4964_a822_ab0888884c7b.slice/crio-c844403ee29a079a76fef91b3ed9055d09bb85580ea3dc91695d8782e48f9070 WatchSource:0}: Error finding container c844403ee29a079a76fef91b3ed9055d09bb85580ea3dc91695d8782e48f9070: Status 404 returned error can't find the container with id c844403ee29a079a76fef91b3ed9055d09bb85580ea3dc91695d8782e48f9070 Jul 21 01:43:53.061754 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:53.061729 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b" event={"ID":"40914193-ef9a-4964-a822-ab0888884c7b","Type":"ContainerStarted","Data":"c844403ee29a079a76fef91b3ed9055d09bb85580ea3dc91695d8782e48f9070"} Jul 21 01:43:54.070967 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:54.070923 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b" event={"ID":"40914193-ef9a-4964-a822-ab0888884c7b","Type":"ContainerStarted","Data":"9b407ab7fb95a4d0e3366ccac2b63c2ae327fc42bd0bbfb28dfd7d45795c52b6"} Jul 21 01:43:54.071366 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:54.071045 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b" Jul 21 01:43:54.096930 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:43:54.096879 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b" podStartSLOduration=2.096863424 podStartE2EDuration="2.096863424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:43:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:43:54.093498963 +0000 UTC m=+1313.780147519" watchObservedRunningTime="2026-07-21 01:43:54.096863424 +0000 UTC m=+1313.783511976" Jul 21 01:44:05.079488 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:44:05.079407 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dk67b" Jul 21 01:47:00.871565 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:47:00.871537 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:47:00.875097 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:47:00.875077 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:47:00.879364 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:47:00.879336 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:47:00.883058 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:47:00.883039 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:50:56.794655 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.794623 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp"] Jul 21 01:50:56.798551 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.798532 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.801393 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.801371 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-11e2e27d-openshift-default-dockercfg-pzdnl\"" Jul 21 01:50:56.821446 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.821421 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp"] Jul 21 01:50:56.854000 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.853968 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-workload-socket\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.854000 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.854002 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-token\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.854214 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.854032 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-data\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.854214 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.854052 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpxdg\" (UniqueName: \"kubernetes.io/projected/8dd06184-71d4-4518-a602-4c1ae50b5c9f-kube-api-access-wpxdg\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.854214 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.854080 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-workload-certs\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.854214 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.854104 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-credential-socket\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.854214 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.854120 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istiod-ca-cert\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.854214 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.854176 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-envoy\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.854416 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.854236 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-podinfo\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.955417 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.955382 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-envoy\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.955417 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.955427 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-podinfo\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.955666 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.955494 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-workload-socket\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.955666 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.955510 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-token\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.955666 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.955540 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-data\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.955841 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.955760 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpxdg\" (UniqueName: \"kubernetes.io/projected/8dd06184-71d4-4518-a602-4c1ae50b5c9f-kube-api-access-wpxdg\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.955919 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.955841 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-workload-certs\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.955919 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.955885 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-credential-socket\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.955919 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.955912 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istiod-ca-cert\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.956079 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.955949 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-data\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.956079 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.956001 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-workload-socket\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.956198 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.956179 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-workload-certs\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.956267 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.956250 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-credential-socket\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.956598 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.956581 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istiod-ca-cert\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.958005 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.957979 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-envoy\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.958608 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.958591 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-podinfo\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.963776 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.963751 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpxdg\" (UniqueName: \"kubernetes.io/projected/8dd06184-71d4-4518-a602-4c1ae50b5c9f-kube-api-access-wpxdg\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:56.964269 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:56.964249 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-token\") pod \"e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:57.109576 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:57.109477 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:57.263421 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:57.263395 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp"] Jul 21 01:50:57.265116 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:50:57.265076 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd06184_71d4_4518_a602_4c1ae50b5c9f.slice/crio-fdddfeb520e898f79f608b17649c1a18c22f5ab24472708539e334b86d5fc262 WatchSource:0}: Error finding container fdddfeb520e898f79f608b17649c1a18c22f5ab24472708539e334b86d5fc262: Status 404 returned error can't find the container with id fdddfeb520e898f79f608b17649c1a18c22f5ab24472708539e334b86d5fc262 Jul 21 01:50:57.267490 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:57.267452 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:50:57.267574 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:57.267545 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:50:57.267612 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:57.267587 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:50:57.573992 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:57.573957 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" event={"ID":"8dd06184-71d4-4518-a602-4c1ae50b5c9f","Type":"ContainerStarted","Data":"23d7db5b1971525dcb1f3410cdcea2a00564d46a88a90f82e732f765815f0c0b"} Jul 21 01:50:57.574175 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:57.574013 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" event={"ID":"8dd06184-71d4-4518-a602-4c1ae50b5c9f","Type":"ContainerStarted","Data":"fdddfeb520e898f79f608b17649c1a18c22f5ab24472708539e334b86d5fc262"} Jul 21 01:50:57.614141 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:57.614071 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" podStartSLOduration=1.6140462759999998 podStartE2EDuration="1.614046276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:50:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:50:57.610032195 +0000 UTC m=+1737.296680751" watchObservedRunningTime="2026-07-21 01:50:57.614046276 +0000 UTC m=+1737.300694832" Jul 21 01:50:58.110014 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:58.109976 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:58.115323 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:58.115286 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:58.579469 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:58.579442 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:50:58.580542 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:50:58.580515 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:51:10.658143 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:10.658107 2553 generic.go:356] "Generic (PLEG): container finished" podID="8dd06184-71d4-4518-a602-4c1ae50b5c9f" containerID="23d7db5b1971525dcb1f3410cdcea2a00564d46a88a90f82e732f765815f0c0b" exitCode=0 Jul 21 01:51:10.658595 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:10.658184 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" event={"ID":"8dd06184-71d4-4518-a602-4c1ae50b5c9f","Type":"ContainerDied","Data":"23d7db5b1971525dcb1f3410cdcea2a00564d46a88a90f82e732f765815f0c0b"} Jul 21 01:51:10.658722 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:10.658704 2553 scope.go:117] "RemoveContainer" containerID="23d7db5b1971525dcb1f3410cdcea2a00564d46a88a90f82e732f765815f0c0b" Jul 21 01:51:10.659964 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:10.659940 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:51:10.660033 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:10.660004 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:51:10.660083 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:10.660038 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:51:11.672158 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:11.672073 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" event={"ID":"8dd06184-71d4-4518-a602-4c1ae50b5c9f","Type":"ContainerStarted","Data":"13971ae89039cbac5907a131edd170a72174aa99b079c7efabcc8cbf7992d92b"} Jul 21 01:51:12.110247 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:12.110207 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:51:12.111526 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:12.111492 2553 patch_prober.go:28] interesting pod/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 21 01:51:12.111665 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:12.111563 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" podUID="8dd06184-71d4-4518-a602-4c1ae50b5c9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 21 01:51:13.109995 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:13.109958 2553 patch_prober.go:28] interesting pod/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 21 01:51:13.110420 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:13.110031 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" podUID="8dd06184-71d4-4518-a602-4c1ae50b5c9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 21 01:51:13.579977 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:13.579934 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:51:14.110388 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:14.110344 2553 patch_prober.go:28] interesting pod/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 21 01:51:14.110793 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:14.110408 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" podUID="8dd06184-71d4-4518-a602-4c1ae50b5c9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 21 01:51:15.109927 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:15.109888 2553 patch_prober.go:28] interesting pod/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 21 01:51:15.110113 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:15.109947 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" podUID="8dd06184-71d4-4518-a602-4c1ae50b5c9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 21 01:51:16.114270 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:16.114236 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:51:16.115300 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:16.115284 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:51:39.718847 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:39.718785 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp"] Jul 21 01:51:39.719455 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:39.719085 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" podUID="8dd06184-71d4-4518-a602-4c1ae50b5c9f" containerName="istio-proxy" containerID="cri-o://13971ae89039cbac5907a131edd170a72174aa99b079c7efabcc8cbf7992d92b" gracePeriod=30 Jul 21 01:51:40.742735 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.742700 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4"] Jul 21 01:51:40.746514 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.746490 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.749548 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.749520 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-18d78b1a-gw-openshift-default-dockercfg-8trh4\"" Jul 21 01:51:40.757933 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.757903 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4"] Jul 21 01:51:40.801675 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.801634 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-envoy\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.801675 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.801678 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-token\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.801967 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.801762 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-workload-socket\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.801967 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.801858 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-podinfo\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.801967 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.801892 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-credential-socket\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.802130 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.801970 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-workload-certs\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.802130 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.802000 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b47qh\" (UniqueName: \"kubernetes.io/projected/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-kube-api-access-b47qh\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.802130 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.802098 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-data\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.802255 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.802138 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istiod-ca-cert\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.903020 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.902982 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-workload-socket\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.903231 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.903038 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-podinfo\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.903231 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.903063 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-credential-socket\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.903231 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.903116 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-workload-certs\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.903231 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.903145 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47qh\" (UniqueName: \"kubernetes.io/projected/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-kube-api-access-b47qh\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.903231 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.903198 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-data\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.903231 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.903218 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istiod-ca-cert\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.903622 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.903427 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-envoy\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.903622 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.903468 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-credential-socket\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.903622 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.903481 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-token\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.903622 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.903528 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-workload-certs\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.903622 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.903592 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-data\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.903939 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.903706 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-workload-socket\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.904036 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.904015 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istiod-ca-cert\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.905750 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.905728 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-envoy\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.905977 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.905960 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-podinfo\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.911511 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.911485 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b47qh\" (UniqueName: \"kubernetes.io/projected/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-kube-api-access-b47qh\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:40.911601 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:40.911549 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-token\") pod \"e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:41.059463 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:41.059366 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:41.210387 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:41.210358 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4"] Jul 21 01:51:41.211540 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:51:41.211514 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f05fbf5_c726_44d1_9a1a_2ed0a72ff199.slice/crio-25f5c22b2b42fabbe7368bd59a47ade4883c17b3b4ee31e046748b2d5abde7d3 WatchSource:0}: Error finding container 25f5c22b2b42fabbe7368bd59a47ade4883c17b3b4ee31e046748b2d5abde7d3: Status 404 returned error can't find the container with id 25f5c22b2b42fabbe7368bd59a47ade4883c17b3b4ee31e046748b2d5abde7d3 Jul 21 01:51:41.213945 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:41.213914 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:51:41.214046 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:41.214019 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:51:41.214108 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:41.214071 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:51:41.853215 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:41.853182 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" event={"ID":"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199","Type":"ContainerStarted","Data":"77aa4d3463971f91bc7626e03a0bf7e3213e25daf925b4ea951a5e8b4112fe80"} Jul 21 01:51:41.853585 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:41.853235 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" event={"ID":"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199","Type":"ContainerStarted","Data":"25f5c22b2b42fabbe7368bd59a47ade4883c17b3b4ee31e046748b2d5abde7d3"} Jul 21 01:51:41.876030 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:41.875972 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" podStartSLOduration=1.8759547269999999 podStartE2EDuration="1.875954727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:51:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:51:41.874161666 +0000 UTC m=+1781.560810217" watchObservedRunningTime="2026-07-21 01:51:41.875954727 +0000 UTC m=+1781.562603364" Jul 21 01:51:42.059619 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:42.059579 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:42.064886 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:42.064859 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:42.858891 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:42.858861 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:42.859926 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:42.859905 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:44.873438 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:44.873398 2553 generic.go:356] "Generic (PLEG): container finished" podID="8dd06184-71d4-4518-a602-4c1ae50b5c9f" containerID="13971ae89039cbac5907a131edd170a72174aa99b079c7efabcc8cbf7992d92b" exitCode=0 Jul 21 01:51:44.873943 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:44.873471 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" event={"ID":"8dd06184-71d4-4518-a602-4c1ae50b5c9f","Type":"ContainerDied","Data":"13971ae89039cbac5907a131edd170a72174aa99b079c7efabcc8cbf7992d92b"} Jul 21 01:51:44.873943 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:44.873536 2553 scope.go:117] "RemoveContainer" containerID="23d7db5b1971525dcb1f3410cdcea2a00564d46a88a90f82e732f765815f0c0b" Jul 21 01:51:44.994226 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:44.994168 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:51:45.046574 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.046536 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-data\") pod \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " Jul 21 01:51:45.046574 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.046581 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-workload-certs\") pod \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " Jul 21 01:51:45.046943 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.046669 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-token\") pod \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " Jul 21 01:51:45.046943 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.046699 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-envoy\") pod \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " Jul 21 01:51:45.046943 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.046733 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-credential-socket\") pod \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " Jul 21 01:51:45.046943 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.046843 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istiod-ca-cert\") pod \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " Jul 21 01:51:45.046943 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.046885 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpxdg\" (UniqueName: \"kubernetes.io/projected/8dd06184-71d4-4518-a602-4c1ae50b5c9f-kube-api-access-wpxdg\") pod \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " Jul 21 01:51:45.046943 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.046926 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-podinfo\") pod \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " Jul 21 01:51:45.047275 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.046984 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-workload-socket\") pod \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\" (UID: \"8dd06184-71d4-4518-a602-4c1ae50b5c9f\") " Jul 21 01:51:45.047395 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.047366 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-data" (OuterVolumeSpecName: "istio-data") pod "8dd06184-71d4-4518-a602-4c1ae50b5c9f" (UID: "8dd06184-71d4-4518-a602-4c1ae50b5c9f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:51:45.047931 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.047598 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8dd06184-71d4-4518-a602-4c1ae50b5c9f" (UID: "8dd06184-71d4-4518-a602-4c1ae50b5c9f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:51:45.047931 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.047671 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8dd06184-71d4-4518-a602-4c1ae50b5c9f" (UID: "8dd06184-71d4-4518-a602-4c1ae50b5c9f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:51:45.048494 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.048457 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8dd06184-71d4-4518-a602-4c1ae50b5c9f" (UID: "8dd06184-71d4-4518-a602-4c1ae50b5c9f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:51:45.048608 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.048543 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8dd06184-71d4-4518-a602-4c1ae50b5c9f" (UID: "8dd06184-71d4-4518-a602-4c1ae50b5c9f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:51:45.050296 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.050270 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-token" (OuterVolumeSpecName: "istio-token") pod "8dd06184-71d4-4518-a602-4c1ae50b5c9f" (UID: "8dd06184-71d4-4518-a602-4c1ae50b5c9f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:51:45.050505 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.050474 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dd06184-71d4-4518-a602-4c1ae50b5c9f-kube-api-access-wpxdg" (OuterVolumeSpecName: "kube-api-access-wpxdg") pod "8dd06184-71d4-4518-a602-4c1ae50b5c9f" (UID: "8dd06184-71d4-4518-a602-4c1ae50b5c9f"). InnerVolumeSpecName "kube-api-access-wpxdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:51:45.050868 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.050843 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8dd06184-71d4-4518-a602-4c1ae50b5c9f" (UID: "8dd06184-71d4-4518-a602-4c1ae50b5c9f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:51:45.050961 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.050878 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8dd06184-71d4-4518-a602-4c1ae50b5c9f" (UID: "8dd06184-71d4-4518-a602-4c1ae50b5c9f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 01:51:45.148808 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.148759 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:51:45.148808 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.148793 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:51:45.148808 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.148816 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:51:45.149051 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.148825 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:51:45.149051 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.148835 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpxdg\" (UniqueName: \"kubernetes.io/projected/8dd06184-71d4-4518-a602-4c1ae50b5c9f-kube-api-access-wpxdg\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:51:45.149051 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.148844 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:51:45.149051 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.148852 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:51:45.149051 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.148860 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:51:45.149051 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.148867 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dd06184-71d4-4518-a602-4c1ae50b5c9f-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:51:45.880269 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.880237 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" Jul 21 01:51:45.880269 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.880262 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp" event={"ID":"8dd06184-71d4-4518-a602-4c1ae50b5c9f","Type":"ContainerDied","Data":"fdddfeb520e898f79f608b17649c1a18c22f5ab24472708539e334b86d5fc262"} Jul 21 01:51:45.880740 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.880330 2553 scope.go:117] "RemoveContainer" containerID="13971ae89039cbac5907a131edd170a72174aa99b079c7efabcc8cbf7992d92b" Jul 21 01:51:45.904193 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.904168 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp"] Jul 21 01:51:45.908300 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:45.908276 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-11e2e27d-openshift-default-797c9756b9-p5qcp"] Jul 21 01:51:46.838019 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:46.837978 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dd06184-71d4-4518-a602-4c1ae50b5c9f" path="/var/lib/kubelet/pods/8dd06184-71d4-4518-a602-4c1ae50b5c9f/volumes" Jul 21 01:51:57.860195 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:57.860162 2553 patch_prober.go:28] interesting pod/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 21 01:51:57.860641 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:57.860226 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" podUID="3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 21 01:51:57.961350 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:57.961317 2553 generic.go:356] "Generic (PLEG): container finished" podID="3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" containerID="77aa4d3463971f91bc7626e03a0bf7e3213e25daf925b4ea951a5e8b4112fe80" exitCode=0 Jul 21 01:51:57.961528 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:57.961400 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" event={"ID":"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199","Type":"ContainerDied","Data":"77aa4d3463971f91bc7626e03a0bf7e3213e25daf925b4ea951a5e8b4112fe80"} Jul 21 01:51:57.961865 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:57.961849 2553 scope.go:117] "RemoveContainer" containerID="77aa4d3463971f91bc7626e03a0bf7e3213e25daf925b4ea951a5e8b4112fe80" Jul 21 01:51:57.962942 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:57.962917 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:51:57.963026 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:57.962989 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:51:57.963068 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:57.963024 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:51:58.973708 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:58.973667 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" event={"ID":"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199","Type":"ContainerStarted","Data":"964e2f7b2ab6eae713b0e93b5064f99a0394b01ad32eda53f4499f873cc635a6"} Jul 21 01:51:59.063246 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:59.063200 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:51:59.063460 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:59.063341 2553 patch_prober.go:28] interesting pod/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 21 01:51:59.063460 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:51:59.063390 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" podUID="3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 21 01:52:00.060142 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:00.060100 2553 patch_prober.go:28] interesting pod/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 21 01:52:00.060757 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:00.060725 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" podUID="3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 21 01:52:00.909789 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:00.909760 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:52:00.914579 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:00.914555 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:52:00.917017 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:00.916995 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:52:00.921539 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:00.921523 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:52:01.060477 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:01.060428 2553 patch_prober.go:28] interesting pod/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 21 01:52:01.061016 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:01.060510 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" podUID="3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 21 01:52:02.060588 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:02.060537 2553 patch_prober.go:28] interesting pod/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 21 01:52:02.061126 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:02.060623 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" podUID="3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 21 01:52:03.064436 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:03.064401 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:52:03.064932 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:03.064832 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:52:03.065567 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:03.065547 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:52:23.521551 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:23.521517 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4"] Jul 21 01:52:23.522098 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:23.521761 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" podUID="3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" containerName="istio-proxy" containerID="cri-o://964e2f7b2ab6eae713b0e93b5064f99a0394b01ad32eda53f4499f873cc635a6" gracePeriod=30 Jul 21 01:52:24.446564 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.446524 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx"] Jul 21 01:52:24.447246 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.447223 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dd06184-71d4-4518-a602-4c1ae50b5c9f" containerName="istio-proxy" Jul 21 01:52:24.447319 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.447251 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dd06184-71d4-4518-a602-4c1ae50b5c9f" containerName="istio-proxy" Jul 21 01:52:24.447383 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.447371 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dd06184-71d4-4518-a602-4c1ae50b5c9f" containerName="istio-proxy" Jul 21 01:52:24.447419 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.447387 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dd06184-71d4-4518-a602-4c1ae50b5c9f" containerName="istio-proxy" Jul 21 01:52:24.452347 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.452324 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.455958 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.455933 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c01c70b7-openshift-default-dockercfg-w6dp5\"" Jul 21 01:52:24.468452 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.468425 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx"] Jul 21 01:52:24.523826 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.523763 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-credential-socket\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.524230 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.523846 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-workload-certs\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.524230 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.523895 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ffea569-2276-4f1c-b72d-58b14dad0de2-istiod-ca-cert\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.524230 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.523924 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-data\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.524230 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.523989 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-podinfo\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.524230 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.524045 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-envoy\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.524230 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.524086 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfvkz\" (UniqueName: \"kubernetes.io/projected/5ffea569-2276-4f1c-b72d-58b14dad0de2-kube-api-access-xfvkz\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.524230 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.524118 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-workload-socket\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.524230 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.524197 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-token\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.624961 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.624914 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-token\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.625148 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.624975 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-credential-socket\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.625148 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.625002 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-workload-certs\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.625148 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.625020 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ffea569-2276-4f1c-b72d-58b14dad0de2-istiod-ca-cert\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.625148 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.625038 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-data\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.625148 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.625079 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-podinfo\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.625148 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.625127 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-envoy\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.625477 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.625161 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfvkz\" (UniqueName: \"kubernetes.io/projected/5ffea569-2276-4f1c-b72d-58b14dad0de2-kube-api-access-xfvkz\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.625477 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.625190 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-workload-socket\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.625589 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.625498 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-workload-certs\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.625589 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.625577 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-workload-socket\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.625690 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.625607 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-data\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.625852 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.625830 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ffea569-2276-4f1c-b72d-58b14dad0de2-istiod-ca-cert\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.625944 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.625919 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-credential-socket\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.628315 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.628283 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-envoy\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.628520 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.628502 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-podinfo\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.633390 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.633365 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-token\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.633495 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.633460 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfvkz\" (UniqueName: \"kubernetes.io/projected/5ffea569-2276-4f1c-b72d-58b14dad0de2-kube-api-access-xfvkz\") pod \"e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.763292 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.763256 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:24.913487 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.913464 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx"] Jul 21 01:52:24.916022 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:52:24.915996 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ffea569_2276_4f1c_b72d_58b14dad0de2.slice/crio-3a526fb91beb7183246a134ebd4c0bf00dbae5825a8615bec256620d51c783ef WatchSource:0}: Error finding container 3a526fb91beb7183246a134ebd4c0bf00dbae5825a8615bec256620d51c783ef: Status 404 returned error can't find the container with id 3a526fb91beb7183246a134ebd4c0bf00dbae5825a8615bec256620d51c783ef Jul 21 01:52:24.918296 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.918265 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:52:24.918376 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.918350 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:52:24.918414 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:24.918379 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:52:25.135861 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:25.135753 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" event={"ID":"5ffea569-2276-4f1c-b72d-58b14dad0de2","Type":"ContainerStarted","Data":"a95f4b88b3f849741a97049b9eaacfd8bafbcf2295b599bbf4813cc89130993d"} Jul 21 01:52:25.135861 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:25.135830 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" event={"ID":"5ffea569-2276-4f1c-b72d-58b14dad0de2","Type":"ContainerStarted","Data":"3a526fb91beb7183246a134ebd4c0bf00dbae5825a8615bec256620d51c783ef"} Jul 21 01:52:25.160946 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:25.160890 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" podStartSLOduration=1.160874418 podStartE2EDuration="1.160874418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:52:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:52:25.158264368 +0000 UTC m=+1824.844912924" watchObservedRunningTime="2026-07-21 01:52:25.160874418 +0000 UTC m=+1824.847522972" Jul 21 01:52:25.764057 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:25.764016 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:25.769145 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:25.769119 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:26.141528 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:26.141437 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:26.142637 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:26.142611 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:28.798337 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.798313 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:52:28.871577 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.871545 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-podinfo\") pod \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " Jul 21 01:52:28.871738 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.871598 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-envoy\") pod \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " Jul 21 01:52:28.871738 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.871642 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b47qh\" (UniqueName: \"kubernetes.io/projected/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-kube-api-access-b47qh\") pod \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " Jul 21 01:52:28.871738 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.871679 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-workload-certs\") pod \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " Jul 21 01:52:28.871738 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.871698 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-data\") pod \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " Jul 21 01:52:28.871738 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.871725 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istiod-ca-cert\") pod \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " Jul 21 01:52:28.872024 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.871827 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-token\") pod \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " Jul 21 01:52:28.872024 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.871864 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-credential-socket\") pod \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " Jul 21 01:52:28.872024 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.871922 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-workload-socket\") pod \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\" (UID: \"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199\") " Jul 21 01:52:28.872024 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.872005 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" (UID: "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:52:28.872259 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.872222 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" (UID: "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:52:28.872259 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.872240 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" (UID: "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:52:28.872597 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.872574 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" (UID: "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:52:28.872752 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.872637 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:52:28.872873 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.872764 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:52:28.872873 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.872781 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:52:28.873251 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.873223 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" (UID: "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:52:28.874158 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.874134 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" (UID: "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:52:28.874158 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.874146 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" (UID: "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 01:52:28.874270 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.874163 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-kube-api-access-b47qh" (OuterVolumeSpecName: "kube-api-access-b47qh") pod "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" (UID: "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199"). InnerVolumeSpecName "kube-api-access-b47qh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:52:28.874270 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.874179 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" (UID: "3f05fbf5-c726-44d1-9a1a-2ed0a72ff199"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:52:28.974178 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.974139 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:52:28.974178 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.974172 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:52:28.974178 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.974181 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b47qh\" (UniqueName: \"kubernetes.io/projected/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-kube-api-access-b47qh\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:52:28.974422 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.974190 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:52:28.974422 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.974198 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:52:28.974422 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:28.974207 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:52:29.164850 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:29.164741 2553 generic.go:356] "Generic (PLEG): container finished" podID="3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" containerID="964e2f7b2ab6eae713b0e93b5064f99a0394b01ad32eda53f4499f873cc635a6" exitCode=0 Jul 21 01:52:29.164850 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:29.164784 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" event={"ID":"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199","Type":"ContainerDied","Data":"964e2f7b2ab6eae713b0e93b5064f99a0394b01ad32eda53f4499f873cc635a6"} Jul 21 01:52:29.164850 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:29.164813 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" Jul 21 01:52:29.164850 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:29.164845 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4" event={"ID":"3f05fbf5-c726-44d1-9a1a-2ed0a72ff199","Type":"ContainerDied","Data":"25f5c22b2b42fabbe7368bd59a47ade4883c17b3b4ee31e046748b2d5abde7d3"} Jul 21 01:52:29.165147 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:29.164869 2553 scope.go:117] "RemoveContainer" containerID="964e2f7b2ab6eae713b0e93b5064f99a0394b01ad32eda53f4499f873cc635a6" Jul 21 01:52:29.174963 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:29.174946 2553 scope.go:117] "RemoveContainer" containerID="77aa4d3463971f91bc7626e03a0bf7e3213e25daf925b4ea951a5e8b4112fe80" Jul 21 01:52:29.184596 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:29.184574 2553 scope.go:117] "RemoveContainer" containerID="964e2f7b2ab6eae713b0e93b5064f99a0394b01ad32eda53f4499f873cc635a6" Jul 21 01:52:29.184889 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:52:29.184866 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"964e2f7b2ab6eae713b0e93b5064f99a0394b01ad32eda53f4499f873cc635a6\": container with ID starting with 964e2f7b2ab6eae713b0e93b5064f99a0394b01ad32eda53f4499f873cc635a6 not found: ID does not exist" containerID="964e2f7b2ab6eae713b0e93b5064f99a0394b01ad32eda53f4499f873cc635a6" Jul 21 01:52:29.184953 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:29.184899 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"964e2f7b2ab6eae713b0e93b5064f99a0394b01ad32eda53f4499f873cc635a6"} err="failed to get container status \"964e2f7b2ab6eae713b0e93b5064f99a0394b01ad32eda53f4499f873cc635a6\": rpc error: code = NotFound desc = could not find container \"964e2f7b2ab6eae713b0e93b5064f99a0394b01ad32eda53f4499f873cc635a6\": container with ID starting with 964e2f7b2ab6eae713b0e93b5064f99a0394b01ad32eda53f4499f873cc635a6 not found: ID does not exist" Jul 21 01:52:29.184953 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:29.184917 2553 scope.go:117] "RemoveContainer" containerID="77aa4d3463971f91bc7626e03a0bf7e3213e25daf925b4ea951a5e8b4112fe80" Jul 21 01:52:29.185144 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:52:29.185124 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77aa4d3463971f91bc7626e03a0bf7e3213e25daf925b4ea951a5e8b4112fe80\": container with ID starting with 77aa4d3463971f91bc7626e03a0bf7e3213e25daf925b4ea951a5e8b4112fe80 not found: ID does not exist" containerID="77aa4d3463971f91bc7626e03a0bf7e3213e25daf925b4ea951a5e8b4112fe80" Jul 21 01:52:29.185181 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:29.185151 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77aa4d3463971f91bc7626e03a0bf7e3213e25daf925b4ea951a5e8b4112fe80"} err="failed to get container status \"77aa4d3463971f91bc7626e03a0bf7e3213e25daf925b4ea951a5e8b4112fe80\": rpc error: code = NotFound desc = could not find container \"77aa4d3463971f91bc7626e03a0bf7e3213e25daf925b4ea951a5e8b4112fe80\": container with ID starting with 77aa4d3463971f91bc7626e03a0bf7e3213e25daf925b4ea951a5e8b4112fe80 not found: ID does not exist" Jul 21 01:52:29.192234 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:29.192204 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4"] Jul 21 01:52:29.205776 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:29.205749 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-18d78b1a-gw-openshift-default-6545765779-k6bz4"] Jul 21 01:52:30.837776 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:30.837744 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" path="/var/lib/kubelet/pods/3f05fbf5-c726-44d1-9a1a-2ed0a72ff199/volumes" Jul 21 01:52:41.143508 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:41.143426 2553 patch_prober.go:28] interesting pod/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 21 01:52:41.143933 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:41.143497 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" podUID="5ffea569-2276-4f1c-b72d-58b14dad0de2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 21 01:52:41.239905 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:41.239870 2553 generic.go:356] "Generic (PLEG): container finished" podID="5ffea569-2276-4f1c-b72d-58b14dad0de2" containerID="a95f4b88b3f849741a97049b9eaacfd8bafbcf2295b599bbf4813cc89130993d" exitCode=0 Jul 21 01:52:41.240091 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:41.239926 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" event={"ID":"5ffea569-2276-4f1c-b72d-58b14dad0de2","Type":"ContainerDied","Data":"a95f4b88b3f849741a97049b9eaacfd8bafbcf2295b599bbf4813cc89130993d"} Jul 21 01:52:41.240354 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:41.240339 2553 scope.go:117] "RemoveContainer" containerID="a95f4b88b3f849741a97049b9eaacfd8bafbcf2295b599bbf4813cc89130993d" Jul 21 01:52:41.241470 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:41.241444 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:52:41.241527 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:41.241514 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:52:41.241567 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:41.241555 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:52:42.252177 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:42.252137 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" event={"ID":"5ffea569-2276-4f1c-b72d-58b14dad0de2","Type":"ContainerStarted","Data":"88316e791ef7856485349ee1e019b77fd5269c83f0e56f1c4d7f60e3eb5c9de2"} Jul 21 01:52:42.764009 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:42.763975 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:42.764438 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:42.764341 2553 patch_prober.go:28] interesting pod/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 21 01:52:42.764623 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:42.764600 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" podUID="5ffea569-2276-4f1c-b72d-58b14dad0de2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 21 01:52:43.764523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:43.764483 2553 patch_prober.go:28] interesting pod/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 21 01:52:43.765190 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:43.765154 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" podUID="5ffea569-2276-4f1c-b72d-58b14dad0de2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 21 01:52:44.764726 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:44.764684 2553 patch_prober.go:28] interesting pod/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 21 01:52:44.765375 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:44.765336 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" podUID="5ffea569-2276-4f1c-b72d-58b14dad0de2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 21 01:52:45.764228 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:45.764179 2553 patch_prober.go:28] interesting pod/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 21 01:52:45.764576 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:45.764545 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" podUID="5ffea569-2276-4f1c-b72d-58b14dad0de2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 21 01:52:46.768264 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:46.768234 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:46.768724 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:46.768648 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:52:46.769465 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:52:46.769447 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:53:08.617137 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:08.617106 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx"] Jul 21 01:53:08.617631 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:08.617336 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" podUID="5ffea569-2276-4f1c-b72d-58b14dad0de2" containerName="istio-proxy" containerID="cri-o://88316e791ef7856485349ee1e019b77fd5269c83f0e56f1c4d7f60e3eb5c9de2" gracePeriod=30 Jul 21 01:53:09.392424 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.392380 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2"] Jul 21 01:53:09.392881 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.392865 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" containerName="istio-proxy" Jul 21 01:53:09.392881 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.392881 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" containerName="istio-proxy" Jul 21 01:53:09.393016 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.392889 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dd06184-71d4-4518-a602-4c1ae50b5c9f" containerName="istio-proxy" Jul 21 01:53:09.393016 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.392895 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dd06184-71d4-4518-a602-4c1ae50b5c9f" containerName="istio-proxy" Jul 21 01:53:09.393016 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.392912 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" containerName="istio-proxy" Jul 21 01:53:09.393016 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.392921 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" containerName="istio-proxy" Jul 21 01:53:09.393016 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.392985 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" containerName="istio-proxy" Jul 21 01:53:09.393016 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.392997 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f05fbf5-c726-44d1-9a1a-2ed0a72ff199" containerName="istio-proxy" Jul 21 01:53:09.396145 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.396126 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.398917 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.398895 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-e1f6418d-openshift-default-dockercfg-kb6c5\"" Jul 21 01:53:09.409372 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.409349 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2"] Jul 21 01:53:09.457304 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.457261 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-istio-envoy\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.457304 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.457307 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-credential-socket\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.457558 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.457325 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-workload-certs\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.457558 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.457424 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-istio-data\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.457558 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.457469 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/642221ea-fd76-4615-8b85-46519a29eea1-istiod-ca-cert\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.457558 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.457510 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/642221ea-fd76-4615-8b85-46519a29eea1-istio-token\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.457755 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.457559 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56hh5\" (UniqueName: \"kubernetes.io/projected/642221ea-fd76-4615-8b85-46519a29eea1-kube-api-access-56hh5\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.457755 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.457636 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/642221ea-fd76-4615-8b85-46519a29eea1-istio-podinfo\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.457755 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.457669 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-workload-socket\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.559186 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.559150 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/642221ea-fd76-4615-8b85-46519a29eea1-istiod-ca-cert\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.559186 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.559191 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/642221ea-fd76-4615-8b85-46519a29eea1-istio-token\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.559451 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.559217 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56hh5\" (UniqueName: \"kubernetes.io/projected/642221ea-fd76-4615-8b85-46519a29eea1-kube-api-access-56hh5\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.559451 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.559260 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/642221ea-fd76-4615-8b85-46519a29eea1-istio-podinfo\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.559451 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.559280 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-workload-socket\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.559451 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.559317 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-istio-envoy\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.559451 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.559346 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-credential-socket\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.559451 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.559365 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-workload-certs\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.559451 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.559434 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-istio-data\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.559860 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.559730 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-workload-socket\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.559860 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.559831 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-credential-socket\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.559974 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.559904 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-workload-certs\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.560030 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.560014 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/642221ea-fd76-4615-8b85-46519a29eea1-istiod-ca-cert\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.560030 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.560025 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-istio-data\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.561736 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.561713 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-istio-envoy\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.561959 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.561942 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/642221ea-fd76-4615-8b85-46519a29eea1-istio-podinfo\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.568412 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.568384 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/642221ea-fd76-4615-8b85-46519a29eea1-istio-token\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.568525 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.568499 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56hh5\" (UniqueName: \"kubernetes.io/projected/642221ea-fd76-4615-8b85-46519a29eea1-kube-api-access-56hh5\") pod \"e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.706826 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.706722 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:09.857347 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.857316 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2"] Jul 21 01:53:09.859388 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:53:09.859361 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642221ea_fd76_4615_8b85_46519a29eea1.slice/crio-1325ede6fb2be900d741987af917bd68a8bdfddfa86631181b31ac5fbffb1d0e WatchSource:0}: Error finding container 1325ede6fb2be900d741987af917bd68a8bdfddfa86631181b31ac5fbffb1d0e: Status 404 returned error can't find the container with id 1325ede6fb2be900d741987af917bd68a8bdfddfa86631181b31ac5fbffb1d0e Jul 21 01:53:09.861778 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.861740 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:53:09.861898 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.861878 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:53:09.861946 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:09.861930 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:53:10.427695 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:10.427654 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" event={"ID":"642221ea-fd76-4615-8b85-46519a29eea1","Type":"ContainerStarted","Data":"e4c76d094260b543c97d85f656ea3f0918efd75ee8216ed170f4a28a4710d82b"} Jul 21 01:53:10.427902 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:10.427715 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" event={"ID":"642221ea-fd76-4615-8b85-46519a29eea1","Type":"ContainerStarted","Data":"1325ede6fb2be900d741987af917bd68a8bdfddfa86631181b31ac5fbffb1d0e"} Jul 21 01:53:10.450991 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:10.450928 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" podStartSLOduration=1.450904897 podStartE2EDuration="1.450904897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:53:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:53:10.447906325 +0000 UTC m=+1870.134554880" watchObservedRunningTime="2026-07-21 01:53:10.450904897 +0000 UTC m=+1870.137553453" Jul 21 01:53:10.707931 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:10.707841 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:10.713043 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:10.713016 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:11.433892 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:11.433854 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:11.434917 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:11.434894 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:13.886989 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:13.886927 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:53:14.005144 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.005102 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-podinfo\") pod \"5ffea569-2276-4f1c-b72d-58b14dad0de2\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " Jul 21 01:53:14.005326 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.005161 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-credential-socket\") pod \"5ffea569-2276-4f1c-b72d-58b14dad0de2\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " Jul 21 01:53:14.005326 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.005186 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-workload-socket\") pod \"5ffea569-2276-4f1c-b72d-58b14dad0de2\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " Jul 21 01:53:14.005326 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.005220 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-envoy\") pod \"5ffea569-2276-4f1c-b72d-58b14dad0de2\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " Jul 21 01:53:14.005326 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.005255 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-data\") pod \"5ffea569-2276-4f1c-b72d-58b14dad0de2\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " Jul 21 01:53:14.005326 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.005284 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-workload-certs\") pod \"5ffea569-2276-4f1c-b72d-58b14dad0de2\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " Jul 21 01:53:14.005592 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.005341 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-token\") pod \"5ffea569-2276-4f1c-b72d-58b14dad0de2\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " Jul 21 01:53:14.005592 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.005399 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ffea569-2276-4f1c-b72d-58b14dad0de2-istiod-ca-cert\") pod \"5ffea569-2276-4f1c-b72d-58b14dad0de2\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " Jul 21 01:53:14.005592 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.005429 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfvkz\" (UniqueName: \"kubernetes.io/projected/5ffea569-2276-4f1c-b72d-58b14dad0de2-kube-api-access-xfvkz\") pod \"5ffea569-2276-4f1c-b72d-58b14dad0de2\" (UID: \"5ffea569-2276-4f1c-b72d-58b14dad0de2\") " Jul 21 01:53:14.005592 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.005478 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ffea569-2276-4f1c-b72d-58b14dad0de2" (UID: "5ffea569-2276-4f1c-b72d-58b14dad0de2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:53:14.005592 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.005504 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ffea569-2276-4f1c-b72d-58b14dad0de2" (UID: "5ffea569-2276-4f1c-b72d-58b14dad0de2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:53:14.005879 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.005621 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ffea569-2276-4f1c-b72d-58b14dad0de2" (UID: "5ffea569-2276-4f1c-b72d-58b14dad0de2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:53:14.006106 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.006044 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:14.006106 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.006070 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:14.006106 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.006086 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:14.006272 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.006113 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ffea569-2276-4f1c-b72d-58b14dad0de2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ffea569-2276-4f1c-b72d-58b14dad0de2" (UID: "5ffea569-2276-4f1c-b72d-58b14dad0de2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:53:14.006422 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.006400 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ffea569-2276-4f1c-b72d-58b14dad0de2" (UID: "5ffea569-2276-4f1c-b72d-58b14dad0de2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:53:14.007614 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.007594 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ffea569-2276-4f1c-b72d-58b14dad0de2" (UID: "5ffea569-2276-4f1c-b72d-58b14dad0de2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 01:53:14.007614 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.007604 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ffea569-2276-4f1c-b72d-58b14dad0de2" (UID: "5ffea569-2276-4f1c-b72d-58b14dad0de2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:53:14.008173 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.008155 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ffea569-2276-4f1c-b72d-58b14dad0de2" (UID: "5ffea569-2276-4f1c-b72d-58b14dad0de2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:53:14.008246 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.008175 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ffea569-2276-4f1c-b72d-58b14dad0de2-kube-api-access-xfvkz" (OuterVolumeSpecName: "kube-api-access-xfvkz") pod "5ffea569-2276-4f1c-b72d-58b14dad0de2" (UID: "5ffea569-2276-4f1c-b72d-58b14dad0de2"). InnerVolumeSpecName "kube-api-access-xfvkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:53:14.106614 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.106577 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:14.106614 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.106605 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:14.106614 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.106614 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ffea569-2276-4f1c-b72d-58b14dad0de2-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:14.106614 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.106622 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfvkz\" (UniqueName: \"kubernetes.io/projected/5ffea569-2276-4f1c-b72d-58b14dad0de2-kube-api-access-xfvkz\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:14.106923 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.106630 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:14.106923 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.106639 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ffea569-2276-4f1c-b72d-58b14dad0de2-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:14.453879 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.453843 2553 generic.go:356] "Generic (PLEG): container finished" podID="5ffea569-2276-4f1c-b72d-58b14dad0de2" containerID="88316e791ef7856485349ee1e019b77fd5269c83f0e56f1c4d7f60e3eb5c9de2" exitCode=0 Jul 21 01:53:14.454068 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.453902 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" event={"ID":"5ffea569-2276-4f1c-b72d-58b14dad0de2","Type":"ContainerDied","Data":"88316e791ef7856485349ee1e019b77fd5269c83f0e56f1c4d7f60e3eb5c9de2"} Jul 21 01:53:14.454068 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.453951 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" event={"ID":"5ffea569-2276-4f1c-b72d-58b14dad0de2","Type":"ContainerDied","Data":"3a526fb91beb7183246a134ebd4c0bf00dbae5825a8615bec256620d51c783ef"} Jul 21 01:53:14.454068 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.453975 2553 scope.go:117] "RemoveContainer" containerID="88316e791ef7856485349ee1e019b77fd5269c83f0e56f1c4d7f60e3eb5c9de2" Jul 21 01:53:14.454068 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.453905 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx" Jul 21 01:53:14.464851 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.464832 2553 scope.go:117] "RemoveContainer" containerID="a95f4b88b3f849741a97049b9eaacfd8bafbcf2295b599bbf4813cc89130993d" Jul 21 01:53:14.474042 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.474021 2553 scope.go:117] "RemoveContainer" containerID="88316e791ef7856485349ee1e019b77fd5269c83f0e56f1c4d7f60e3eb5c9de2" Jul 21 01:53:14.474315 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:53:14.474296 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88316e791ef7856485349ee1e019b77fd5269c83f0e56f1c4d7f60e3eb5c9de2\": container with ID starting with 88316e791ef7856485349ee1e019b77fd5269c83f0e56f1c4d7f60e3eb5c9de2 not found: ID does not exist" containerID="88316e791ef7856485349ee1e019b77fd5269c83f0e56f1c4d7f60e3eb5c9de2" Jul 21 01:53:14.474365 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.474326 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88316e791ef7856485349ee1e019b77fd5269c83f0e56f1c4d7f60e3eb5c9de2"} err="failed to get container status \"88316e791ef7856485349ee1e019b77fd5269c83f0e56f1c4d7f60e3eb5c9de2\": rpc error: code = NotFound desc = could not find container \"88316e791ef7856485349ee1e019b77fd5269c83f0e56f1c4d7f60e3eb5c9de2\": container with ID starting with 88316e791ef7856485349ee1e019b77fd5269c83f0e56f1c4d7f60e3eb5c9de2 not found: ID does not exist" Jul 21 01:53:14.474365 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.474344 2553 scope.go:117] "RemoveContainer" containerID="a95f4b88b3f849741a97049b9eaacfd8bafbcf2295b599bbf4813cc89130993d" Jul 21 01:53:14.474661 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:53:14.474638 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a95f4b88b3f849741a97049b9eaacfd8bafbcf2295b599bbf4813cc89130993d\": container with ID starting with a95f4b88b3f849741a97049b9eaacfd8bafbcf2295b599bbf4813cc89130993d not found: ID does not exist" containerID="a95f4b88b3f849741a97049b9eaacfd8bafbcf2295b599bbf4813cc89130993d" Jul 21 01:53:14.474787 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.474664 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a95f4b88b3f849741a97049b9eaacfd8bafbcf2295b599bbf4813cc89130993d"} err="failed to get container status \"a95f4b88b3f849741a97049b9eaacfd8bafbcf2295b599bbf4813cc89130993d\": rpc error: code = NotFound desc = could not find container \"a95f4b88b3f849741a97049b9eaacfd8bafbcf2295b599bbf4813cc89130993d\": container with ID starting with a95f4b88b3f849741a97049b9eaacfd8bafbcf2295b599bbf4813cc89130993d not found: ID does not exist" Jul 21 01:53:14.478004 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.477982 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx"] Jul 21 01:53:14.481948 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.481925 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c01c70b7-openshift-default-67f6954c8f-klmxx"] Jul 21 01:53:14.836715 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:14.836680 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ffea569-2276-4f1c-b72d-58b14dad0de2" path="/var/lib/kubelet/pods/5ffea569-2276-4f1c-b72d-58b14dad0de2/volumes" Jul 21 01:53:23.523763 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:23.523726 2553 generic.go:356] "Generic (PLEG): container finished" podID="642221ea-fd76-4615-8b85-46519a29eea1" containerID="e4c76d094260b543c97d85f656ea3f0918efd75ee8216ed170f4a28a4710d82b" exitCode=0 Jul 21 01:53:23.524208 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:23.523812 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" event={"ID":"642221ea-fd76-4615-8b85-46519a29eea1","Type":"ContainerDied","Data":"e4c76d094260b543c97d85f656ea3f0918efd75ee8216ed170f4a28a4710d82b"} Jul 21 01:53:23.524264 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:23.524244 2553 scope.go:117] "RemoveContainer" containerID="e4c76d094260b543c97d85f656ea3f0918efd75ee8216ed170f4a28a4710d82b" Jul 21 01:53:23.525360 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:23.525331 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:53:23.525472 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:23.525400 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:53:23.525472 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:23.525437 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:53:24.531880 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:24.531842 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" event={"ID":"642221ea-fd76-4615-8b85-46519a29eea1","Type":"ContainerStarted","Data":"05a8334e6c896d6bac44b9151eda1132483987df1cde19dc4f59efc32a9159ec"} Jul 21 01:53:24.707955 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:24.707914 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:24.709210 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:24.709183 2553 patch_prober.go:28] interesting pod/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 21 01:53:24.709324 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:24.709233 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" podUID="642221ea-fd76-4615-8b85-46519a29eea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 21 01:53:25.707747 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:25.707712 2553 patch_prober.go:28] interesting pod/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 21 01:53:25.708157 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:25.707768 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" podUID="642221ea-fd76-4615-8b85-46519a29eea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 21 01:53:26.434496 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:26.434456 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:26.707939 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:26.707848 2553 patch_prober.go:28] interesting pod/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 21 01:53:26.707939 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:26.707923 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" podUID="642221ea-fd76-4615-8b85-46519a29eea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 21 01:53:27.707526 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:27.707488 2553 patch_prober.go:28] interesting pod/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 21 01:53:27.707717 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:27.707541 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" podUID="642221ea-fd76-4615-8b85-46519a29eea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 21 01:53:28.711399 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:28.711365 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:28.712277 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:28.712253 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:51.953528 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:51.953492 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2"] Jul 21 01:53:51.954175 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:51.953773 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" podUID="642221ea-fd76-4615-8b85-46519a29eea1" containerName="istio-proxy" containerID="cri-o://05a8334e6c896d6bac44b9151eda1132483987df1cde19dc4f59efc32a9159ec" gracePeriod=30 Jul 21 01:53:57.227007 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.226986 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:57.329729 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.329695 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-istio-envoy\") pod \"642221ea-fd76-4615-8b85-46519a29eea1\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " Jul 21 01:53:57.329729 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.329738 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-workload-certs\") pod \"642221ea-fd76-4615-8b85-46519a29eea1\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " Jul 21 01:53:57.330028 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.329763 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/642221ea-fd76-4615-8b85-46519a29eea1-istio-token\") pod \"642221ea-fd76-4615-8b85-46519a29eea1\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " Jul 21 01:53:57.330028 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.329810 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-credential-socket\") pod \"642221ea-fd76-4615-8b85-46519a29eea1\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " Jul 21 01:53:57.330028 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.329860 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/642221ea-fd76-4615-8b85-46519a29eea1-istio-podinfo\") pod \"642221ea-fd76-4615-8b85-46519a29eea1\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " Jul 21 01:53:57.330028 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.329889 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-workload-socket\") pod \"642221ea-fd76-4615-8b85-46519a29eea1\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " Jul 21 01:53:57.330028 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.329927 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/642221ea-fd76-4615-8b85-46519a29eea1-istiod-ca-cert\") pod \"642221ea-fd76-4615-8b85-46519a29eea1\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " Jul 21 01:53:57.330028 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.329956 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56hh5\" (UniqueName: \"kubernetes.io/projected/642221ea-fd76-4615-8b85-46519a29eea1-kube-api-access-56hh5\") pod \"642221ea-fd76-4615-8b85-46519a29eea1\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " Jul 21 01:53:57.330028 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.330004 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-istio-data\") pod \"642221ea-fd76-4615-8b85-46519a29eea1\" (UID: \"642221ea-fd76-4615-8b85-46519a29eea1\") " Jul 21 01:53:57.330445 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.330063 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "642221ea-fd76-4615-8b85-46519a29eea1" (UID: "642221ea-fd76-4615-8b85-46519a29eea1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:53:57.330445 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.330147 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "642221ea-fd76-4615-8b85-46519a29eea1" (UID: "642221ea-fd76-4615-8b85-46519a29eea1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:53:57.330445 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.330296 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "642221ea-fd76-4615-8b85-46519a29eea1" (UID: "642221ea-fd76-4615-8b85-46519a29eea1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:53:57.330445 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.330379 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/642221ea-fd76-4615-8b85-46519a29eea1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "642221ea-fd76-4615-8b85-46519a29eea1" (UID: "642221ea-fd76-4615-8b85-46519a29eea1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:53:57.330445 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.330386 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:57.330445 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.330421 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:57.330445 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.330437 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:57.331355 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.331327 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-istio-data" (OuterVolumeSpecName: "istio-data") pod "642221ea-fd76-4615-8b85-46519a29eea1" (UID: "642221ea-fd76-4615-8b85-46519a29eea1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:53:57.332428 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.332397 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/642221ea-fd76-4615-8b85-46519a29eea1-kube-api-access-56hh5" (OuterVolumeSpecName: "kube-api-access-56hh5") pod "642221ea-fd76-4615-8b85-46519a29eea1" (UID: "642221ea-fd76-4615-8b85-46519a29eea1"). InnerVolumeSpecName "kube-api-access-56hh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:53:57.332573 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.332558 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/642221ea-fd76-4615-8b85-46519a29eea1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "642221ea-fd76-4615-8b85-46519a29eea1" (UID: "642221ea-fd76-4615-8b85-46519a29eea1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 01:53:57.332674 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.332660 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "642221ea-fd76-4615-8b85-46519a29eea1" (UID: "642221ea-fd76-4615-8b85-46519a29eea1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:53:57.332735 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.332692 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/642221ea-fd76-4615-8b85-46519a29eea1-istio-token" (OuterVolumeSpecName: "istio-token") pod "642221ea-fd76-4615-8b85-46519a29eea1" (UID: "642221ea-fd76-4615-8b85-46519a29eea1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:53:57.431085 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.431048 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/642221ea-fd76-4615-8b85-46519a29eea1-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:57.431085 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.431086 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/642221ea-fd76-4615-8b85-46519a29eea1-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:57.431296 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.431103 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56hh5\" (UniqueName: \"kubernetes.io/projected/642221ea-fd76-4615-8b85-46519a29eea1-kube-api-access-56hh5\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:57.431296 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.431120 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:57.431296 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.431134 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/642221ea-fd76-4615-8b85-46519a29eea1-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:57.431296 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.431147 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/642221ea-fd76-4615-8b85-46519a29eea1-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:53:57.736097 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.736065 2553 generic.go:356] "Generic (PLEG): container finished" podID="642221ea-fd76-4615-8b85-46519a29eea1" containerID="05a8334e6c896d6bac44b9151eda1132483987df1cde19dc4f59efc32a9159ec" exitCode=0 Jul 21 01:53:57.736306 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.736115 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" Jul 21 01:53:57.736306 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.736153 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" event={"ID":"642221ea-fd76-4615-8b85-46519a29eea1","Type":"ContainerDied","Data":"05a8334e6c896d6bac44b9151eda1132483987df1cde19dc4f59efc32a9159ec"} Jul 21 01:53:57.736306 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.736230 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2" event={"ID":"642221ea-fd76-4615-8b85-46519a29eea1","Type":"ContainerDied","Data":"1325ede6fb2be900d741987af917bd68a8bdfddfa86631181b31ac5fbffb1d0e"} Jul 21 01:53:57.736306 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.736264 2553 scope.go:117] "RemoveContainer" containerID="05a8334e6c896d6bac44b9151eda1132483987df1cde19dc4f59efc32a9159ec" Jul 21 01:53:57.746643 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.746621 2553 scope.go:117] "RemoveContainer" containerID="e4c76d094260b543c97d85f656ea3f0918efd75ee8216ed170f4a28a4710d82b" Jul 21 01:53:57.755581 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.755561 2553 scope.go:117] "RemoveContainer" containerID="05a8334e6c896d6bac44b9151eda1132483987df1cde19dc4f59efc32a9159ec" Jul 21 01:53:57.755986 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:53:57.755902 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05a8334e6c896d6bac44b9151eda1132483987df1cde19dc4f59efc32a9159ec\": container with ID starting with 05a8334e6c896d6bac44b9151eda1132483987df1cde19dc4f59efc32a9159ec not found: ID does not exist" containerID="05a8334e6c896d6bac44b9151eda1132483987df1cde19dc4f59efc32a9159ec" Jul 21 01:53:57.756097 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.755983 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05a8334e6c896d6bac44b9151eda1132483987df1cde19dc4f59efc32a9159ec"} err="failed to get container status \"05a8334e6c896d6bac44b9151eda1132483987df1cde19dc4f59efc32a9159ec\": rpc error: code = NotFound desc = could not find container \"05a8334e6c896d6bac44b9151eda1132483987df1cde19dc4f59efc32a9159ec\": container with ID starting with 05a8334e6c896d6bac44b9151eda1132483987df1cde19dc4f59efc32a9159ec not found: ID does not exist" Jul 21 01:53:57.756097 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.756001 2553 scope.go:117] "RemoveContainer" containerID="e4c76d094260b543c97d85f656ea3f0918efd75ee8216ed170f4a28a4710d82b" Jul 21 01:53:57.756319 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:53:57.756283 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4c76d094260b543c97d85f656ea3f0918efd75ee8216ed170f4a28a4710d82b\": container with ID starting with e4c76d094260b543c97d85f656ea3f0918efd75ee8216ed170f4a28a4710d82b not found: ID does not exist" containerID="e4c76d094260b543c97d85f656ea3f0918efd75ee8216ed170f4a28a4710d82b" Jul 21 01:53:57.756429 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.756321 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4c76d094260b543c97d85f656ea3f0918efd75ee8216ed170f4a28a4710d82b"} err="failed to get container status \"e4c76d094260b543c97d85f656ea3f0918efd75ee8216ed170f4a28a4710d82b\": rpc error: code = NotFound desc = could not find container \"e4c76d094260b543c97d85f656ea3f0918efd75ee8216ed170f4a28a4710d82b\": container with ID starting with e4c76d094260b543c97d85f656ea3f0918efd75ee8216ed170f4a28a4710d82b not found: ID does not exist" Jul 21 01:53:57.758983 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.758963 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2"] Jul 21 01:53:57.763623 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:57.763603 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-e1f6418d-openshift-default-8c94989bc-gzmv2"] Jul 21 01:53:58.836437 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:53:58.836405 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="642221ea-fd76-4615-8b85-46519a29eea1" path="/var/lib/kubelet/pods/642221ea-fd76-4615-8b85-46519a29eea1/volumes" Jul 21 01:55:34.289311 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.289278 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j"] Jul 21 01:55:34.289754 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.289684 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ffea569-2276-4f1c-b72d-58b14dad0de2" containerName="istio-proxy" Jul 21 01:55:34.289754 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.289695 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ffea569-2276-4f1c-b72d-58b14dad0de2" containerName="istio-proxy" Jul 21 01:55:34.289754 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.289710 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="642221ea-fd76-4615-8b85-46519a29eea1" containerName="istio-proxy" Jul 21 01:55:34.289754 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.289715 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="642221ea-fd76-4615-8b85-46519a29eea1" containerName="istio-proxy" Jul 21 01:55:34.289754 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.289726 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="642221ea-fd76-4615-8b85-46519a29eea1" containerName="istio-proxy" Jul 21 01:55:34.289754 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.289732 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="642221ea-fd76-4615-8b85-46519a29eea1" containerName="istio-proxy" Jul 21 01:55:34.289976 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.289827 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ffea569-2276-4f1c-b72d-58b14dad0de2" containerName="istio-proxy" Jul 21 01:55:34.289976 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.289839 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ffea569-2276-4f1c-b72d-58b14dad0de2" containerName="istio-proxy" Jul 21 01:55:34.289976 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.289846 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="642221ea-fd76-4615-8b85-46519a29eea1" containerName="istio-proxy" Jul 21 01:55:34.289976 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.289852 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="642221ea-fd76-4615-8b85-46519a29eea1" containerName="istio-proxy" Jul 21 01:55:34.292959 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.292941 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.295639 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.295620 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a83ed288-openshift-default-dockercfg-sc5fm\"" Jul 21 01:55:34.319489 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.319451 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j"] Jul 21 01:55:34.449653 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.449609 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-workload-socket\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.449653 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.449655 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-workload-certs\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.449959 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.449683 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-podinfo\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.449959 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.449718 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-envoy\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.449959 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.449786 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-credential-socket\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.449959 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.449837 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istiod-ca-cert\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.449959 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.449891 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-data\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.449959 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.449916 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-token\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.449959 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.449952 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8j9l\" (UniqueName: \"kubernetes.io/projected/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-kube-api-access-g8j9l\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.551093 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.550998 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-workload-socket\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.551093 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.551044 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-workload-certs\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.551093 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.551069 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-podinfo\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.551375 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.551098 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-envoy\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.551375 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.551141 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-credential-socket\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.551375 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.551181 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istiod-ca-cert\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.551375 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.551235 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-data\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.551375 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.551258 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-token\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.551375 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.551296 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8j9l\" (UniqueName: \"kubernetes.io/projected/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-kube-api-access-g8j9l\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.551660 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.551465 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-workload-socket\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.551660 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.551501 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-workload-certs\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.551660 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.551553 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-credential-socket\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.551863 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.551841 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-data\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.552010 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.551990 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istiod-ca-cert\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.553858 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.553834 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-envoy\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.554077 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.554056 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-podinfo\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.560634 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.560605 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-token\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.560912 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.560894 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8j9l\" (UniqueName: \"kubernetes.io/projected/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-kube-api-access-g8j9l\") pod \"e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.603481 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.603439 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:34.751038 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.751006 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j"] Jul 21 01:55:34.752275 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:55:34.752241 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c6b1ec4_c990_4e7f_8c3c_ec7f8dc2c7fb.slice/crio-5dfe64e41c1365dc6cb3e4b54a1a8a2978060fa5e867084433e2e08ba67128ef WatchSource:0}: Error finding container 5dfe64e41c1365dc6cb3e4b54a1a8a2978060fa5e867084433e2e08ba67128ef: Status 404 returned error can't find the container with id 5dfe64e41c1365dc6cb3e4b54a1a8a2978060fa5e867084433e2e08ba67128ef Jul 21 01:55:34.754682 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.754642 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:55:34.754828 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.754728 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:55:34.754828 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:34.754772 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:55:35.323607 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:35.323569 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" event={"ID":"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb","Type":"ContainerStarted","Data":"b712f94e326163c23d6ed389b114e6ef47d458a635ee06f2cee762dc8671d150"} Jul 21 01:55:35.324013 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:35.323634 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" event={"ID":"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb","Type":"ContainerStarted","Data":"5dfe64e41c1365dc6cb3e4b54a1a8a2978060fa5e867084433e2e08ba67128ef"} Jul 21 01:55:35.349920 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:35.347418 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" podStartSLOduration=1.34739557 podStartE2EDuration="1.34739557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:55:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:55:35.343874409 +0000 UTC m=+2015.030522965" watchObservedRunningTime="2026-07-21 01:55:35.34739557 +0000 UTC m=+2015.034044128" Jul 21 01:55:35.604016 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:35.603928 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:35.609086 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:35.609059 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:36.329508 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:36.329482 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:36.330454 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:36.330428 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:51.331488 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:51.331404 2553 patch_prober.go:28] interesting pod/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 21 01:55:51.331488 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:51.331469 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" podUID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 21 01:55:51.424072 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:51.423980 2553 generic.go:356] "Generic (PLEG): container finished" podID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" containerID="b712f94e326163c23d6ed389b114e6ef47d458a635ee06f2cee762dc8671d150" exitCode=0 Jul 21 01:55:51.424239 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:51.424066 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" event={"ID":"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb","Type":"ContainerDied","Data":"b712f94e326163c23d6ed389b114e6ef47d458a635ee06f2cee762dc8671d150"} Jul 21 01:55:51.424481 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:51.424468 2553 scope.go:117] "RemoveContainer" containerID="b712f94e326163c23d6ed389b114e6ef47d458a635ee06f2cee762dc8671d150" Jul 21 01:55:51.425543 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:51.425517 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:55:51.425601 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:51.425589 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:55:51.425644 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:51.425619 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:55:52.432401 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:52.432363 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" event={"ID":"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb","Type":"ContainerStarted","Data":"bb24500014833377a8ff9340809dce7e45b6f7dc5f5f6f8f9963f61f177a9c49"} Jul 21 01:55:52.604393 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:52.604355 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:52.604626 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:52.604605 2553 patch_prober.go:28] interesting pod/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 21 01:55:52.604732 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:52.604658 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" podUID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 21 01:55:53.604230 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:53.604177 2553 patch_prober.go:28] interesting pod/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 21 01:55:53.604636 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:53.604246 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" podUID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 21 01:55:54.604466 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:54.604424 2553 patch_prober.go:28] interesting pod/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 21 01:55:54.604898 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:54.604494 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" podUID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 21 01:55:55.604565 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:55.604526 2553 patch_prober.go:28] interesting pod/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 21 01:55:55.604995 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:55.604604 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" podUID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 21 01:55:56.608766 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:56.608732 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:56.609183 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:56.609138 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:55:56.609946 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:55:56.609926 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:56:10.524375 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:10.524341 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j"] Jul 21 01:56:10.524973 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:10.524614 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" podUID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" containerName="istio-proxy" containerID="cri-o://bb24500014833377a8ff9340809dce7e45b6f7dc5f5f6f8f9963f61f177a9c49" gracePeriod=30 Jul 21 01:56:11.611891 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:11.611849 2553 patch_prober.go:28] interesting pod/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 21 01:56:11.612274 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:11.611912 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" podUID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 21 01:56:15.784561 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.784533 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:56:15.863426 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.863343 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-credential-socket\") pod \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " Jul 21 01:56:15.863590 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.863432 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-envoy\") pod \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " Jul 21 01:56:15.863590 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.863461 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-data\") pod \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " Jul 21 01:56:15.863590 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.863492 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8j9l\" (UniqueName: \"kubernetes.io/projected/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-kube-api-access-g8j9l\") pod \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " Jul 21 01:56:15.863590 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.863544 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istiod-ca-cert\") pod \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " Jul 21 01:56:15.863590 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.863573 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-podinfo\") pod \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " Jul 21 01:56:15.863883 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.863613 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-workload-certs\") pod \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " Jul 21 01:56:15.863883 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.863653 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" (UID: "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:56:15.863883 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.863717 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-workload-socket\") pod \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " Jul 21 01:56:15.863883 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.863781 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-token\") pod \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\" (UID: \"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb\") " Jul 21 01:56:15.864087 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.863986 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" (UID: "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:56:15.864087 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.864078 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" (UID: "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:56:15.864317 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.864297 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:56:15.864479 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.864464 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:56:15.864553 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.864483 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:56:15.864553 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.864331 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" (UID: "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:56:15.864553 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.864393 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" (UID: "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:56:15.866272 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.866244 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" (UID: "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 01:56:15.866272 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.866248 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" (UID: "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:56:15.866532 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.866514 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-kube-api-access-g8j9l" (OuterVolumeSpecName: "kube-api-access-g8j9l") pod "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" (UID: "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb"). InnerVolumeSpecName "kube-api-access-g8j9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:56:15.866587 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.866550 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" (UID: "6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:56:15.965455 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.965424 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:56:15.965455 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.965450 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:56:15.965455 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.965459 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8j9l\" (UniqueName: \"kubernetes.io/projected/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-kube-api-access-g8j9l\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:56:15.965683 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.965468 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:56:15.965683 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.965477 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:56:15.965683 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:15.965485 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:56:16.581964 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:16.581931 2553 generic.go:356] "Generic (PLEG): container finished" podID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" containerID="bb24500014833377a8ff9340809dce7e45b6f7dc5f5f6f8f9963f61f177a9c49" exitCode=0 Jul 21 01:56:16.582155 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:16.581983 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" Jul 21 01:56:16.582155 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:16.582021 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" event={"ID":"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb","Type":"ContainerDied","Data":"bb24500014833377a8ff9340809dce7e45b6f7dc5f5f6f8f9963f61f177a9c49"} Jul 21 01:56:16.582155 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:16.582076 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j" event={"ID":"6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb","Type":"ContainerDied","Data":"5dfe64e41c1365dc6cb3e4b54a1a8a2978060fa5e867084433e2e08ba67128ef"} Jul 21 01:56:16.582155 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:16.582105 2553 scope.go:117] "RemoveContainer" containerID="bb24500014833377a8ff9340809dce7e45b6f7dc5f5f6f8f9963f61f177a9c49" Jul 21 01:56:16.592562 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:16.592540 2553 scope.go:117] "RemoveContainer" containerID="b712f94e326163c23d6ed389b114e6ef47d458a635ee06f2cee762dc8671d150" Jul 21 01:56:16.602419 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:16.602397 2553 scope.go:117] "RemoveContainer" containerID="bb24500014833377a8ff9340809dce7e45b6f7dc5f5f6f8f9963f61f177a9c49" Jul 21 01:56:16.602757 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:56:16.602738 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb24500014833377a8ff9340809dce7e45b6f7dc5f5f6f8f9963f61f177a9c49\": container with ID starting with bb24500014833377a8ff9340809dce7e45b6f7dc5f5f6f8f9963f61f177a9c49 not found: ID does not exist" containerID="bb24500014833377a8ff9340809dce7e45b6f7dc5f5f6f8f9963f61f177a9c49" Jul 21 01:56:16.602875 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:16.602769 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb24500014833377a8ff9340809dce7e45b6f7dc5f5f6f8f9963f61f177a9c49"} err="failed to get container status \"bb24500014833377a8ff9340809dce7e45b6f7dc5f5f6f8f9963f61f177a9c49\": rpc error: code = NotFound desc = could not find container \"bb24500014833377a8ff9340809dce7e45b6f7dc5f5f6f8f9963f61f177a9c49\": container with ID starting with bb24500014833377a8ff9340809dce7e45b6f7dc5f5f6f8f9963f61f177a9c49 not found: ID does not exist" Jul 21 01:56:16.602875 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:16.602787 2553 scope.go:117] "RemoveContainer" containerID="b712f94e326163c23d6ed389b114e6ef47d458a635ee06f2cee762dc8671d150" Jul 21 01:56:16.603111 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:56:16.603091 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b712f94e326163c23d6ed389b114e6ef47d458a635ee06f2cee762dc8671d150\": container with ID starting with b712f94e326163c23d6ed389b114e6ef47d458a635ee06f2cee762dc8671d150 not found: ID does not exist" containerID="b712f94e326163c23d6ed389b114e6ef47d458a635ee06f2cee762dc8671d150" Jul 21 01:56:16.603171 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:16.603118 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b712f94e326163c23d6ed389b114e6ef47d458a635ee06f2cee762dc8671d150"} err="failed to get container status \"b712f94e326163c23d6ed389b114e6ef47d458a635ee06f2cee762dc8671d150\": rpc error: code = NotFound desc = could not find container \"b712f94e326163c23d6ed389b114e6ef47d458a635ee06f2cee762dc8671d150\": container with ID starting with b712f94e326163c23d6ed389b114e6ef47d458a635ee06f2cee762dc8671d150 not found: ID does not exist" Jul 21 01:56:16.604927 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:16.604901 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j"] Jul 21 01:56:16.608478 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:16.608454 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a83ed288-openshift-default-7c645574dc-6v62j"] Jul 21 01:56:16.837099 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:16.837020 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" path="/var/lib/kubelet/pods/6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb/volumes" Jul 21 01:56:29.912178 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.912143 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk"] Jul 21 01:56:29.912593 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.912579 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" containerName="istio-proxy" Jul 21 01:56:29.912593 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.912591 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" containerName="istio-proxy" Jul 21 01:56:29.912666 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.912607 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ffea569-2276-4f1c-b72d-58b14dad0de2" containerName="istio-proxy" Jul 21 01:56:29.912666 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.912612 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ffea569-2276-4f1c-b72d-58b14dad0de2" containerName="istio-proxy" Jul 21 01:56:29.912732 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.912680 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" containerName="istio-proxy" Jul 21 01:56:29.912732 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.912691 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" containerName="istio-proxy" Jul 21 01:56:29.915841 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.915824 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:29.918566 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.918549 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-12818e85-openshift-default-dockercfg-l47ww\"" Jul 21 01:56:29.925638 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.925612 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk"] Jul 21 01:56:29.989508 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.989465 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t87ht\" (UniqueName: \"kubernetes.io/projected/8a236329-b329-4716-a67a-0095ec2dbb6c-kube-api-access-t87ht\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:29.989508 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.989510 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-credential-socket\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:29.989741 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.989625 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-token\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:29.989741 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.989668 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-data\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:29.989741 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.989687 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-envoy\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:29.989883 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.989734 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-workload-certs\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:29.989883 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.989759 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-podinfo\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:29.989883 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.989776 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a236329-b329-4716-a67a-0095ec2dbb6c-istiod-ca-cert\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:29.989883 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:29.989793 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-workload-socket\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.090455 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.090413 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t87ht\" (UniqueName: \"kubernetes.io/projected/8a236329-b329-4716-a67a-0095ec2dbb6c-kube-api-access-t87ht\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.090455 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.090454 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-credential-socket\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.090740 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.090510 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-token\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.090740 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.090535 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-data\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.090740 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.090552 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-envoy\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.090740 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.090580 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-workload-certs\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.090740 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.090604 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-podinfo\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.090740 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.090629 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a236329-b329-4716-a67a-0095ec2dbb6c-istiod-ca-cert\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.090740 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.090653 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-workload-socket\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.091158 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.091011 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-data\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.091158 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.091067 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-credential-socket\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.091158 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.091131 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-workload-certs\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.091158 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.091155 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-workload-socket\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.091416 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.091399 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a236329-b329-4716-a67a-0095ec2dbb6c-istiod-ca-cert\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.093096 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.093073 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-envoy\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.093281 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.093259 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-podinfo\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.099060 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.099040 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-token\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.099344 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.099328 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t87ht\" (UniqueName: \"kubernetes.io/projected/8a236329-b329-4716-a67a-0095ec2dbb6c-kube-api-access-t87ht\") pod \"e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.227618 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.227589 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:30.391554 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.391524 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk"] Jul 21 01:56:30.393539 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.393505 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:56:30.393686 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.393645 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:56:30.393759 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.393720 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:56:30.664922 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.664831 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" event={"ID":"8a236329-b329-4716-a67a-0095ec2dbb6c","Type":"ContainerStarted","Data":"b27f135b72ededc091341f50e5a36437e02444fffd6aeade192bef5eed076197"} Jul 21 01:56:30.664922 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.664892 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" event={"ID":"8a236329-b329-4716-a67a-0095ec2dbb6c","Type":"ContainerStarted","Data":"831ce35154dfe3a8ad0a2c47b89f9f4744961d1eb53924cd3da233e646c20afe"} Jul 21 01:56:30.684980 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:30.684931 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" podStartSLOduration=1.684914997 podStartE2EDuration="1.684914997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:56:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:56:30.68342807 +0000 UTC m=+2070.370076624" watchObservedRunningTime="2026-07-21 01:56:30.684914997 +0000 UTC m=+2070.371563552" Jul 21 01:56:31.228515 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:31.228483 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:31.233452 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:31.233428 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:31.670879 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:31.670776 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:31.671825 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:31.671782 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:46.672480 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:46.672442 2553 patch_prober.go:28] interesting pod/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 21 01:56:46.672952 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:46.672520 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" podUID="8a236329-b329-4716-a67a-0095ec2dbb6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 21 01:56:46.763532 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:46.763497 2553 generic.go:356] "Generic (PLEG): container finished" podID="8a236329-b329-4716-a67a-0095ec2dbb6c" containerID="b27f135b72ededc091341f50e5a36437e02444fffd6aeade192bef5eed076197" exitCode=0 Jul 21 01:56:46.763737 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:46.763571 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" event={"ID":"8a236329-b329-4716-a67a-0095ec2dbb6c","Type":"ContainerDied","Data":"b27f135b72ededc091341f50e5a36437e02444fffd6aeade192bef5eed076197"} Jul 21 01:56:46.763995 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:46.763981 2553 scope.go:117] "RemoveContainer" containerID="b27f135b72ededc091341f50e5a36437e02444fffd6aeade192bef5eed076197" Jul 21 01:56:46.765031 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:46.765002 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:56:46.765142 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:46.765087 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:56:46.765204 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:46.765137 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:56:47.776317 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:47.776282 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" event={"ID":"8a236329-b329-4716-a67a-0095ec2dbb6c","Type":"ContainerStarted","Data":"210f5323ea7de1effa058fa636561c7ba5e94620c516f20c2d9c34fb9f894837"} Jul 21 01:56:48.227828 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:48.227785 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:48.227988 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:48.227969 2553 patch_prober.go:28] interesting pod/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 21 01:56:48.228056 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:48.228010 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" podUID="8a236329-b329-4716-a67a-0095ec2dbb6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 21 01:56:49.228393 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:49.228350 2553 patch_prober.go:28] interesting pod/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 21 01:56:49.228903 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:49.228433 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" podUID="8a236329-b329-4716-a67a-0095ec2dbb6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 21 01:56:50.228404 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:50.228366 2553 patch_prober.go:28] interesting pod/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 21 01:56:50.228825 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:50.228423 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" podUID="8a236329-b329-4716-a67a-0095ec2dbb6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 21 01:56:51.228450 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:51.228409 2553 patch_prober.go:28] interesting pod/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 21 01:56:51.228871 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:51.228482 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" podUID="8a236329-b329-4716-a67a-0095ec2dbb6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 21 01:56:52.232963 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:52.232932 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:52.233417 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:52.233330 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:56:52.234228 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:56:52.234211 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:57:00.947272 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:57:00.947243 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:57:00.953291 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:57:00.953263 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 01:57:00.954612 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:57:00.954588 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:57:00.960553 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:57:00.960534 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 01:58:26.312917 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:26.312878 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk"] Jul 21 01:58:26.313462 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:26.313148 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" podUID="8a236329-b329-4716-a67a-0095ec2dbb6c" containerName="istio-proxy" containerID="cri-o://210f5323ea7de1effa058fa636561c7ba5e94620c516f20c2d9c34fb9f894837" gracePeriod=30 Jul 21 01:58:31.583079 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.583017 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:58:31.686971 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.686933 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-envoy\") pod \"8a236329-b329-4716-a67a-0095ec2dbb6c\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " Jul 21 01:58:31.687173 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.687015 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-workload-socket\") pod \"8a236329-b329-4716-a67a-0095ec2dbb6c\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " Jul 21 01:58:31.687173 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.687037 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-credential-socket\") pod \"8a236329-b329-4716-a67a-0095ec2dbb6c\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " Jul 21 01:58:31.687173 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.687070 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-podinfo\") pod \"8a236329-b329-4716-a67a-0095ec2dbb6c\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " Jul 21 01:58:31.687173 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.687095 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-token\") pod \"8a236329-b329-4716-a67a-0095ec2dbb6c\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " Jul 21 01:58:31.687173 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.687115 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-workload-certs\") pod \"8a236329-b329-4716-a67a-0095ec2dbb6c\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " Jul 21 01:58:31.687173 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.687162 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a236329-b329-4716-a67a-0095ec2dbb6c-istiod-ca-cert\") pod \"8a236329-b329-4716-a67a-0095ec2dbb6c\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " Jul 21 01:58:31.687492 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.687215 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t87ht\" (UniqueName: \"kubernetes.io/projected/8a236329-b329-4716-a67a-0095ec2dbb6c-kube-api-access-t87ht\") pod \"8a236329-b329-4716-a67a-0095ec2dbb6c\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " Jul 21 01:58:31.687492 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.687246 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-data\") pod \"8a236329-b329-4716-a67a-0095ec2dbb6c\" (UID: \"8a236329-b329-4716-a67a-0095ec2dbb6c\") " Jul 21 01:58:31.687492 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.687358 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a236329-b329-4716-a67a-0095ec2dbb6c" (UID: "8a236329-b329-4716-a67a-0095ec2dbb6c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:58:31.687492 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.687373 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a236329-b329-4716-a67a-0095ec2dbb6c" (UID: "8a236329-b329-4716-a67a-0095ec2dbb6c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:58:31.687717 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.687570 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a236329-b329-4716-a67a-0095ec2dbb6c" (UID: "8a236329-b329-4716-a67a-0095ec2dbb6c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:58:31.687717 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.687608 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a236329-b329-4716-a67a-0095ec2dbb6c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a236329-b329-4716-a67a-0095ec2dbb6c" (UID: "8a236329-b329-4716-a67a-0095ec2dbb6c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 01:58:31.687717 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.687613 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:58:31.687717 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.687644 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:58:31.688389 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.688349 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a236329-b329-4716-a67a-0095ec2dbb6c" (UID: "8a236329-b329-4716-a67a-0095ec2dbb6c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:58:31.690048 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.690013 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a236329-b329-4716-a67a-0095ec2dbb6c" (UID: "8a236329-b329-4716-a67a-0095ec2dbb6c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 01:58:31.691280 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.691243 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a236329-b329-4716-a67a-0095ec2dbb6c-kube-api-access-t87ht" (OuterVolumeSpecName: "kube-api-access-t87ht") pod "8a236329-b329-4716-a67a-0095ec2dbb6c" (UID: "8a236329-b329-4716-a67a-0095ec2dbb6c"). InnerVolumeSpecName "kube-api-access-t87ht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:58:31.691381 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.691281 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a236329-b329-4716-a67a-0095ec2dbb6c" (UID: "8a236329-b329-4716-a67a-0095ec2dbb6c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 01:58:31.691517 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.691495 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a236329-b329-4716-a67a-0095ec2dbb6c" (UID: "8a236329-b329-4716-a67a-0095ec2dbb6c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 01:58:31.788440 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.788403 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t87ht\" (UniqueName: \"kubernetes.io/projected/8a236329-b329-4716-a67a-0095ec2dbb6c-kube-api-access-t87ht\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:58:31.788440 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.788434 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:58:31.788440 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.788443 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:58:31.788440 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.788451 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:58:31.788705 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.788459 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a236329-b329-4716-a67a-0095ec2dbb6c-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:58:31.788705 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.788467 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a236329-b329-4716-a67a-0095ec2dbb6c-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:58:31.788705 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:31.788474 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a236329-b329-4716-a67a-0095ec2dbb6c-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 01:58:32.384894 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:32.384862 2553 generic.go:356] "Generic (PLEG): container finished" podID="8a236329-b329-4716-a67a-0095ec2dbb6c" containerID="210f5323ea7de1effa058fa636561c7ba5e94620c516f20c2d9c34fb9f894837" exitCode=0 Jul 21 01:58:32.385095 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:32.384909 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" Jul 21 01:58:32.385095 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:32.384951 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" event={"ID":"8a236329-b329-4716-a67a-0095ec2dbb6c","Type":"ContainerDied","Data":"210f5323ea7de1effa058fa636561c7ba5e94620c516f20c2d9c34fb9f894837"} Jul 21 01:58:32.385095 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:32.385007 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk" event={"ID":"8a236329-b329-4716-a67a-0095ec2dbb6c","Type":"ContainerDied","Data":"831ce35154dfe3a8ad0a2c47b89f9f4744961d1eb53924cd3da233e646c20afe"} Jul 21 01:58:32.385095 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:32.385031 2553 scope.go:117] "RemoveContainer" containerID="210f5323ea7de1effa058fa636561c7ba5e94620c516f20c2d9c34fb9f894837" Jul 21 01:58:32.395575 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:32.395556 2553 scope.go:117] "RemoveContainer" containerID="b27f135b72ededc091341f50e5a36437e02444fffd6aeade192bef5eed076197" Jul 21 01:58:32.404378 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:32.404359 2553 scope.go:117] "RemoveContainer" containerID="210f5323ea7de1effa058fa636561c7ba5e94620c516f20c2d9c34fb9f894837" Jul 21 01:58:32.404645 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:58:32.404623 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"210f5323ea7de1effa058fa636561c7ba5e94620c516f20c2d9c34fb9f894837\": container with ID starting with 210f5323ea7de1effa058fa636561c7ba5e94620c516f20c2d9c34fb9f894837 not found: ID does not exist" containerID="210f5323ea7de1effa058fa636561c7ba5e94620c516f20c2d9c34fb9f894837" Jul 21 01:58:32.404715 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:32.404654 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"210f5323ea7de1effa058fa636561c7ba5e94620c516f20c2d9c34fb9f894837"} err="failed to get container status \"210f5323ea7de1effa058fa636561c7ba5e94620c516f20c2d9c34fb9f894837\": rpc error: code = NotFound desc = could not find container \"210f5323ea7de1effa058fa636561c7ba5e94620c516f20c2d9c34fb9f894837\": container with ID starting with 210f5323ea7de1effa058fa636561c7ba5e94620c516f20c2d9c34fb9f894837 not found: ID does not exist" Jul 21 01:58:32.404715 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:32.404699 2553 scope.go:117] "RemoveContainer" containerID="b27f135b72ededc091341f50e5a36437e02444fffd6aeade192bef5eed076197" Jul 21 01:58:32.405118 ip-10-0-132-244 kubenswrapper[2553]: E0721 01:58:32.405077 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b27f135b72ededc091341f50e5a36437e02444fffd6aeade192bef5eed076197\": container with ID starting with b27f135b72ededc091341f50e5a36437e02444fffd6aeade192bef5eed076197 not found: ID does not exist" containerID="b27f135b72ededc091341f50e5a36437e02444fffd6aeade192bef5eed076197" Jul 21 01:58:32.405199 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:32.405120 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b27f135b72ededc091341f50e5a36437e02444fffd6aeade192bef5eed076197"} err="failed to get container status \"b27f135b72ededc091341f50e5a36437e02444fffd6aeade192bef5eed076197\": rpc error: code = NotFound desc = could not find container \"b27f135b72ededc091341f50e5a36437e02444fffd6aeade192bef5eed076197\": container with ID starting with b27f135b72ededc091341f50e5a36437e02444fffd6aeade192bef5eed076197 not found: ID does not exist" Jul 21 01:58:32.408219 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:32.408193 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk"] Jul 21 01:58:32.414553 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:32.414533 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-12818e85-openshift-default-5b8cdc46bc-lr4hk"] Jul 21 01:58:32.836720 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:58:32.836687 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a236329-b329-4716-a67a-0095ec2dbb6c" path="/var/lib/kubelet/pods/8a236329-b329-4716-a67a-0095ec2dbb6c/volumes" Jul 21 01:59:22.466881 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.466767 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd"] Jul 21 01:59:22.467344 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.467328 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a236329-b329-4716-a67a-0095ec2dbb6c" containerName="istio-proxy" Jul 21 01:59:22.467387 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.467347 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a236329-b329-4716-a67a-0095ec2dbb6c" containerName="istio-proxy" Jul 21 01:59:22.467387 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.467356 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a236329-b329-4716-a67a-0095ec2dbb6c" containerName="istio-proxy" Jul 21 01:59:22.467387 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.467363 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a236329-b329-4716-a67a-0095ec2dbb6c" containerName="istio-proxy" Jul 21 01:59:22.467387 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.467375 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" containerName="istio-proxy" Jul 21 01:59:22.467387 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.467381 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c6b1ec4-c990-4e7f-8c3c-ec7f8dc2c7fb" containerName="istio-proxy" Jul 21 01:59:22.467578 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.467454 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a236329-b329-4716-a67a-0095ec2dbb6c" containerName="istio-proxy" Jul 21 01:59:22.467578 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.467460 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a236329-b329-4716-a67a-0095ec2dbb6c" containerName="istio-proxy" Jul 21 01:59:22.470779 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.470756 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.473843 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.473821 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-811ee7-openshift-default-dockercfg-lx8j9\"" Jul 21 01:59:22.482978 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.482956 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd"] Jul 21 01:59:22.566186 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.566146 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-podinfo\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.566358 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.566198 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq8qv\" (UniqueName: \"kubernetes.io/projected/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-kube-api-access-gq8qv\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.566358 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.566278 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-credential-socket\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.566358 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.566324 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-token\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.566527 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.566379 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-envoy\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.566527 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.566415 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-data\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.566641 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.566558 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istiod-ca-cert\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.566641 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.566632 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-workload-socket\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.566744 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.566673 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-workload-certs\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.667390 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.667346 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq8qv\" (UniqueName: \"kubernetes.io/projected/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-kube-api-access-gq8qv\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.667583 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.667452 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-credential-socket\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.667583 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.667502 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-token\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.667583 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.667534 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-envoy\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.667583 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.667564 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-data\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.667839 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.667610 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istiod-ca-cert\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.667839 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.667644 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-workload-socket\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.667839 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.667678 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-workload-certs\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.667839 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.667743 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-podinfo\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.668057 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.667958 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-credential-socket\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.668057 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.667980 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-data\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.668175 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.668068 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-workload-socket\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.668308 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.668288 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-workload-certs\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.668578 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.668555 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istiod-ca-cert\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.670016 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.669999 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-envoy\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.670602 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.670588 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-podinfo\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.675722 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.675691 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq8qv\" (UniqueName: \"kubernetes.io/projected/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-kube-api-access-gq8qv\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.676010 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.675990 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-token\") pod \"e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.782528 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.782485 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:22.932663 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.932629 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd"] Jul 21 01:59:22.934220 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:59:22.934190 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb361e9bd_cb3e_4bce_addb_5d158cbfd8a4.slice/crio-62e3dc409add9b6e39f10564c5b6e140c5b6988b26fbfe27d87fad54d60f0c7b WatchSource:0}: Error finding container 62e3dc409add9b6e39f10564c5b6e140c5b6988b26fbfe27d87fad54d60f0c7b: Status 404 returned error can't find the container with id 62e3dc409add9b6e39f10564c5b6e140c5b6988b26fbfe27d87fad54d60f0c7b Jul 21 01:59:22.936509 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.936479 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:59:22.936572 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.936544 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:59:22.936615 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:22.936571 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:59:23.700604 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:23.700567 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" event={"ID":"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4","Type":"ContainerStarted","Data":"c94a99dd9f623fa351597d1f8c0e71836aa6a8c7ee76e486d10dec38f493e96c"} Jul 21 01:59:23.701017 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:23.700624 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" event={"ID":"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4","Type":"ContainerStarted","Data":"62e3dc409add9b6e39f10564c5b6e140c5b6988b26fbfe27d87fad54d60f0c7b"} Jul 21 01:59:23.725083 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:23.725033 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" podStartSLOduration=1.7250145140000002 podStartE2EDuration="1.725014514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:59:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:59:23.722266918 +0000 UTC m=+2243.408915474" watchObservedRunningTime="2026-07-21 01:59:23.725014514 +0000 UTC m=+2243.411663069" Jul 21 01:59:23.783181 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:23.783150 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:23.788243 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:23.788216 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:24.707079 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:24.707044 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:24.708178 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:24.708153 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:30.959392 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:30.959355 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7"] Jul 21 01:59:30.964075 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:30.964054 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:30.967030 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:30.967005 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f35db9-openshift-default-dockercfg-hh56l\"" Jul 21 01:59:30.975526 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:30.975496 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7"] Jul 21 01:59:31.048116 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.048079 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-workload-certs\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.048359 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.048134 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-envoy\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.048359 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.048161 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-token\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.048359 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.048184 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18217c24-0f9e-4582-b4f7-ca2b6920344b-istiod-ca-cert\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.048359 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.048239 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-podinfo\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.048359 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.048283 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-credential-socket\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.048359 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.048338 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-data\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.048692 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.048381 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-workload-socket\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.048692 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.048479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s55kw\" (UniqueName: \"kubernetes.io/projected/18217c24-0f9e-4582-b4f7-ca2b6920344b-kube-api-access-s55kw\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.149841 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.149781 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s55kw\" (UniqueName: \"kubernetes.io/projected/18217c24-0f9e-4582-b4f7-ca2b6920344b-kube-api-access-s55kw\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.150086 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.149870 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-workload-certs\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.150086 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.149902 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-envoy\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.150086 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.149918 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-token\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.150086 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.149936 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18217c24-0f9e-4582-b4f7-ca2b6920344b-istiod-ca-cert\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.150086 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.149979 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-podinfo\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.150086 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.150001 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-credential-socket\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.150086 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.150049 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-data\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.150086 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.150089 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-workload-socket\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.150523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.150464 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-credential-socket\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.150523 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.150508 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-workload-certs\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.150929 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.150906 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-data\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.151031 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.151002 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-workload-socket\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.151240 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.151215 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18217c24-0f9e-4582-b4f7-ca2b6920344b-istiod-ca-cert\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.152541 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.152516 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-envoy\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.153198 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.153170 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-podinfo\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.158964 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.158941 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-token\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.159070 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.158976 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s55kw\" (UniqueName: \"kubernetes.io/projected/18217c24-0f9e-4582-b4f7-ca2b6920344b-kube-api-access-s55kw\") pod \"e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.277682 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.277648 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:31.439693 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.439665 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7"] Jul 21 01:59:31.441049 ip-10-0-132-244 kubenswrapper[2553]: W0721 01:59:31.441023 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18217c24_0f9e_4582_b4f7_ca2b6920344b.slice/crio-eb9fb388dc5be00667c7ceabacf442d5b5937c5b782438b78f84312f2f2e84bb WatchSource:0}: Error finding container eb9fb388dc5be00667c7ceabacf442d5b5937c5b782438b78f84312f2f2e84bb: Status 404 returned error can't find the container with id eb9fb388dc5be00667c7ceabacf442d5b5937c5b782438b78f84312f2f2e84bb Jul 21 01:59:31.443385 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.443350 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:59:31.443495 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.443439 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:59:31.443495 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.443486 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:59:31.749358 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.749127 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" event={"ID":"18217c24-0f9e-4582-b4f7-ca2b6920344b","Type":"ContainerStarted","Data":"1efd4f2a1be6c34361ab408c3c51152e41ccdbef91628460136b71e5cbb3d1ce"} Jul 21 01:59:31.749358 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.749206 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" event={"ID":"18217c24-0f9e-4582-b4f7-ca2b6920344b","Type":"ContainerStarted","Data":"eb9fb388dc5be00667c7ceabacf442d5b5937c5b782438b78f84312f2f2e84bb"} Jul 21 01:59:31.772692 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:31.772639 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" podStartSLOduration=1.772621708 podStartE2EDuration="1.772621708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:59:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:59:31.770934074 +0000 UTC m=+2251.457582629" watchObservedRunningTime="2026-07-21 01:59:31.772621708 +0000 UTC m=+2251.459270263" Jul 21 01:59:32.278295 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:32.278262 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:32.283971 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:32.283943 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:32.761428 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:32.761386 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:32.767104 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:32.767065 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:39.708624 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:39.708534 2553 patch_prober.go:28] interesting pod/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Jul 21 01:59:39.708624 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:39.708608 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" podUID="b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Jul 21 01:59:39.817930 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:39.817841 2553 generic.go:356] "Generic (PLEG): container finished" podID="b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" containerID="c94a99dd9f623fa351597d1f8c0e71836aa6a8c7ee76e486d10dec38f493e96c" exitCode=0 Jul 21 01:59:39.817930 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:39.817880 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" event={"ID":"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4","Type":"ContainerDied","Data":"c94a99dd9f623fa351597d1f8c0e71836aa6a8c7ee76e486d10dec38f493e96c"} Jul 21 01:59:39.818281 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:39.818268 2553 scope.go:117] "RemoveContainer" containerID="c94a99dd9f623fa351597d1f8c0e71836aa6a8c7ee76e486d10dec38f493e96c" Jul 21 01:59:39.819439 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:39.819409 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:59:39.819515 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:39.819498 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:59:39.819605 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:39.819537 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:59:40.825845 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:40.825784 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" event={"ID":"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4","Type":"ContainerStarted","Data":"d19860b2d0ef6fd6c89e2ff672d78cbc89b96132a08672988cb97443d6bbdcdf"} Jul 21 01:59:41.783662 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:41.783622 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:41.784013 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:41.783980 2553 patch_prober.go:28] interesting pod/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Jul 21 01:59:41.784270 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:41.784220 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" podUID="b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Jul 21 01:59:42.783581 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:42.783528 2553 patch_prober.go:28] interesting pod/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Jul 21 01:59:42.784277 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:42.784199 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" podUID="b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Jul 21 01:59:43.783999 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:43.783498 2553 patch_prober.go:28] interesting pod/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Jul 21 01:59:43.783999 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:43.783564 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" podUID="b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Jul 21 01:59:44.783085 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:44.783047 2553 patch_prober.go:28] interesting pod/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Jul 21 01:59:44.783275 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:44.783113 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" podUID="b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Jul 21 01:59:45.788136 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:45.788106 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:45.788566 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:45.788554 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:45.789500 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:45.789480 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 01:59:46.875715 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:46.875684 2553 generic.go:356] "Generic (PLEG): container finished" podID="18217c24-0f9e-4582-b4f7-ca2b6920344b" containerID="1efd4f2a1be6c34361ab408c3c51152e41ccdbef91628460136b71e5cbb3d1ce" exitCode=0 Jul 21 01:59:46.876125 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:46.875752 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" event={"ID":"18217c24-0f9e-4582-b4f7-ca2b6920344b","Type":"ContainerDied","Data":"1efd4f2a1be6c34361ab408c3c51152e41ccdbef91628460136b71e5cbb3d1ce"} Jul 21 01:59:46.876378 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:46.876360 2553 scope.go:117] "RemoveContainer" containerID="1efd4f2a1be6c34361ab408c3c51152e41ccdbef91628460136b71e5cbb3d1ce" Jul 21 01:59:46.877493 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:46.877469 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:59:46.877558 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:46.877538 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:59:46.877592 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:46.877568 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 01:59:47.761752 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:47.761691 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:47.884077 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:47.884042 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" event={"ID":"18217c24-0f9e-4582-b4f7-ca2b6920344b","Type":"ContainerStarted","Data":"5d8bad981c5070d640e08dfe6200bbad0ba2219735d23177e30aa8930d4aaa4c"} Jul 21 01:59:48.278365 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:48.278332 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:48.279571 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:48.279543 2553 patch_prober.go:28] interesting pod/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Jul 21 01:59:48.279698 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:48.279608 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" podUID="18217c24-0f9e-4582-b4f7-ca2b6920344b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Jul 21 01:59:49.278316 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:49.278277 2553 patch_prober.go:28] interesting pod/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Jul 21 01:59:49.278729 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:49.278348 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" podUID="18217c24-0f9e-4582-b4f7-ca2b6920344b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Jul 21 01:59:50.279099 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:50.279057 2553 patch_prober.go:28] interesting pod/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Jul 21 01:59:50.279503 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:50.279133 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" podUID="18217c24-0f9e-4582-b4f7-ca2b6920344b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Jul 21 01:59:51.278193 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:51.278158 2553 patch_prober.go:28] interesting pod/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Jul 21 01:59:51.278373 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:51.278217 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" podUID="18217c24-0f9e-4582-b4f7-ca2b6920344b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Jul 21 01:59:52.282198 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:52.282163 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:52.282685 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:52.282668 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 01:59:52.283413 ip-10-0-132-244 kubenswrapper[2553]: I0721 01:59:52.283391 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 02:01:31.404477 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:31.404437 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd"] Jul 21 02:01:31.404979 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:31.404648 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" podUID="b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" containerName="istio-proxy" containerID="cri-o://d19860b2d0ef6fd6c89e2ff672d78cbc89b96132a08672988cb97443d6bbdcdf" gracePeriod=30 Jul 21 02:01:36.544790 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.544731 2553 generic.go:356] "Generic (PLEG): container finished" podID="b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" containerID="d19860b2d0ef6fd6c89e2ff672d78cbc89b96132a08672988cb97443d6bbdcdf" exitCode=0 Jul 21 02:01:36.545172 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.544786 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" event={"ID":"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4","Type":"ContainerDied","Data":"d19860b2d0ef6fd6c89e2ff672d78cbc89b96132a08672988cb97443d6bbdcdf"} Jul 21 02:01:36.545172 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.544884 2553 scope.go:117] "RemoveContainer" containerID="c94a99dd9f623fa351597d1f8c0e71836aa6a8c7ee76e486d10dec38f493e96c" Jul 21 02:01:36.676523 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.676464 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 02:01:36.741453 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.741424 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-credential-socket\") pod \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " Jul 21 02:01:36.741638 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.741483 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-workload-certs\") pod \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " Jul 21 02:01:36.741638 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.741506 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-workload-socket\") pod \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " Jul 21 02:01:36.741638 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.741540 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq8qv\" (UniqueName: \"kubernetes.io/projected/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-kube-api-access-gq8qv\") pod \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " Jul 21 02:01:36.741638 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.741575 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-token\") pod \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " Jul 21 02:01:36.741638 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.741609 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-podinfo\") pod \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " Jul 21 02:01:36.741638 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.741634 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-data\") pod \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " Jul 21 02:01:36.741938 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.741715 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-envoy\") pod \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " Jul 21 02:01:36.741938 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.741719 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" (UID: "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:01:36.741938 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.741748 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istiod-ca-cert\") pod \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\" (UID: \"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4\") " Jul 21 02:01:36.741938 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.741847 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" (UID: "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:01:36.741938 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.741891 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" (UID: "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:01:36.742221 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.742182 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:36.742221 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.742218 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:36.742340 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.742234 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:36.742340 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.742232 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" (UID: "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:01:36.742646 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.742622 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" (UID: "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:01:36.744068 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.744043 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" (UID: "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 02:01:36.744195 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.744109 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" (UID: "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:01:36.744453 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.744434 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" (UID: "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:01:36.744513 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.744458 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-kube-api-access-gq8qv" (OuterVolumeSpecName: "kube-api-access-gq8qv") pod "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" (UID: "b361e9bd-cb3e-4bce-addb-5d158cbfd8a4"). InnerVolumeSpecName "kube-api-access-gq8qv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:01:36.843482 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.843456 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:36.843482 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.843480 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:36.843482 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.843489 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:36.843701 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.843498 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq8qv\" (UniqueName: \"kubernetes.io/projected/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-kube-api-access-gq8qv\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:36.843701 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.843509 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:36.843701 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:36.843517 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:37.551917 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:37.551886 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" Jul 21 02:01:37.552383 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:37.551965 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd" event={"ID":"b361e9bd-cb3e-4bce-addb-5d158cbfd8a4","Type":"ContainerDied","Data":"62e3dc409add9b6e39f10564c5b6e140c5b6988b26fbfe27d87fad54d60f0c7b"} Jul 21 02:01:37.552383 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:37.552029 2553 scope.go:117] "RemoveContainer" containerID="d19860b2d0ef6fd6c89e2ff672d78cbc89b96132a08672988cb97443d6bbdcdf" Jul 21 02:01:37.572013 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:37.571985 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd"] Jul 21 02:01:37.575808 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:37.575777 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-811ee7-openshift-default-7945ccc94c-rtkpd"] Jul 21 02:01:38.836841 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:38.836785 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" path="/var/lib/kubelet/pods/b361e9bd-cb3e-4bce-addb-5d158cbfd8a4/volumes" Jul 21 02:01:53.725890 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:53.725852 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7"] Jul 21 02:01:53.726449 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:53.726089 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" podUID="18217c24-0f9e-4582-b4f7-ca2b6920344b" containerName="istio-proxy" containerID="cri-o://5d8bad981c5070d640e08dfe6200bbad0ba2219735d23177e30aa8930d4aaa4c" gracePeriod=30 Jul 21 02:01:54.684766 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.684734 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq"] Jul 21 02:01:54.685189 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.685175 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" containerName="istio-proxy" Jul 21 02:01:54.685234 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.685193 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" containerName="istio-proxy" Jul 21 02:01:54.685234 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.685201 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" containerName="istio-proxy" Jul 21 02:01:54.685234 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.685209 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" containerName="istio-proxy" Jul 21 02:01:54.685337 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.685274 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" containerName="istio-proxy" Jul 21 02:01:54.685337 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.685282 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b361e9bd-cb3e-4bce-addb-5d158cbfd8a4" containerName="istio-proxy" Jul 21 02:01:54.688665 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.688649 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.693535 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.693515 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-450472-openshift-default-dockercfg-szgsx\"" Jul 21 02:01:54.715082 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.715055 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq"] Jul 21 02:01:54.817904 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.817871 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-data\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.818383 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.817925 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-token\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.818383 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.818026 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f5c4b2e-89ea-466d-847a-85c94bd97740-istiod-ca-cert\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.818383 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.818099 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-envoy\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.818383 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.818132 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmwls\" (UniqueName: \"kubernetes.io/projected/6f5c4b2e-89ea-466d-847a-85c94bd97740-kube-api-access-xmwls\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.818383 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.818167 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-podinfo\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.818383 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.818214 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-credential-socket\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.818383 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.818257 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-workload-certs\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.818383 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.818335 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-workload-socket\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.919111 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.919067 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-data\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.919333 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.919126 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-token\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.919333 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.919165 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f5c4b2e-89ea-466d-847a-85c94bd97740-istiod-ca-cert\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.919333 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.919208 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-envoy\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.919333 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.919234 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmwls\" (UniqueName: \"kubernetes.io/projected/6f5c4b2e-89ea-466d-847a-85c94bd97740-kube-api-access-xmwls\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.919333 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.919264 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-podinfo\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.919333 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.919299 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-credential-socket\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.919753 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.919339 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-workload-certs\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.919753 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.919391 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-workload-socket\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.919753 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.919562 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-data\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.919960 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.919820 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-workload-certs\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.919960 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.919869 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-workload-socket\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.919960 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.919901 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-credential-socket\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.920076 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.919978 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f5c4b2e-89ea-466d-847a-85c94bd97740-istiod-ca-cert\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.921724 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.921701 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-envoy\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.921989 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.921970 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-podinfo\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.928900 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.928874 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-token\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.929886 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.929859 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmwls\" (UniqueName: \"kubernetes.io/projected/6f5c4b2e-89ea-466d-847a-85c94bd97740-kube-api-access-xmwls\") pod \"e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:54.999028 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:54.998983 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:55.155290 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:55.155257 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq"] Jul 21 02:01:55.157548 ip-10-0-132-244 kubenswrapper[2553]: W0721 02:01:55.157511 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5c4b2e_89ea_466d_847a_85c94bd97740.slice/crio-171d1af8043a2f43f0a12319d3c16e1231d4517545d7d2049a2870cdb57bf134 WatchSource:0}: Error finding container 171d1af8043a2f43f0a12319d3c16e1231d4517545d7d2049a2870cdb57bf134: Status 404 returned error can't find the container with id 171d1af8043a2f43f0a12319d3c16e1231d4517545d7d2049a2870cdb57bf134 Jul 21 02:01:55.160061 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:55.160030 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:01:55.160151 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:55.160099 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:01:55.160151 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:55.160126 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:01:55.660563 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:55.660523 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" event={"ID":"6f5c4b2e-89ea-466d-847a-85c94bd97740","Type":"ContainerStarted","Data":"9d0d4c3192f509809352a1d4fb59b1d10866d92ec716f5cf3353b4517198c92b"} Jul 21 02:01:55.660789 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:55.660582 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" event={"ID":"6f5c4b2e-89ea-466d-847a-85c94bd97740","Type":"ContainerStarted","Data":"171d1af8043a2f43f0a12319d3c16e1231d4517545d7d2049a2870cdb57bf134"} Jul 21 02:01:55.685913 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:55.685864 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" podStartSLOduration=1.685846995 podStartE2EDuration="1.685846995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:01:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:01:55.683654592 +0000 UTC m=+2395.370303170" watchObservedRunningTime="2026-07-21 02:01:55.685846995 +0000 UTC m=+2395.372495550" Jul 21 02:01:55.999867 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:55.999837 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:57.004932 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:57.004897 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:57.677113 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:57.677076 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:57.678029 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:57.678007 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:01:59.006157 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.006126 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 02:01:59.057865 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.057831 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-credential-socket\") pod \"18217c24-0f9e-4582-b4f7-ca2b6920344b\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " Jul 21 02:01:59.058066 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.057900 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-workload-socket\") pod \"18217c24-0f9e-4582-b4f7-ca2b6920344b\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " Jul 21 02:01:59.058066 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.057932 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18217c24-0f9e-4582-b4f7-ca2b6920344b-istiod-ca-cert\") pod \"18217c24-0f9e-4582-b4f7-ca2b6920344b\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " Jul 21 02:01:59.058066 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.057959 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-workload-certs\") pod \"18217c24-0f9e-4582-b4f7-ca2b6920344b\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " Jul 21 02:01:59.058066 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.058009 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-token\") pod \"18217c24-0f9e-4582-b4f7-ca2b6920344b\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " Jul 21 02:01:59.058066 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.058045 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s55kw\" (UniqueName: \"kubernetes.io/projected/18217c24-0f9e-4582-b4f7-ca2b6920344b-kube-api-access-s55kw\") pod \"18217c24-0f9e-4582-b4f7-ca2b6920344b\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " Jul 21 02:01:59.058344 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.058068 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-data\") pod \"18217c24-0f9e-4582-b4f7-ca2b6920344b\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " Jul 21 02:01:59.058344 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.058112 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-envoy\") pod \"18217c24-0f9e-4582-b4f7-ca2b6920344b\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " Jul 21 02:01:59.058344 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.058118 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18217c24-0f9e-4582-b4f7-ca2b6920344b" (UID: "18217c24-0f9e-4582-b4f7-ca2b6920344b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:01:59.058344 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.058181 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-podinfo\") pod \"18217c24-0f9e-4582-b4f7-ca2b6920344b\" (UID: \"18217c24-0f9e-4582-b4f7-ca2b6920344b\") " Jul 21 02:01:59.058344 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.058187 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18217c24-0f9e-4582-b4f7-ca2b6920344b" (UID: "18217c24-0f9e-4582-b4f7-ca2b6920344b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:01:59.058601 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.058498 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18217c24-0f9e-4582-b4f7-ca2b6920344b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18217c24-0f9e-4582-b4f7-ca2b6920344b" (UID: "18217c24-0f9e-4582-b4f7-ca2b6920344b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:01:59.058601 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.058509 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:59.058601 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.058526 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:59.059204 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.059128 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18217c24-0f9e-4582-b4f7-ca2b6920344b" (UID: "18217c24-0f9e-4582-b4f7-ca2b6920344b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:01:59.059532 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.059494 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-data" (OuterVolumeSpecName: "istio-data") pod "18217c24-0f9e-4582-b4f7-ca2b6920344b" (UID: "18217c24-0f9e-4582-b4f7-ca2b6920344b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:01:59.060886 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.060785 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-token" (OuterVolumeSpecName: "istio-token") pod "18217c24-0f9e-4582-b4f7-ca2b6920344b" (UID: "18217c24-0f9e-4582-b4f7-ca2b6920344b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:01:59.061361 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.061337 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18217c24-0f9e-4582-b4f7-ca2b6920344b" (UID: "18217c24-0f9e-4582-b4f7-ca2b6920344b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 02:01:59.061652 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.061630 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18217c24-0f9e-4582-b4f7-ca2b6920344b" (UID: "18217c24-0f9e-4582-b4f7-ca2b6920344b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:01:59.062009 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.061983 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18217c24-0f9e-4582-b4f7-ca2b6920344b-kube-api-access-s55kw" (OuterVolumeSpecName: "kube-api-access-s55kw") pod "18217c24-0f9e-4582-b4f7-ca2b6920344b" (UID: "18217c24-0f9e-4582-b4f7-ca2b6920344b"). InnerVolumeSpecName "kube-api-access-s55kw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:01:59.159340 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.159302 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:59.159340 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.159333 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18217c24-0f9e-4582-b4f7-ca2b6920344b-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:59.159340 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.159343 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:59.159340 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.159350 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:59.159612 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.159359 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s55kw\" (UniqueName: \"kubernetes.io/projected/18217c24-0f9e-4582-b4f7-ca2b6920344b-kube-api-access-s55kw\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:59.159612 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.159368 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:59.159612 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.159376 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18217c24-0f9e-4582-b4f7-ca2b6920344b-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:01:59.690697 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.690659 2553 generic.go:356] "Generic (PLEG): container finished" podID="18217c24-0f9e-4582-b4f7-ca2b6920344b" containerID="5d8bad981c5070d640e08dfe6200bbad0ba2219735d23177e30aa8930d4aaa4c" exitCode=0 Jul 21 02:01:59.690963 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.690723 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" Jul 21 02:01:59.690963 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.690764 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" event={"ID":"18217c24-0f9e-4582-b4f7-ca2b6920344b","Type":"ContainerDied","Data":"5d8bad981c5070d640e08dfe6200bbad0ba2219735d23177e30aa8930d4aaa4c"} Jul 21 02:01:59.690963 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.690837 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7" event={"ID":"18217c24-0f9e-4582-b4f7-ca2b6920344b","Type":"ContainerDied","Data":"eb9fb388dc5be00667c7ceabacf442d5b5937c5b782438b78f84312f2f2e84bb"} Jul 21 02:01:59.690963 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.690870 2553 scope.go:117] "RemoveContainer" containerID="5d8bad981c5070d640e08dfe6200bbad0ba2219735d23177e30aa8930d4aaa4c" Jul 21 02:01:59.701184 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.701162 2553 scope.go:117] "RemoveContainer" containerID="1efd4f2a1be6c34361ab408c3c51152e41ccdbef91628460136b71e5cbb3d1ce" Jul 21 02:01:59.710079 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.710059 2553 scope.go:117] "RemoveContainer" containerID="5d8bad981c5070d640e08dfe6200bbad0ba2219735d23177e30aa8930d4aaa4c" Jul 21 02:01:59.710348 ip-10-0-132-244 kubenswrapper[2553]: E0721 02:01:59.710326 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d8bad981c5070d640e08dfe6200bbad0ba2219735d23177e30aa8930d4aaa4c\": container with ID starting with 5d8bad981c5070d640e08dfe6200bbad0ba2219735d23177e30aa8930d4aaa4c not found: ID does not exist" containerID="5d8bad981c5070d640e08dfe6200bbad0ba2219735d23177e30aa8930d4aaa4c" Jul 21 02:01:59.710407 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.710357 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d8bad981c5070d640e08dfe6200bbad0ba2219735d23177e30aa8930d4aaa4c"} err="failed to get container status \"5d8bad981c5070d640e08dfe6200bbad0ba2219735d23177e30aa8930d4aaa4c\": rpc error: code = NotFound desc = could not find container \"5d8bad981c5070d640e08dfe6200bbad0ba2219735d23177e30aa8930d4aaa4c\": container with ID starting with 5d8bad981c5070d640e08dfe6200bbad0ba2219735d23177e30aa8930d4aaa4c not found: ID does not exist" Jul 21 02:01:59.710407 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.710377 2553 scope.go:117] "RemoveContainer" containerID="1efd4f2a1be6c34361ab408c3c51152e41ccdbef91628460136b71e5cbb3d1ce" Jul 21 02:01:59.710623 ip-10-0-132-244 kubenswrapper[2553]: E0721 02:01:59.710606 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1efd4f2a1be6c34361ab408c3c51152e41ccdbef91628460136b71e5cbb3d1ce\": container with ID starting with 1efd4f2a1be6c34361ab408c3c51152e41ccdbef91628460136b71e5cbb3d1ce not found: ID does not exist" containerID="1efd4f2a1be6c34361ab408c3c51152e41ccdbef91628460136b71e5cbb3d1ce" Jul 21 02:01:59.710667 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.710629 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1efd4f2a1be6c34361ab408c3c51152e41ccdbef91628460136b71e5cbb3d1ce"} err="failed to get container status \"1efd4f2a1be6c34361ab408c3c51152e41ccdbef91628460136b71e5cbb3d1ce\": rpc error: code = NotFound desc = could not find container \"1efd4f2a1be6c34361ab408c3c51152e41ccdbef91628460136b71e5cbb3d1ce\": container with ID starting with 1efd4f2a1be6c34361ab408c3c51152e41ccdbef91628460136b71e5cbb3d1ce not found: ID does not exist" Jul 21 02:01:59.725667 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.725635 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7"] Jul 21 02:01:59.733280 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:01:59.733254 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f35db9-openshift-default-88f48fc85-dw8z7"] Jul 21 02:02:00.836239 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:00.836209 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18217c24-0f9e-4582-b4f7-ca2b6920344b" path="/var/lib/kubelet/pods/18217c24-0f9e-4582-b4f7-ca2b6920344b/volumes" Jul 21 02:02:00.984452 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:00.984414 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 02:02:00.991596 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:00.991572 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 02:02:00.993811 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:00.993775 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 02:02:01.000119 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:01.000101 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 02:02:03.077851 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.077656 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp"] Jul 21 02:02:03.078366 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.078319 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18217c24-0f9e-4582-b4f7-ca2b6920344b" containerName="istio-proxy" Jul 21 02:02:03.078366 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.078339 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="18217c24-0f9e-4582-b4f7-ca2b6920344b" containerName="istio-proxy" Jul 21 02:02:03.078366 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.078355 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18217c24-0f9e-4582-b4f7-ca2b6920344b" containerName="istio-proxy" Jul 21 02:02:03.078366 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.078364 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="18217c24-0f9e-4582-b4f7-ca2b6920344b" containerName="istio-proxy" Jul 21 02:02:03.078581 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.078467 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="18217c24-0f9e-4582-b4f7-ca2b6920344b" containerName="istio-proxy" Jul 21 02:02:03.082136 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.082114 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.085820 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.085768 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-50f51c-openshift-default-dockercfg-lzbhk\"" Jul 21 02:02:03.099304 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.099279 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp"] Jul 21 02:02:03.200254 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.200219 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-token\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.200430 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.200276 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istiod-ca-cert\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.200430 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.200348 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58rtq\" (UniqueName: \"kubernetes.io/projected/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-kube-api-access-58rtq\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.200430 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.200406 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-workload-socket\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.200558 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.200444 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-envoy\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.200558 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.200468 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-credential-socket\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.200558 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.200525 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-workload-certs\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.200558 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.200553 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-podinfo\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.200735 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.200591 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-data\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.301653 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.301610 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-envoy\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.301653 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.301651 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-credential-socket\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.301918 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.301674 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-workload-certs\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.301918 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.301789 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-podinfo\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.301918 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.301885 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-data\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.302044 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.301969 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-token\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.302044 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.302033 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istiod-ca-cert\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.302156 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.302073 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58rtq\" (UniqueName: \"kubernetes.io/projected/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-kube-api-access-58rtq\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.302156 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.302122 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-workload-socket\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.302156 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.302144 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-credential-socket\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.302325 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.302301 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-data\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.302619 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.302430 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-workload-certs\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.302619 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.302501 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-workload-socket\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.302728 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.302698 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istiod-ca-cert\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.304253 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.304233 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-envoy\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.304366 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.304349 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-podinfo\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.316883 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.316859 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58rtq\" (UniqueName: \"kubernetes.io/projected/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-kube-api-access-58rtq\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.318608 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.318587 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-token\") pod \"e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.393527 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.393436 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:03.614361 ip-10-0-132-244 kubenswrapper[2553]: W0721 02:02:03.614324 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde7c5be_1a73_4b15_a813_2b1b936c8b2d.slice/crio-7e2baaa49c8f2a021cffe3af6b78bad2be701ae05d5ffb73becd4bf9aca89214 WatchSource:0}: Error finding container 7e2baaa49c8f2a021cffe3af6b78bad2be701ae05d5ffb73becd4bf9aca89214: Status 404 returned error can't find the container with id 7e2baaa49c8f2a021cffe3af6b78bad2be701ae05d5ffb73becd4bf9aca89214 Jul 21 02:02:03.614734 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.614713 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp"] Jul 21 02:02:03.616580 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.616549 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:02:03.616679 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.616623 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:02:03.616679 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.616670 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:02:03.718724 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.718550 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" event={"ID":"fde7c5be-1a73-4b15-a813-2b1b936c8b2d","Type":"ContainerStarted","Data":"d87a72bba04850333bec89d62f95ff0ccb78f28fb5cc19456041bbce459b5899"} Jul 21 02:02:03.718724 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.718625 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" event={"ID":"fde7c5be-1a73-4b15-a813-2b1b936c8b2d","Type":"ContainerStarted","Data":"7e2baaa49c8f2a021cffe3af6b78bad2be701ae05d5ffb73becd4bf9aca89214"} Jul 21 02:02:03.743465 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:03.743398 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" podStartSLOduration=0.743376819 podStartE2EDuration="743.376819ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:02:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:02:03.74110469 +0000 UTC m=+2403.427753256" watchObservedRunningTime="2026-07-21 02:02:03.743376819 +0000 UTC m=+2403.430025375" Jul 21 02:02:04.394006 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:04.393962 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:04.399052 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:04.399024 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:04.724279 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:04.724188 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:04.726007 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:04.725988 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:09.753706 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:09.753672 2553 generic.go:356] "Generic (PLEG): container finished" podID="6f5c4b2e-89ea-466d-847a-85c94bd97740" containerID="9d0d4c3192f509809352a1d4fb59b1d10866d92ec716f5cf3353b4517198c92b" exitCode=0 Jul 21 02:02:09.754306 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:09.753748 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" event={"ID":"6f5c4b2e-89ea-466d-847a-85c94bd97740","Type":"ContainerDied","Data":"9d0d4c3192f509809352a1d4fb59b1d10866d92ec716f5cf3353b4517198c92b"} Jul 21 02:02:09.754306 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:09.754188 2553 scope.go:117] "RemoveContainer" containerID="9d0d4c3192f509809352a1d4fb59b1d10866d92ec716f5cf3353b4517198c92b" Jul 21 02:02:09.755372 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:09.755340 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:02:09.755460 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:09.755414 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:02:09.755460 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:09.755444 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:02:10.766874 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:10.766834 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" event={"ID":"6f5c4b2e-89ea-466d-847a-85c94bd97740","Type":"ContainerStarted","Data":"21d1eb7dd8d0f8d46be9517fc3518259ae024103dd7265556c620565379e1a57"} Jul 21 02:02:10.999714 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:10.999678 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:02:11.001091 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:11.001062 2553 patch_prober.go:28] interesting pod/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Jul 21 02:02:11.001222 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:11.001117 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" podUID="6f5c4b2e-89ea-466d-847a-85c94bd97740" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Jul 21 02:02:12.000295 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:12.000262 2553 patch_prober.go:28] interesting pod/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Jul 21 02:02:12.000701 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:12.000323 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" podUID="6f5c4b2e-89ea-466d-847a-85c94bd97740" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Jul 21 02:02:12.677220 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:12.677182 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:02:13.000102 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:13.000070 2553 patch_prober.go:28] interesting pod/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Jul 21 02:02:13.000298 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:13.000138 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" podUID="6f5c4b2e-89ea-466d-847a-85c94bd97740" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Jul 21 02:02:14.000084 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:14.000043 2553 patch_prober.go:28] interesting pod/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Jul 21 02:02:14.000493 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:14.000114 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" podUID="6f5c4b2e-89ea-466d-847a-85c94bd97740" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Jul 21 02:02:15.004370 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:15.004339 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:02:15.005275 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:15.005253 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:02:24.855350 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:24.855312 2553 generic.go:356] "Generic (PLEG): container finished" podID="fde7c5be-1a73-4b15-a813-2b1b936c8b2d" containerID="d87a72bba04850333bec89d62f95ff0ccb78f28fb5cc19456041bbce459b5899" exitCode=0 Jul 21 02:02:24.855847 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:24.855386 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" event={"ID":"fde7c5be-1a73-4b15-a813-2b1b936c8b2d","Type":"ContainerDied","Data":"d87a72bba04850333bec89d62f95ff0ccb78f28fb5cc19456041bbce459b5899"} Jul 21 02:02:24.855847 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:24.855815 2553 scope.go:117] "RemoveContainer" containerID="d87a72bba04850333bec89d62f95ff0ccb78f28fb5cc19456041bbce459b5899" Jul 21 02:02:24.856959 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:24.856936 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:02:24.857037 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:24.856999 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:02:24.857077 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:24.857041 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:02:25.868863 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:25.868791 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" event={"ID":"fde7c5be-1a73-4b15-a813-2b1b936c8b2d","Type":"ContainerStarted","Data":"e27cacba42fac9ea2dbf17b369168857cbc41835e942e61ca329b57264e46108"} Jul 21 02:02:26.394671 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:26.394628 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:26.394936 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:26.394898 2553 patch_prober.go:28] interesting pod/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Jul 21 02:02:26.395038 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:26.394977 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" podUID="fde7c5be-1a73-4b15-a813-2b1b936c8b2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Jul 21 02:02:27.394624 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:27.394579 2553 patch_prober.go:28] interesting pod/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Jul 21 02:02:27.395052 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:27.394645 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" podUID="fde7c5be-1a73-4b15-a813-2b1b936c8b2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Jul 21 02:02:28.394769 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:28.394724 2553 patch_prober.go:28] interesting pod/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Jul 21 02:02:28.395206 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:28.394812 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" podUID="fde7c5be-1a73-4b15-a813-2b1b936c8b2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Jul 21 02:02:29.393985 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:29.393942 2553 patch_prober.go:28] interesting pod/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Jul 21 02:02:29.394186 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:29.394005 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" podUID="fde7c5be-1a73-4b15-a813-2b1b936c8b2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Jul 21 02:02:30.398583 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:30.398547 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:30.399068 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:30.398840 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:30.399668 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:30.399650 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:02:46.288843 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:46.288792 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq"] Jul 21 02:02:46.289274 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:46.289039 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" podUID="6f5c4b2e-89ea-466d-847a-85c94bd97740" containerName="istio-proxy" containerID="cri-o://21d1eb7dd8d0f8d46be9517fc3518259ae024103dd7265556c620565379e1a57" gracePeriod=30 Jul 21 02:02:51.548695 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.548612 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:02:51.693648 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.693612 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-credential-socket\") pod \"6f5c4b2e-89ea-466d-847a-85c94bd97740\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " Jul 21 02:02:51.693907 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.693706 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-token\") pod \"6f5c4b2e-89ea-466d-847a-85c94bd97740\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " Jul 21 02:02:51.693907 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.693730 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-data\") pod \"6f5c4b2e-89ea-466d-847a-85c94bd97740\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " Jul 21 02:02:51.693907 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.693793 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-podinfo\") pod \"6f5c4b2e-89ea-466d-847a-85c94bd97740\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " Jul 21 02:02:51.693907 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.693863 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-workload-certs\") pod \"6f5c4b2e-89ea-466d-847a-85c94bd97740\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " Jul 21 02:02:51.693907 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.693890 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-workload-socket\") pod \"6f5c4b2e-89ea-466d-847a-85c94bd97740\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " Jul 21 02:02:51.694180 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.693921 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmwls\" (UniqueName: \"kubernetes.io/projected/6f5c4b2e-89ea-466d-847a-85c94bd97740-kube-api-access-xmwls\") pod \"6f5c4b2e-89ea-466d-847a-85c94bd97740\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " Jul 21 02:02:51.694180 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.693951 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f5c4b2e-89ea-466d-847a-85c94bd97740" (UID: "6f5c4b2e-89ea-466d-847a-85c94bd97740"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:02:51.694180 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.693960 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-envoy\") pod \"6f5c4b2e-89ea-466d-847a-85c94bd97740\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " Jul 21 02:02:51.694180 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.694134 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f5c4b2e-89ea-466d-847a-85c94bd97740-istiod-ca-cert\") pod \"6f5c4b2e-89ea-466d-847a-85c94bd97740\" (UID: \"6f5c4b2e-89ea-466d-847a-85c94bd97740\") " Jul 21 02:02:51.694394 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.694213 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f5c4b2e-89ea-466d-847a-85c94bd97740" (UID: "6f5c4b2e-89ea-466d-847a-85c94bd97740"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:02:51.694394 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.694165 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f5c4b2e-89ea-466d-847a-85c94bd97740" (UID: "6f5c4b2e-89ea-466d-847a-85c94bd97740"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:02:51.694504 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.694490 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:02:51.694561 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.694509 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:02:51.694561 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.694523 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:02:51.694837 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.694757 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f5c4b2e-89ea-466d-847a-85c94bd97740-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f5c4b2e-89ea-466d-847a-85c94bd97740" (UID: "6f5c4b2e-89ea-466d-847a-85c94bd97740"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:02:51.695067 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.695044 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f5c4b2e-89ea-466d-847a-85c94bd97740" (UID: "6f5c4b2e-89ea-466d-847a-85c94bd97740"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:02:51.696357 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.696329 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f5c4b2e-89ea-466d-847a-85c94bd97740-kube-api-access-xmwls" (OuterVolumeSpecName: "kube-api-access-xmwls") pod "6f5c4b2e-89ea-466d-847a-85c94bd97740" (UID: "6f5c4b2e-89ea-466d-847a-85c94bd97740"). InnerVolumeSpecName "kube-api-access-xmwls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:02:51.696465 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.696333 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f5c4b2e-89ea-466d-847a-85c94bd97740" (UID: "6f5c4b2e-89ea-466d-847a-85c94bd97740"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 02:02:51.696658 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.696635 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f5c4b2e-89ea-466d-847a-85c94bd97740" (UID: "6f5c4b2e-89ea-466d-847a-85c94bd97740"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:02:51.696781 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.696634 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f5c4b2e-89ea-466d-847a-85c94bd97740" (UID: "6f5c4b2e-89ea-466d-847a-85c94bd97740"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:02:51.795191 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.795149 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:02:51.795191 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.795185 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:02:51.795191 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.795193 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:02:51.795191 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.795201 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmwls\" (UniqueName: \"kubernetes.io/projected/6f5c4b2e-89ea-466d-847a-85c94bd97740-kube-api-access-xmwls\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:02:51.795478 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.795210 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f5c4b2e-89ea-466d-847a-85c94bd97740-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:02:51.795478 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:51.795222 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f5c4b2e-89ea-466d-847a-85c94bd97740-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:02:52.025621 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:52.025591 2553 generic.go:356] "Generic (PLEG): container finished" podID="6f5c4b2e-89ea-466d-847a-85c94bd97740" containerID="21d1eb7dd8d0f8d46be9517fc3518259ae024103dd7265556c620565379e1a57" exitCode=0 Jul 21 02:02:52.025809 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:52.025648 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" Jul 21 02:02:52.025809 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:52.025673 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" event={"ID":"6f5c4b2e-89ea-466d-847a-85c94bd97740","Type":"ContainerDied","Data":"21d1eb7dd8d0f8d46be9517fc3518259ae024103dd7265556c620565379e1a57"} Jul 21 02:02:52.025809 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:52.025733 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq" event={"ID":"6f5c4b2e-89ea-466d-847a-85c94bd97740","Type":"ContainerDied","Data":"171d1af8043a2f43f0a12319d3c16e1231d4517545d7d2049a2870cdb57bf134"} Jul 21 02:02:52.025809 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:52.025750 2553 scope.go:117] "RemoveContainer" containerID="21d1eb7dd8d0f8d46be9517fc3518259ae024103dd7265556c620565379e1a57" Jul 21 02:02:52.036260 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:52.036241 2553 scope.go:117] "RemoveContainer" containerID="9d0d4c3192f509809352a1d4fb59b1d10866d92ec716f5cf3353b4517198c92b" Jul 21 02:02:52.045655 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:52.045638 2553 scope.go:117] "RemoveContainer" containerID="21d1eb7dd8d0f8d46be9517fc3518259ae024103dd7265556c620565379e1a57" Jul 21 02:02:52.045925 ip-10-0-132-244 kubenswrapper[2553]: E0721 02:02:52.045905 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21d1eb7dd8d0f8d46be9517fc3518259ae024103dd7265556c620565379e1a57\": container with ID starting with 21d1eb7dd8d0f8d46be9517fc3518259ae024103dd7265556c620565379e1a57 not found: ID does not exist" containerID="21d1eb7dd8d0f8d46be9517fc3518259ae024103dd7265556c620565379e1a57" Jul 21 02:02:52.045969 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:52.045936 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21d1eb7dd8d0f8d46be9517fc3518259ae024103dd7265556c620565379e1a57"} err="failed to get container status \"21d1eb7dd8d0f8d46be9517fc3518259ae024103dd7265556c620565379e1a57\": rpc error: code = NotFound desc = could not find container \"21d1eb7dd8d0f8d46be9517fc3518259ae024103dd7265556c620565379e1a57\": container with ID starting with 21d1eb7dd8d0f8d46be9517fc3518259ae024103dd7265556c620565379e1a57 not found: ID does not exist" Jul 21 02:02:52.045969 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:52.045955 2553 scope.go:117] "RemoveContainer" containerID="9d0d4c3192f509809352a1d4fb59b1d10866d92ec716f5cf3353b4517198c92b" Jul 21 02:02:52.046174 ip-10-0-132-244 kubenswrapper[2553]: E0721 02:02:52.046159 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d0d4c3192f509809352a1d4fb59b1d10866d92ec716f5cf3353b4517198c92b\": container with ID starting with 9d0d4c3192f509809352a1d4fb59b1d10866d92ec716f5cf3353b4517198c92b not found: ID does not exist" containerID="9d0d4c3192f509809352a1d4fb59b1d10866d92ec716f5cf3353b4517198c92b" Jul 21 02:02:52.046210 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:52.046179 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d0d4c3192f509809352a1d4fb59b1d10866d92ec716f5cf3353b4517198c92b"} err="failed to get container status \"9d0d4c3192f509809352a1d4fb59b1d10866d92ec716f5cf3353b4517198c92b\": rpc error: code = NotFound desc = could not find container \"9d0d4c3192f509809352a1d4fb59b1d10866d92ec716f5cf3353b4517198c92b\": container with ID starting with 9d0d4c3192f509809352a1d4fb59b1d10866d92ec716f5cf3353b4517198c92b not found: ID does not exist" Jul 21 02:02:52.052177 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:52.052152 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq"] Jul 21 02:02:52.056928 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:52.056902 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-450472-openshift-default-8557d45c4c-d7qqq"] Jul 21 02:02:52.837426 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:02:52.837391 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f5c4b2e-89ea-466d-847a-85c94bd97740" path="/var/lib/kubelet/pods/6f5c4b2e-89ea-466d-847a-85c94bd97740/volumes" Jul 21 02:03:14.033906 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:14.033866 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp"] Jul 21 02:03:14.034468 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:14.034075 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" podUID="fde7c5be-1a73-4b15-a813-2b1b936c8b2d" containerName="istio-proxy" containerID="cri-o://e27cacba42fac9ea2dbf17b369168857cbc41835e942e61ca329b57264e46108" gracePeriod=30 Jul 21 02:03:15.040356 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.040324 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p"] Jul 21 02:03:15.040751 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.040726 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f5c4b2e-89ea-466d-847a-85c94bd97740" containerName="istio-proxy" Jul 21 02:03:15.040751 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.040737 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f5c4b2e-89ea-466d-847a-85c94bd97740" containerName="istio-proxy" Jul 21 02:03:15.040878 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.040866 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="18217c24-0f9e-4582-b4f7-ca2b6920344b" containerName="istio-proxy" Jul 21 02:03:15.040915 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.040882 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f5c4b2e-89ea-466d-847a-85c94bd97740" containerName="istio-proxy" Jul 21 02:03:15.043354 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.043336 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.048459 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.048437 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0dfbd0-openshift-default-dockercfg-vclpj\"" Jul 21 02:03:15.069775 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.069744 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p"] Jul 21 02:03:15.113705 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.113669 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-workload-certs\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.113939 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.113731 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-workload-socket\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.113939 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.113774 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-envoy\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.113939 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.113824 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-data\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.113939 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.113843 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istiod-ca-cert\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.113939 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.113882 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86ctp\" (UniqueName: \"kubernetes.io/projected/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-kube-api-access-86ctp\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.113939 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.113935 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-podinfo\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.114281 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.113954 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-credential-socket\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.114281 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.114025 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-token\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.215475 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.215440 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-podinfo\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.215475 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.215474 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-credential-socket\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.215755 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.215512 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-token\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.215755 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.215545 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-workload-certs\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.215755 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.215576 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-workload-socket\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.215755 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.215595 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-envoy\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.215755 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.215619 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-data\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.215755 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.215637 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istiod-ca-cert\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.215755 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.215727 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86ctp\" (UniqueName: \"kubernetes.io/projected/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-kube-api-access-86ctp\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.216157 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.215993 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-credential-socket\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.216157 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.216014 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-workload-socket\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.216316 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.216294 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-data\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.216382 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.216364 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-workload-certs\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.216501 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.216482 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istiod-ca-cert\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.218161 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.218134 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-envoy\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.218453 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.218433 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-podinfo\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.230616 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.230589 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86ctp\" (UniqueName: \"kubernetes.io/projected/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-kube-api-access-86ctp\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.231325 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.231306 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-token\") pod \"e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.354022 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.353939 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:15.402155 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.402116 2553 patch_prober.go:28] interesting pod/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 21 02:03:15.402343 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.402194 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" podUID="fde7c5be-1a73-4b15-a813-2b1b936c8b2d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 21 02:03:15.524252 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.524219 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p"] Jul 21 02:03:15.525364 ip-10-0-132-244 kubenswrapper[2553]: W0721 02:03:15.525334 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2ef33f_8a7e_4f1f_8fb7_04a86b95a6f0.slice/crio-1d586fa5445c231850bf91538647afa4182dd0e6edf3bf23eb947a496c1109c2 WatchSource:0}: Error finding container 1d586fa5445c231850bf91538647afa4182dd0e6edf3bf23eb947a496c1109c2: Status 404 returned error can't find the container with id 1d586fa5445c231850bf91538647afa4182dd0e6edf3bf23eb947a496c1109c2 Jul 21 02:03:15.527595 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.527562 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:03:15.527703 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.527643 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:03:15.527703 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:15.527685 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:03:16.177855 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:16.177822 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" event={"ID":"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0","Type":"ContainerStarted","Data":"e70c4cdbd2c9d530876c1eb05822bf218a811681339d29fa4e17411d05ccda96"} Jul 21 02:03:16.178300 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:16.177877 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" event={"ID":"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0","Type":"ContainerStarted","Data":"1d586fa5445c231850bf91538647afa4182dd0e6edf3bf23eb947a496c1109c2"} Jul 21 02:03:16.231117 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:16.231068 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" podStartSLOduration=1.231051663 podStartE2EDuration="1.231051663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:03:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:03:16.230397332 +0000 UTC m=+2475.917045886" watchObservedRunningTime="2026-07-21 02:03:16.231051663 +0000 UTC m=+2475.917700218" Jul 21 02:03:16.354290 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:16.354260 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:16.359274 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:16.359250 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:17.187842 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:17.187222 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:17.191703 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:17.191675 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:19.201476 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.201438 2553 generic.go:356] "Generic (PLEG): container finished" podID="fde7c5be-1a73-4b15-a813-2b1b936c8b2d" containerID="e27cacba42fac9ea2dbf17b369168857cbc41835e942e61ca329b57264e46108" exitCode=0 Jul 21 02:03:19.201996 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.201507 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" event={"ID":"fde7c5be-1a73-4b15-a813-2b1b936c8b2d","Type":"ContainerDied","Data":"e27cacba42fac9ea2dbf17b369168857cbc41835e942e61ca329b57264e46108"} Jul 21 02:03:19.201996 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.201570 2553 scope.go:117] "RemoveContainer" containerID="d87a72bba04850333bec89d62f95ff0ccb78f28fb5cc19456041bbce459b5899" Jul 21 02:03:19.301232 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.301175 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:03:19.356732 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.356704 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-credential-socket\") pod \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " Jul 21 02:03:19.356942 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.356744 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-token\") pod \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " Jul 21 02:03:19.356942 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.356768 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-envoy\") pod \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " Jul 21 02:03:19.356942 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.356817 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58rtq\" (UniqueName: \"kubernetes.io/projected/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-kube-api-access-58rtq\") pod \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " Jul 21 02:03:19.356942 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.356842 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-podinfo\") pod \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " Jul 21 02:03:19.356942 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.356874 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istiod-ca-cert\") pod \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " Jul 21 02:03:19.357222 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.356988 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-workload-certs\") pod \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " Jul 21 02:03:19.357222 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.357062 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fde7c5be-1a73-4b15-a813-2b1b936c8b2d" (UID: "fde7c5be-1a73-4b15-a813-2b1b936c8b2d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:03:19.357222 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.357091 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-workload-socket\") pod \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " Jul 21 02:03:19.357222 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.357138 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-data\") pod \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\" (UID: \"fde7c5be-1a73-4b15-a813-2b1b936c8b2d\") " Jul 21 02:03:19.357439 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.357269 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fde7c5be-1a73-4b15-a813-2b1b936c8b2d" (UID: "fde7c5be-1a73-4b15-a813-2b1b936c8b2d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:03:19.357439 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.357361 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fde7c5be-1a73-4b15-a813-2b1b936c8b2d" (UID: "fde7c5be-1a73-4b15-a813-2b1b936c8b2d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:03:19.357654 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.357598 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fde7c5be-1a73-4b15-a813-2b1b936c8b2d" (UID: "fde7c5be-1a73-4b15-a813-2b1b936c8b2d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:03:19.357911 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.357852 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:03:19.357911 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.357877 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:03:19.357911 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.357890 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:03:19.357911 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.357903 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:03:19.358510 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.358473 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-data" (OuterVolumeSpecName: "istio-data") pod "fde7c5be-1a73-4b15-a813-2b1b936c8b2d" (UID: "fde7c5be-1a73-4b15-a813-2b1b936c8b2d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:03:19.359565 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.359527 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fde7c5be-1a73-4b15-a813-2b1b936c8b2d" (UID: "fde7c5be-1a73-4b15-a813-2b1b936c8b2d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 02:03:19.359663 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.359588 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-kube-api-access-58rtq" (OuterVolumeSpecName: "kube-api-access-58rtq") pod "fde7c5be-1a73-4b15-a813-2b1b936c8b2d" (UID: "fde7c5be-1a73-4b15-a813-2b1b936c8b2d"). InnerVolumeSpecName "kube-api-access-58rtq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:03:19.359663 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.359629 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-token" (OuterVolumeSpecName: "istio-token") pod "fde7c5be-1a73-4b15-a813-2b1b936c8b2d" (UID: "fde7c5be-1a73-4b15-a813-2b1b936c8b2d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:03:19.359867 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.359845 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fde7c5be-1a73-4b15-a813-2b1b936c8b2d" (UID: "fde7c5be-1a73-4b15-a813-2b1b936c8b2d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:03:19.459342 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.459303 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:03:19.459342 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.459333 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:03:19.459342 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.459345 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:03:19.459576 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.459357 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58rtq\" (UniqueName: \"kubernetes.io/projected/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-kube-api-access-58rtq\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:03:19.459576 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:19.459370 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fde7c5be-1a73-4b15-a813-2b1b936c8b2d-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:03:20.208933 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:20.208896 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" event={"ID":"fde7c5be-1a73-4b15-a813-2b1b936c8b2d","Type":"ContainerDied","Data":"7e2baaa49c8f2a021cffe3af6b78bad2be701ae05d5ffb73becd4bf9aca89214"} Jul 21 02:03:20.208933 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:20.208932 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp" Jul 21 02:03:20.209462 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:20.208969 2553 scope.go:117] "RemoveContainer" containerID="e27cacba42fac9ea2dbf17b369168857cbc41835e942e61ca329b57264e46108" Jul 21 02:03:20.244520 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:20.244488 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp"] Jul 21 02:03:20.254482 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:20.254456 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-50f51c-openshift-default-6658b94db9-w7svp"] Jul 21 02:03:20.837054 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:20.837011 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fde7c5be-1a73-4b15-a813-2b1b936c8b2d" path="/var/lib/kubelet/pods/fde7c5be-1a73-4b15-a813-2b1b936c8b2d/volumes" Jul 21 02:03:23.658562 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.658498 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8"] Jul 21 02:03:23.659010 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.658995 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fde7c5be-1a73-4b15-a813-2b1b936c8b2d" containerName="istio-proxy" Jul 21 02:03:23.659056 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.659012 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="fde7c5be-1a73-4b15-a813-2b1b936c8b2d" containerName="istio-proxy" Jul 21 02:03:23.659056 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.659027 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f5c4b2e-89ea-466d-847a-85c94bd97740" containerName="istio-proxy" Jul 21 02:03:23.659056 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.659032 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f5c4b2e-89ea-466d-847a-85c94bd97740" containerName="istio-proxy" Jul 21 02:03:23.659149 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.659089 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="fde7c5be-1a73-4b15-a813-2b1b936c8b2d" containerName="istio-proxy" Jul 21 02:03:23.659149 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.659098 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="fde7c5be-1a73-4b15-a813-2b1b936c8b2d" containerName="istio-proxy" Jul 21 02:03:23.659149 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.659106 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f5c4b2e-89ea-466d-847a-85c94bd97740" containerName="istio-proxy" Jul 21 02:03:23.662320 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.662302 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.669173 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.669148 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-a256ec-openshift-default-dockercfg-fv9q4\"" Jul 21 02:03:23.699430 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.699401 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-envoy\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.699572 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.699437 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-workload-socket\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.699572 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.699481 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5r8w\" (UniqueName: \"kubernetes.io/projected/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-kube-api-access-b5r8w\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.699572 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.699525 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-credential-socket\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.699572 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.699552 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-token\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.699762 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.699612 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istiod-ca-cert\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.699762 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.699670 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-workload-certs\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.699762 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.699743 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-podinfo\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.699915 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.699772 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-data\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.707528 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.707503 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8"] Jul 21 02:03:23.801213 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.801170 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-envoy\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.801213 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.801216 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-workload-socket\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.801491 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.801252 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5r8w\" (UniqueName: \"kubernetes.io/projected/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-kube-api-access-b5r8w\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.801491 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.801279 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-credential-socket\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.801491 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.801308 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-token\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.801491 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.801333 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istiod-ca-cert\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.801491 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.801369 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-workload-certs\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.801491 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.801448 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-podinfo\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.801491 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.801489 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-data\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.801865 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.801840 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-credential-socket\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.802065 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.802042 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-workload-socket\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.802153 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.802130 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-data\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.802201 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.802156 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istiod-ca-cert\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.802238 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.802192 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-workload-certs\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.803661 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.803644 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-envoy\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.803938 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.803919 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-podinfo\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.819950 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.819923 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-token\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.820076 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.820011 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5r8w\" (UniqueName: \"kubernetes.io/projected/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-kube-api-access-b5r8w\") pod \"e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:23.972955 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:23.972861 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:24.141030 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:24.141000 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8"] Jul 21 02:03:24.143331 ip-10-0-132-244 kubenswrapper[2553]: W0721 02:03:24.143301 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8536ac7_44a1_4527_a2f4_ea2645f61b1d.slice/crio-e215cdf8a90a1c7dc9230e4353123e2d9ab825a89c14d30d66098eee61c37585 WatchSource:0}: Error finding container e215cdf8a90a1c7dc9230e4353123e2d9ab825a89c14d30d66098eee61c37585: Status 404 returned error can't find the container with id e215cdf8a90a1c7dc9230e4353123e2d9ab825a89c14d30d66098eee61c37585 Jul 21 02:03:24.145671 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:24.145634 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:03:24.145772 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:24.145721 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:03:24.145772 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:24.145760 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:03:24.236232 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:24.236179 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" event={"ID":"d8536ac7-44a1-4527-a2f4-ea2645f61b1d","Type":"ContainerStarted","Data":"dedeb4f3c0604cbeae6a2fc64bd241828a02f417fdc9de8bfd573f395a7ec26d"} Jul 21 02:03:24.236419 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:24.236253 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" event={"ID":"d8536ac7-44a1-4527-a2f4-ea2645f61b1d","Type":"ContainerStarted","Data":"e215cdf8a90a1c7dc9230e4353123e2d9ab825a89c14d30d66098eee61c37585"} Jul 21 02:03:24.314346 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:24.314297 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" podStartSLOduration=1.3142810360000001 podStartE2EDuration="1.314281036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:03:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:03:24.312018989 +0000 UTC m=+2483.998667545" watchObservedRunningTime="2026-07-21 02:03:24.314281036 +0000 UTC m=+2484.000929591" Jul 21 02:03:24.973139 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:24.973096 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:25.979482 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:25.979444 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:26.253574 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:26.253475 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:26.261316 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:26.261288 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:32.189281 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:32.188828 2553 patch_prober.go:28] interesting pod/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Jul 21 02:03:32.189281 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:32.188942 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" podUID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Jul 21 02:03:32.297339 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:32.297255 2553 generic.go:356] "Generic (PLEG): container finished" podID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" containerID="e70c4cdbd2c9d530876c1eb05822bf218a811681339d29fa4e17411d05ccda96" exitCode=0 Jul 21 02:03:32.297508 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:32.297333 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" event={"ID":"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0","Type":"ContainerDied","Data":"e70c4cdbd2c9d530876c1eb05822bf218a811681339d29fa4e17411d05ccda96"} Jul 21 02:03:32.297749 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:32.297730 2553 scope.go:117] "RemoveContainer" containerID="e70c4cdbd2c9d530876c1eb05822bf218a811681339d29fa4e17411d05ccda96" Jul 21 02:03:32.298824 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:32.298771 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:03:32.298934 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:32.298858 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:03:32.298934 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:32.298892 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:03:33.305578 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:33.305542 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" event={"ID":"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0","Type":"ContainerStarted","Data":"4e0f99ea0fa48aa5409303602f634231aefffc6dba50b0bf636262579e6b6301"} Jul 21 02:03:33.355150 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:33.354682 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:33.355150 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:33.354832 2553 patch_prober.go:28] interesting pod/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Jul 21 02:03:33.355150 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:33.354882 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" podUID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Jul 21 02:03:34.355489 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:34.355448 2553 patch_prober.go:28] interesting pod/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Jul 21 02:03:34.356118 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:34.356082 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" podUID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Jul 21 02:03:35.354842 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:35.354763 2553 patch_prober.go:28] interesting pod/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Jul 21 02:03:35.355069 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:35.354868 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" podUID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Jul 21 02:03:36.354860 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:36.354827 2553 patch_prober.go:28] interesting pod/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Jul 21 02:03:36.355503 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:36.355445 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" podUID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Jul 21 02:03:37.355108 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:37.355060 2553 patch_prober.go:28] interesting pod/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Jul 21 02:03:37.355612 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:37.355135 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" podUID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Jul 21 02:03:38.358463 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:38.358427 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:38.358895 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:38.358845 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:38.359613 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:38.359590 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:03:40.351569 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:40.351532 2553 generic.go:356] "Generic (PLEG): container finished" podID="d8536ac7-44a1-4527-a2f4-ea2645f61b1d" containerID="dedeb4f3c0604cbeae6a2fc64bd241828a02f417fdc9de8bfd573f395a7ec26d" exitCode=0 Jul 21 02:03:40.352070 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:40.351609 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" event={"ID":"d8536ac7-44a1-4527-a2f4-ea2645f61b1d","Type":"ContainerDied","Data":"dedeb4f3c0604cbeae6a2fc64bd241828a02f417fdc9de8bfd573f395a7ec26d"} Jul 21 02:03:40.352237 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:40.352220 2553 scope.go:117] "RemoveContainer" containerID="dedeb4f3c0604cbeae6a2fc64bd241828a02f417fdc9de8bfd573f395a7ec26d" Jul 21 02:03:40.353229 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:40.353202 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:03:40.353326 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:40.353284 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:03:40.353389 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:40.353344 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 21 02:03:41.253394 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:41.253353 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:41.359305 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:41.359261 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" event={"ID":"d8536ac7-44a1-4527-a2f4-ea2645f61b1d","Type":"ContainerStarted","Data":"33cd782311909e83fff0d829685e0094d2d672c6f428356759a7e087c5251783"} Jul 21 02:03:41.973548 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:41.973508 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:41.974735 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:41.974708 2553 patch_prober.go:28] interesting pod/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Jul 21 02:03:41.974888 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:41.974763 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" podUID="d8536ac7-44a1-4527-a2f4-ea2645f61b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Jul 21 02:03:42.973605 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:42.973564 2553 patch_prober.go:28] interesting pod/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Jul 21 02:03:42.974138 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:42.973619 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" podUID="d8536ac7-44a1-4527-a2f4-ea2645f61b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Jul 21 02:03:43.973644 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:43.973597 2553 patch_prober.go:28] interesting pod/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Jul 21 02:03:43.974083 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:43.973719 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" podUID="d8536ac7-44a1-4527-a2f4-ea2645f61b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Jul 21 02:03:44.973466 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:44.973425 2553 patch_prober.go:28] interesting pod/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Jul 21 02:03:44.973672 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:44.973497 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" podUID="d8536ac7-44a1-4527-a2f4-ea2645f61b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Jul 21 02:03:45.978179 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:45.978146 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:45.978567 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:45.978425 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:03:45.979112 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:03:45.979092 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:07:01.023353 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:07:01.023323 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 02:07:01.030567 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:07:01.030540 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 02:07:01.033733 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:07:01.033715 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 02:07:01.040627 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:07:01.040609 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jdsfw_8ddb4db9-32ba-4437-b3b0-e76756b9542d/ovn-acl-logging/0.log" Jul 21 02:09:36.849388 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:36.849356 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7538-140632279585712"] Jul 21 02:09:36.849881 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:36.849821 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fde7c5be-1a73-4b15-a813-2b1b936c8b2d" containerName="istio-proxy" Jul 21 02:09:36.849881 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:36.849834 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="fde7c5be-1a73-4b15-a813-2b1b936c8b2d" containerName="istio-proxy" Jul 21 02:09:36.853104 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:36.853077 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279585712" Jul 21 02:09:36.856314 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:36.856286 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wjdmg\"" Jul 21 02:09:36.859018 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:36.858992 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7538-140632279585712"] Jul 21 02:09:36.908405 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:36.908371 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4hmh\" (UniqueName: \"kubernetes.io/projected/ff3b0961-86cb-47b8-9a4b-42de933d76e5-kube-api-access-m4hmh\") pod \"test-curl-7538-140632279585712\" (UID: \"ff3b0961-86cb-47b8-9a4b-42de933d76e5\") " pod="opendatahub/test-curl-7538-140632279585712" Jul 21 02:09:37.009378 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:37.009335 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4hmh\" (UniqueName: \"kubernetes.io/projected/ff3b0961-86cb-47b8-9a4b-42de933d76e5-kube-api-access-m4hmh\") pod \"test-curl-7538-140632279585712\" (UID: \"ff3b0961-86cb-47b8-9a4b-42de933d76e5\") " pod="opendatahub/test-curl-7538-140632279585712" Jul 21 02:09:37.018177 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:37.018140 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4hmh\" (UniqueName: \"kubernetes.io/projected/ff3b0961-86cb-47b8-9a4b-42de933d76e5-kube-api-access-m4hmh\") pod \"test-curl-7538-140632279585712\" (UID: \"ff3b0961-86cb-47b8-9a4b-42de933d76e5\") " pod="opendatahub/test-curl-7538-140632279585712" Jul 21 02:09:37.165497 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:37.165411 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279585712" Jul 21 02:09:37.319160 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:37.319125 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7538-140632279585712"] Jul 21 02:09:37.321677 ip-10-0-132-244 kubenswrapper[2553]: W0721 02:09:37.321644 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff3b0961_86cb_47b8_9a4b_42de933d76e5.slice/crio-3134bf57fa8ec77b027deda1eabd3e1cc0f140ef7b753e2740c9df4a16c3013c WatchSource:0}: Error finding container 3134bf57fa8ec77b027deda1eabd3e1cc0f140ef7b753e2740c9df4a16c3013c: Status 404 returned error can't find the container with id 3134bf57fa8ec77b027deda1eabd3e1cc0f140ef7b753e2740c9df4a16c3013c Jul 21 02:09:37.323064 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:37.323047 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 02:09:37.509873 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:37.509836 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7538-140632279585712" event={"ID":"ff3b0961-86cb-47b8-9a4b-42de933d76e5","Type":"ContainerStarted","Data":"3134bf57fa8ec77b027deda1eabd3e1cc0f140ef7b753e2740c9df4a16c3013c"} Jul 21 02:09:38.518290 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:38.518254 2553 generic.go:356] "Generic (PLEG): container finished" podID="ff3b0961-86cb-47b8-9a4b-42de933d76e5" containerID="12b25e698b2d143b40590953cb9f00eb11eeda7f719fd159fc62ccaca8006cc4" exitCode=0 Jul 21 02:09:38.518754 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:38.518343 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7538-140632279585712" event={"ID":"ff3b0961-86cb-47b8-9a4b-42de933d76e5","Type":"ContainerDied","Data":"12b25e698b2d143b40590953cb9f00eb11eeda7f719fd159fc62ccaca8006cc4"} Jul 21 02:09:39.675717 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:39.675687 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279585712" Jul 21 02:09:39.711063 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:39.711037 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7538-140632279585712_ff3b0961-86cb-47b8-9a4b-42de933d76e5/test-curl-7538-140632279585712/0.log" Jul 21 02:09:39.736745 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:39.736716 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4hmh\" (UniqueName: \"kubernetes.io/projected/ff3b0961-86cb-47b8-9a4b-42de933d76e5-kube-api-access-m4hmh\") pod \"ff3b0961-86cb-47b8-9a4b-42de933d76e5\" (UID: \"ff3b0961-86cb-47b8-9a4b-42de933d76e5\") " Jul 21 02:09:39.737061 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:39.737042 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7538-140632279585712"] Jul 21 02:09:39.739007 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:39.738980 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3b0961-86cb-47b8-9a4b-42de933d76e5-kube-api-access-m4hmh" (OuterVolumeSpecName: "kube-api-access-m4hmh") pod "ff3b0961-86cb-47b8-9a4b-42de933d76e5" (UID: "ff3b0961-86cb-47b8-9a4b-42de933d76e5"). InnerVolumeSpecName "kube-api-access-m4hmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:09:39.739494 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:39.739475 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7538-140632279585712"] Jul 21 02:09:39.838406 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:39.838310 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4hmh\" (UniqueName: \"kubernetes.io/projected/ff3b0961-86cb-47b8-9a4b-42de933d76e5-kube-api-access-m4hmh\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:09:39.898635 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:39.898590 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7538-140632279507136"] Jul 21 02:09:39.899120 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:39.899105 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3b0961-86cb-47b8-9a4b-42de933d76e5" containerName="test-curl-7538-140632279585712" Jul 21 02:09:39.899197 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:39.899123 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3b0961-86cb-47b8-9a4b-42de933d76e5" containerName="test-curl-7538-140632279585712" Jul 21 02:09:39.899240 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:39.899215 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff3b0961-86cb-47b8-9a4b-42de933d76e5" containerName="test-curl-7538-140632279585712" Jul 21 02:09:39.901571 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:39.901556 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279507136" Jul 21 02:09:39.909197 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:39.909168 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7538-140632279507136"] Jul 21 02:09:39.939372 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:39.939337 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4qt6\" (UniqueName: \"kubernetes.io/projected/79ff3190-331d-44da-9149-343832997455-kube-api-access-x4qt6\") pod \"test-curl-7538-140632279507136\" (UID: \"79ff3190-331d-44da-9149-343832997455\") " pod="opendatahub/test-curl-7538-140632279507136" Jul 21 02:09:40.040110 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:40.040073 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4qt6\" (UniqueName: \"kubernetes.io/projected/79ff3190-331d-44da-9149-343832997455-kube-api-access-x4qt6\") pod \"test-curl-7538-140632279507136\" (UID: \"79ff3190-331d-44da-9149-343832997455\") " pod="opendatahub/test-curl-7538-140632279507136" Jul 21 02:09:40.050011 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:40.049979 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4qt6\" (UniqueName: \"kubernetes.io/projected/79ff3190-331d-44da-9149-343832997455-kube-api-access-x4qt6\") pod \"test-curl-7538-140632279507136\" (UID: \"79ff3190-331d-44da-9149-343832997455\") " pod="opendatahub/test-curl-7538-140632279507136" Jul 21 02:09:40.212914 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:40.212828 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279507136" Jul 21 02:09:40.357789 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:40.357755 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7538-140632279507136"] Jul 21 02:09:40.359570 ip-10-0-132-244 kubenswrapper[2553]: W0721 02:09:40.359547 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79ff3190_331d_44da_9149_343832997455.slice/crio-7d69f170dff10b59c25e3ab06f4d2d6bd1a41457a2f21ad759610cbe760940a5 WatchSource:0}: Error finding container 7d69f170dff10b59c25e3ab06f4d2d6bd1a41457a2f21ad759610cbe760940a5: Status 404 returned error can't find the container with id 7d69f170dff10b59c25e3ab06f4d2d6bd1a41457a2f21ad759610cbe760940a5 Jul 21 02:09:40.532084 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:40.532054 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3134bf57fa8ec77b027deda1eabd3e1cc0f140ef7b753e2740c9df4a16c3013c" Jul 21 02:09:40.532084 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:40.532060 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279585712" Jul 21 02:09:40.533247 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:40.533218 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7538-140632279507136" event={"ID":"79ff3190-331d-44da-9149-343832997455","Type":"ContainerStarted","Data":"7d69f170dff10b59c25e3ab06f4d2d6bd1a41457a2f21ad759610cbe760940a5"} Jul 21 02:09:40.545910 ip-10-0-132-244 kubenswrapper[2553]: E0721 02:09:40.545881 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7538-140632279585712\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="ff3b0961-86cb-47b8-9a4b-42de933d76e5" pod="opendatahub/test-curl-7538-140632279585712" Jul 21 02:09:40.835535 ip-10-0-132-244 kubenswrapper[2553]: E0721 02:09:40.835448 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7538-140632279585712\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="ff3b0961-86cb-47b8-9a4b-42de933d76e5" pod="opendatahub/test-curl-7538-140632279585712" Jul 21 02:09:40.836806 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:40.836775 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff3b0961-86cb-47b8-9a4b-42de933d76e5" path="/var/lib/kubelet/pods/ff3b0961-86cb-47b8-9a4b-42de933d76e5/volumes" Jul 21 02:09:41.540102 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:41.540066 2553 generic.go:356] "Generic (PLEG): container finished" podID="79ff3190-331d-44da-9149-343832997455" containerID="e10a7025f71221e4a3741c66ecdc7ad5de34d26d8ce4d89c7bbe4dfbcc07b8db" exitCode=0 Jul 21 02:09:41.540315 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:41.540154 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7538-140632279507136" event={"ID":"79ff3190-331d-44da-9149-343832997455","Type":"ContainerDied","Data":"e10a7025f71221e4a3741c66ecdc7ad5de34d26d8ce4d89c7bbe4dfbcc07b8db"} Jul 21 02:09:42.690128 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:42.690104 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279507136" Jul 21 02:09:42.711686 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:42.711656 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7538-140632279507136_79ff3190-331d-44da-9149-343832997455/test-curl-7538-140632279507136/0.log" Jul 21 02:09:42.734996 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:42.734965 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7538-140632279507136"] Jul 21 02:09:42.740481 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:42.740457 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7538-140632279507136"] Jul 21 02:09:42.764267 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:42.764235 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4qt6\" (UniqueName: \"kubernetes.io/projected/79ff3190-331d-44da-9149-343832997455-kube-api-access-x4qt6\") pod \"79ff3190-331d-44da-9149-343832997455\" (UID: \"79ff3190-331d-44da-9149-343832997455\") " Jul 21 02:09:42.766485 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:42.766463 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79ff3190-331d-44da-9149-343832997455-kube-api-access-x4qt6" (OuterVolumeSpecName: "kube-api-access-x4qt6") pod "79ff3190-331d-44da-9149-343832997455" (UID: "79ff3190-331d-44da-9149-343832997455"). InnerVolumeSpecName "kube-api-access-x4qt6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:09:42.836374 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:42.836292 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79ff3190-331d-44da-9149-343832997455" path="/var/lib/kubelet/pods/79ff3190-331d-44da-9149-343832997455/volumes" Jul 21 02:09:42.865896 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:42.865862 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4qt6\" (UniqueName: \"kubernetes.io/projected/79ff3190-331d-44da-9149-343832997455-kube-api-access-x4qt6\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:09:43.559026 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:43.558997 2553 scope.go:117] "RemoveContainer" containerID="e10a7025f71221e4a3741c66ecdc7ad5de34d26d8ce4d89c7bbe4dfbcc07b8db" Jul 21 02:09:43.559195 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:43.558999 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279507136" Jul 21 02:09:45.870545 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:45.870510 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7538-140632277681184"] Jul 21 02:09:45.870978 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:45.870962 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79ff3190-331d-44da-9149-343832997455" containerName="test-curl-7538-140632279507136" Jul 21 02:09:45.871024 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:45.870980 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="79ff3190-331d-44da-9149-343832997455" containerName="test-curl-7538-140632279507136" Jul 21 02:09:45.871079 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:45.871070 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="79ff3190-331d-44da-9149-343832997455" containerName="test-curl-7538-140632279507136" Jul 21 02:09:45.874201 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:45.874182 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632277681184" Jul 21 02:09:45.877239 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:45.877217 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wjdmg\"" Jul 21 02:09:45.881079 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:45.881040 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7538-140632277681184"] Jul 21 02:09:45.897516 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:45.897485 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfkr2\" (UniqueName: \"kubernetes.io/projected/e2233d61-831d-4fed-9a22-d09d6b890d3c-kube-api-access-qfkr2\") pod \"test-curl-7538-140632277681184\" (UID: \"e2233d61-831d-4fed-9a22-d09d6b890d3c\") " pod="opendatahub/test-curl-7538-140632277681184" Jul 21 02:09:45.998846 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:45.998789 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfkr2\" (UniqueName: \"kubernetes.io/projected/e2233d61-831d-4fed-9a22-d09d6b890d3c-kube-api-access-qfkr2\") pod \"test-curl-7538-140632277681184\" (UID: \"e2233d61-831d-4fed-9a22-d09d6b890d3c\") " pod="opendatahub/test-curl-7538-140632277681184" Jul 21 02:09:46.007566 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:46.007540 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfkr2\" (UniqueName: \"kubernetes.io/projected/e2233d61-831d-4fed-9a22-d09d6b890d3c-kube-api-access-qfkr2\") pod \"test-curl-7538-140632277681184\" (UID: \"e2233d61-831d-4fed-9a22-d09d6b890d3c\") " pod="opendatahub/test-curl-7538-140632277681184" Jul 21 02:09:46.185009 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:46.184906 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632277681184" Jul 21 02:09:46.330282 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:46.330257 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7538-140632277681184"] Jul 21 02:09:46.332042 ip-10-0-132-244 kubenswrapper[2553]: W0721 02:09:46.332016 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2233d61_831d_4fed_9a22_d09d6b890d3c.slice/crio-c425e640a80d7fc18f7a42aa0c4d4d70bffbf858d4aee9a82bd4a626ee25bfdd WatchSource:0}: Error finding container c425e640a80d7fc18f7a42aa0c4d4d70bffbf858d4aee9a82bd4a626ee25bfdd: Status 404 returned error can't find the container with id c425e640a80d7fc18f7a42aa0c4d4d70bffbf858d4aee9a82bd4a626ee25bfdd Jul 21 02:09:46.580141 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:46.580107 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7538-140632277681184" event={"ID":"e2233d61-831d-4fed-9a22-d09d6b890d3c","Type":"ContainerStarted","Data":"c425e640a80d7fc18f7a42aa0c4d4d70bffbf858d4aee9a82bd4a626ee25bfdd"} Jul 21 02:09:47.587824 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:47.587757 2553 generic.go:356] "Generic (PLEG): container finished" podID="e2233d61-831d-4fed-9a22-d09d6b890d3c" containerID="cee56468388be95e0f2b544bc5f85406d69ddab0307661348ccffb592d6166ac" exitCode=0 Jul 21 02:09:47.588260 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:47.587900 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7538-140632277681184" event={"ID":"e2233d61-831d-4fed-9a22-d09d6b890d3c","Type":"ContainerDied","Data":"cee56468388be95e0f2b544bc5f85406d69ddab0307661348ccffb592d6166ac"} Jul 21 02:09:48.738239 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:48.738212 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632277681184" Jul 21 02:09:48.764252 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:48.764223 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7538-140632277681184_e2233d61-831d-4fed-9a22-d09d6b890d3c/test-curl-7538-140632277681184/0.log" Jul 21 02:09:48.788196 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:48.788158 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7538-140632277681184"] Jul 21 02:09:48.792390 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:48.792360 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7538-140632277681184"] Jul 21 02:09:48.827876 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:48.827842 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfkr2\" (UniqueName: \"kubernetes.io/projected/e2233d61-831d-4fed-9a22-d09d6b890d3c-kube-api-access-qfkr2\") pod \"e2233d61-831d-4fed-9a22-d09d6b890d3c\" (UID: \"e2233d61-831d-4fed-9a22-d09d6b890d3c\") " Jul 21 02:09:48.830225 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:48.830192 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2233d61-831d-4fed-9a22-d09d6b890d3c-kube-api-access-qfkr2" (OuterVolumeSpecName: "kube-api-access-qfkr2") pod "e2233d61-831d-4fed-9a22-d09d6b890d3c" (UID: "e2233d61-831d-4fed-9a22-d09d6b890d3c"). InnerVolumeSpecName "kube-api-access-qfkr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:09:48.837221 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:48.837196 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2233d61-831d-4fed-9a22-d09d6b890d3c" path="/var/lib/kubelet/pods/e2233d61-831d-4fed-9a22-d09d6b890d3c/volumes" Jul 21 02:09:48.928845 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:48.928781 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfkr2\" (UniqueName: \"kubernetes.io/projected/e2233d61-831d-4fed-9a22-d09d6b890d3c-kube-api-access-qfkr2\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:09:49.607112 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:49.607079 2553 scope.go:117] "RemoveContainer" containerID="cee56468388be95e0f2b544bc5f85406d69ddab0307661348ccffb592d6166ac" Jul 21 02:09:49.607306 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:09:49.607240 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632277681184" Jul 21 02:10:13.761708 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:13.761672 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p"] Jul 21 02:10:13.762474 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:13.761889 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" podUID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" containerName="istio-proxy" containerID="cri-o://4e0f99ea0fa48aa5409303602f634231aefffc6dba50b0bf636262579e6b6301" gracePeriod=30 Jul 21 02:10:19.031416 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.031349 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:10:19.121998 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.121957 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istiod-ca-cert\") pod \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " Jul 21 02:10:19.121998 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122001 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-workload-socket\") pod \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " Jul 21 02:10:19.122337 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122044 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-token\") pod \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " Jul 21 02:10:19.122337 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122074 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-data\") pod \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " Jul 21 02:10:19.122337 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122104 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-podinfo\") pod \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " Jul 21 02:10:19.122337 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122148 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86ctp\" (UniqueName: \"kubernetes.io/projected/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-kube-api-access-86ctp\") pod \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " Jul 21 02:10:19.122337 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122182 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-envoy\") pod \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " Jul 21 02:10:19.122337 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122212 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-workload-certs\") pod \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " Jul 21 02:10:19.122337 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122239 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-credential-socket\") pod \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\" (UID: \"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0\") " Jul 21 02:10:19.122703 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122383 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" (UID: "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:10:19.122703 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122406 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" (UID: "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:10:19.122703 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122521 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" (UID: "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:10:19.122703 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122598 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" (UID: "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:10:19.122703 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122691 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:19.123170 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122709 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:19.123170 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122726 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:19.123170 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.122742 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:19.123333 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.123299 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-data" (OuterVolumeSpecName: "istio-data") pod "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" (UID: "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:10:19.124687 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.124656 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-token" (OuterVolumeSpecName: "istio-token") pod "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" (UID: "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:10:19.124687 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.124656 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" (UID: "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:10:19.124922 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.124713 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-kube-api-access-86ctp" (OuterVolumeSpecName: "kube-api-access-86ctp") pod "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" (UID: "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0"). InnerVolumeSpecName "kube-api-access-86ctp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:10:19.124922 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.124761 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" (UID: "5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 02:10:19.223933 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.223894 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:19.223933 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.223925 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:19.223933 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.223935 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86ctp\" (UniqueName: \"kubernetes.io/projected/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-kube-api-access-86ctp\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:19.223933 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.223946 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:19.224219 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.223955 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:19.792720 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.792680 2553 generic.go:356] "Generic (PLEG): container finished" podID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" containerID="4e0f99ea0fa48aa5409303602f634231aefffc6dba50b0bf636262579e6b6301" exitCode=0 Jul 21 02:10:19.792924 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.792735 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" Jul 21 02:10:19.792924 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.792763 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" event={"ID":"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0","Type":"ContainerDied","Data":"4e0f99ea0fa48aa5409303602f634231aefffc6dba50b0bf636262579e6b6301"} Jul 21 02:10:19.792924 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.792851 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p" event={"ID":"5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0","Type":"ContainerDied","Data":"1d586fa5445c231850bf91538647afa4182dd0e6edf3bf23eb947a496c1109c2"} Jul 21 02:10:19.792924 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.792879 2553 scope.go:117] "RemoveContainer" containerID="4e0f99ea0fa48aa5409303602f634231aefffc6dba50b0bf636262579e6b6301" Jul 21 02:10:19.803882 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.803789 2553 scope.go:117] "RemoveContainer" containerID="e70c4cdbd2c9d530876c1eb05822bf218a811681339d29fa4e17411d05ccda96" Jul 21 02:10:19.812982 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.812957 2553 scope.go:117] "RemoveContainer" containerID="4e0f99ea0fa48aa5409303602f634231aefffc6dba50b0bf636262579e6b6301" Jul 21 02:10:19.813258 ip-10-0-132-244 kubenswrapper[2553]: E0721 02:10:19.813241 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e0f99ea0fa48aa5409303602f634231aefffc6dba50b0bf636262579e6b6301\": container with ID starting with 4e0f99ea0fa48aa5409303602f634231aefffc6dba50b0bf636262579e6b6301 not found: ID does not exist" containerID="4e0f99ea0fa48aa5409303602f634231aefffc6dba50b0bf636262579e6b6301" Jul 21 02:10:19.813319 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.813268 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e0f99ea0fa48aa5409303602f634231aefffc6dba50b0bf636262579e6b6301"} err="failed to get container status \"4e0f99ea0fa48aa5409303602f634231aefffc6dba50b0bf636262579e6b6301\": rpc error: code = NotFound desc = could not find container \"4e0f99ea0fa48aa5409303602f634231aefffc6dba50b0bf636262579e6b6301\": container with ID starting with 4e0f99ea0fa48aa5409303602f634231aefffc6dba50b0bf636262579e6b6301 not found: ID does not exist" Jul 21 02:10:19.813319 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.813285 2553 scope.go:117] "RemoveContainer" containerID="e70c4cdbd2c9d530876c1eb05822bf218a811681339d29fa4e17411d05ccda96" Jul 21 02:10:19.813514 ip-10-0-132-244 kubenswrapper[2553]: E0721 02:10:19.813495 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e70c4cdbd2c9d530876c1eb05822bf218a811681339d29fa4e17411d05ccda96\": container with ID starting with e70c4cdbd2c9d530876c1eb05822bf218a811681339d29fa4e17411d05ccda96 not found: ID does not exist" containerID="e70c4cdbd2c9d530876c1eb05822bf218a811681339d29fa4e17411d05ccda96" Jul 21 02:10:19.813569 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.813525 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e70c4cdbd2c9d530876c1eb05822bf218a811681339d29fa4e17411d05ccda96"} err="failed to get container status \"e70c4cdbd2c9d530876c1eb05822bf218a811681339d29fa4e17411d05ccda96\": rpc error: code = NotFound desc = could not find container \"e70c4cdbd2c9d530876c1eb05822bf218a811681339d29fa4e17411d05ccda96\": container with ID starting with e70c4cdbd2c9d530876c1eb05822bf218a811681339d29fa4e17411d05ccda96 not found: ID does not exist" Jul 21 02:10:19.819197 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.819174 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p"] Jul 21 02:10:19.825182 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:19.825159 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0dfbd0-openshift-default-9cbdc8db7-xnp8p"] Jul 21 02:10:20.842933 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:20.842899 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" path="/var/lib/kubelet/pods/5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0/volumes" Jul 21 02:10:35.751396 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:35.751362 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8"] Jul 21 02:10:35.751836 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:35.751608 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" podUID="d8536ac7-44a1-4527-a2f4-ea2645f61b1d" containerName="istio-proxy" containerID="cri-o://33cd782311909e83fff0d829685e0094d2d672c6f428356759a7e087c5251783" gracePeriod=30 Jul 21 02:10:36.412506 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:36.412471 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-784686956b-flxbc_50216fc0-4af4-45c3-a3c9-582df1698921/authorino/0.log" Jul 21 02:10:40.923368 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:40.923338 2553 generic.go:356] "Generic (PLEG): container finished" podID="d8536ac7-44a1-4527-a2f4-ea2645f61b1d" containerID="33cd782311909e83fff0d829685e0094d2d672c6f428356759a7e087c5251783" exitCode=0 Jul 21 02:10:40.923790 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:40.923423 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" event={"ID":"d8536ac7-44a1-4527-a2f4-ea2645f61b1d","Type":"ContainerDied","Data":"33cd782311909e83fff0d829685e0094d2d672c6f428356759a7e087c5251783"} Jul 21 02:10:40.923790 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:40.923504 2553 scope.go:117] "RemoveContainer" containerID="dedeb4f3c0604cbeae6a2fc64bd241828a02f417fdc9de8bfd573f395a7ec26d" Jul 21 02:10:41.012463 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.012438 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:10:41.142674 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.142587 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-podinfo\") pod \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " Jul 21 02:10:41.142674 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.142638 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istiod-ca-cert\") pod \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " Jul 21 02:10:41.142674 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.142660 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-workload-socket\") pod \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " Jul 21 02:10:41.143008 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.142709 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-credential-socket\") pod \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " Jul 21 02:10:41.143008 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.142728 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-data\") pod \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " Jul 21 02:10:41.143008 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.142789 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5r8w\" (UniqueName: \"kubernetes.io/projected/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-kube-api-access-b5r8w\") pod \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " Jul 21 02:10:41.143008 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.142852 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-token\") pod \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " Jul 21 02:10:41.143008 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.142873 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-envoy\") pod \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " Jul 21 02:10:41.143008 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.142911 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-workload-certs\") pod \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\" (UID: \"d8536ac7-44a1-4527-a2f4-ea2645f61b1d\") " Jul 21 02:10:41.143228 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.143114 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d8536ac7-44a1-4527-a2f4-ea2645f61b1d" (UID: "d8536ac7-44a1-4527-a2f4-ea2645f61b1d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:10:41.143289 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.143271 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:41.143345 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.143307 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d8536ac7-44a1-4527-a2f4-ea2645f61b1d" (UID: "d8536ac7-44a1-4527-a2f4-ea2645f61b1d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:10:41.143500 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.143426 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d8536ac7-44a1-4527-a2f4-ea2645f61b1d" (UID: "d8536ac7-44a1-4527-a2f4-ea2645f61b1d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:10:41.143500 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.143468 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d8536ac7-44a1-4527-a2f4-ea2645f61b1d" (UID: "d8536ac7-44a1-4527-a2f4-ea2645f61b1d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:10:41.143929 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.143899 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d8536ac7-44a1-4527-a2f4-ea2645f61b1d" (UID: "d8536ac7-44a1-4527-a2f4-ea2645f61b1d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:10:41.145168 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.145143 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d8536ac7-44a1-4527-a2f4-ea2645f61b1d" (UID: "d8536ac7-44a1-4527-a2f4-ea2645f61b1d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 02:10:41.145540 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.145519 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d8536ac7-44a1-4527-a2f4-ea2645f61b1d" (UID: "d8536ac7-44a1-4527-a2f4-ea2645f61b1d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:10:41.145717 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.145693 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d8536ac7-44a1-4527-a2f4-ea2645f61b1d" (UID: "d8536ac7-44a1-4527-a2f4-ea2645f61b1d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:10:41.145764 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.145721 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-kube-api-access-b5r8w" (OuterVolumeSpecName: "kube-api-access-b5r8w") pod "d8536ac7-44a1-4527-a2f4-ea2645f61b1d" (UID: "d8536ac7-44a1-4527-a2f4-ea2645f61b1d"). InnerVolumeSpecName "kube-api-access-b5r8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:10:41.244614 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.244581 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5r8w\" (UniqueName: \"kubernetes.io/projected/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-kube-api-access-b5r8w\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:41.244614 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.244611 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:41.244614 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.244620 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:41.244883 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.244628 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:41.244883 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.244638 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:41.244883 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.244645 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:41.244883 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.244653 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:41.244883 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.244661 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8536ac7-44a1-4527-a2f4-ea2645f61b1d-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\"" Jul 21 02:10:41.831082 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.831041 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fzhsm_b52c61c1-a6aa-417e-9d4f-37030b5f3f8e/manager/0.log" Jul 21 02:10:41.931917 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.931883 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" event={"ID":"d8536ac7-44a1-4527-a2f4-ea2645f61b1d","Type":"ContainerDied","Data":"e215cdf8a90a1c7dc9230e4353123e2d9ab825a89c14d30d66098eee61c37585"} Jul 21 02:10:41.931917 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.931909 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8" Jul 21 02:10:41.932465 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.931970 2553 scope.go:117] "RemoveContainer" containerID="33cd782311909e83fff0d829685e0094d2d672c6f428356759a7e087c5251783" Jul 21 02:10:41.952866 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.952831 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-r5qkc_532f1f78-aa89-40b8-95ad-6f6ec02d2c4b/manager/0.log" Jul 21 02:10:41.956749 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.956722 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8"] Jul 21 02:10:41.962911 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:41.962887 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-a256ec-openshift-default-76b9c55d59-pj2m8"] Jul 21 02:10:42.199761 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:42.199688 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5jp44_62ae8016-3970-4793-99e1-db4a3e3b8b25/server/0.log" Jul 21 02:10:42.326167 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:42.326137 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-khdgr_9df12abe-28a2-4998-b63f-fe5b60e5aead/manager/0.log" Jul 21 02:10:42.440871 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:42.440842 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74c7b5f9f-6tp6g_f19a9334-decc-46cd-8d77-9c85d5f2e5d5/copy-manifests/0.log" Jul 21 02:10:42.447170 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:42.447143 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74c7b5f9f-6tp6g_f19a9334-decc-46cd-8d77-9c85d5f2e5d5/manager/0.log" Jul 21 02:10:42.837892 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:42.837857 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8536ac7-44a1-4527-a2f4-ea2645f61b1d" path="/var/lib/kubelet/pods/d8536ac7-44a1-4527-a2f4-ea2645f61b1d/volumes" Jul 21 02:10:44.210202 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:44.210172 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb_a91016dc-76fe-4084-a1b2-b09cc6f2a4bb/pull/0.log" Jul 21 02:10:44.216680 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:44.216659 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb_a91016dc-76fe-4084-a1b2-b09cc6f2a4bb/extract/0.log" Jul 21 02:10:44.222897 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:44.222870 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb_a91016dc-76fe-4084-a1b2-b09cc6f2a4bb/util/0.log" Jul 21 02:10:44.341319 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:44.341287 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp_d259804e-7ec4-4b58-86fa-884a71977fc6/util/0.log" Jul 21 02:10:44.348629 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:44.348600 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp_d259804e-7ec4-4b58-86fa-884a71977fc6/pull/0.log" Jul 21 02:10:44.356483 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:44.356461 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp_d259804e-7ec4-4b58-86fa-884a71977fc6/extract/0.log" Jul 21 02:10:44.468873 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:44.468765 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc_13c55319-0019-4c62-bedf-360bbe883528/util/0.log" Jul 21 02:10:44.475558 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:44.475536 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc_13c55319-0019-4c62-bedf-360bbe883528/pull/0.log" Jul 21 02:10:44.481851 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:44.481824 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc_13c55319-0019-4c62-bedf-360bbe883528/extract/0.log" Jul 21 02:10:44.594521 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:44.594491 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq_716404c9-8285-4b94-9e70-a80fda11795c/extract/0.log" Jul 21 02:10:44.600717 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:44.600700 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq_716404c9-8285-4b94-9e70-a80fda11795c/util/0.log" Jul 21 02:10:44.606975 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:44.606958 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq_716404c9-8285-4b94-9e70-a80fda11795c/pull/0.log" Jul 21 02:10:44.730740 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:44.730710 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-784686956b-flxbc_50216fc0-4af4-45c3-a3c9-582df1698921/authorino/0.log" Jul 21 02:10:44.866844 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:44.866811 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-m5nl9_104697a2-70c6-44eb-9413-3c502c68c87c/manager/0.log" Jul 21 02:10:44.976044 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:44.976014 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qmpr4_7a5bdf0d-9e31-4b3a-bf49-898358287568/manager/0.log" Jul 21 02:10:45.203777 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:45.203700 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tmfxb_f8c628e1-1592-4759-8bf5-1add00a1fe7f/registry-server/0.log" Jul 21 02:10:45.331653 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:45.331624 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dk67b_40914193-ef9a-4964-a822-ab0888884c7b/manager/0.log" Jul 21 02:10:45.585980 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:45.585949 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cf2bw_5d403120-e90e-44b3-8cc6-e0b0ec14743a/manager/0.log" Jul 21 02:10:45.941973 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:45.941892 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6787h68s_1b38387d-1fd0-4053-9a05-16b7bd7c3462/istio-proxy/0.log" Jul 21 02:10:46.293871 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:46.293840 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dd4bbd9-j2kp9_ee9bc36f-5a20-4a59-87b4-c31d365326d6/kube-auth-proxy/0.log" Jul 21 02:10:46.416164 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:46.416134 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-lxqcx_ce470538-e0e7-402b-bf10-5f77b137c4ef/istio-proxy/1.log" Jul 21 02:10:46.654263 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:46.654188 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-krn4g_8f6aab8f-ec51-4e02-9571-3d67f696da3f/payload-processing/0.log" Jul 21 02:10:46.768376 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:46.768344 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7789f5dbd8-ppcw5_9255a818-3a1b-4d27-b06c-a668e13160fe/router/0.log" Jul 21 02:10:47.136075 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:47.136034 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-qpdjf_e6f5d29a-9881-4ebd-9823-d2ef35e7e0b5/main/0.log" Jul 21 02:10:47.361883 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:47.361856 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-fp6kv_0c266739-af5e-4285-9183-f3ecbf29a66c/main/0.log" Jul 21 02:10:53.301772 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.301735 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-whjhw/must-gather-q8q4n"] Jul 21 02:10:53.302413 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.302387 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2233d61-831d-4fed-9a22-d09d6b890d3c" containerName="test-curl-7538-140632277681184" Jul 21 02:10:53.302511 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.302417 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2233d61-831d-4fed-9a22-d09d6b890d3c" containerName="test-curl-7538-140632277681184" Jul 21 02:10:53.302511 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.302449 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" containerName="istio-proxy" Jul 21 02:10:53.302511 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.302459 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" containerName="istio-proxy" Jul 21 02:10:53.302511 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.302483 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8536ac7-44a1-4527-a2f4-ea2645f61b1d" containerName="istio-proxy" Jul 21 02:10:53.302511 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.302491 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8536ac7-44a1-4527-a2f4-ea2645f61b1d" containerName="istio-proxy" Jul 21 02:10:53.302511 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.302507 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8536ac7-44a1-4527-a2f4-ea2645f61b1d" containerName="istio-proxy" Jul 21 02:10:53.302858 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.302515 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8536ac7-44a1-4527-a2f4-ea2645f61b1d" containerName="istio-proxy" Jul 21 02:10:53.302858 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.302625 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8536ac7-44a1-4527-a2f4-ea2645f61b1d" containerName="istio-proxy" Jul 21 02:10:53.302858 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.302638 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" containerName="istio-proxy" Jul 21 02:10:53.302858 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.302647 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8536ac7-44a1-4527-a2f4-ea2645f61b1d" containerName="istio-proxy" Jul 21 02:10:53.302858 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.302658 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" containerName="istio-proxy" Jul 21 02:10:53.302858 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.302666 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2233d61-831d-4fed-9a22-d09d6b890d3c" containerName="test-curl-7538-140632277681184" Jul 21 02:10:53.302858 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.302767 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" containerName="istio-proxy" Jul 21 02:10:53.302858 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.302775 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2ef33f-8a7e-4f1f-8fb7-04a86b95a6f0" containerName="istio-proxy" Jul 21 02:10:53.307847 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.307782 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whjhw/must-gather-q8q4n" Jul 21 02:10:53.312677 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.312647 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-whjhw\"/\"openshift-service-ca.crt\"" Jul 21 02:10:53.312838 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.312715 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-whjhw\"/\"kube-root-ca.crt\"" Jul 21 02:10:53.312838 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.312658 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-whjhw\"/\"default-dockercfg-vdthq\"" Jul 21 02:10:53.318909 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.318886 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whjhw/must-gather-q8q4n"] Jul 21 02:10:53.460326 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.460290 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf77h\" (UniqueName: \"kubernetes.io/projected/7767ca72-e47a-45d5-8d11-9efa3cb0d91d-kube-api-access-hf77h\") pod \"must-gather-q8q4n\" (UID: \"7767ca72-e47a-45d5-8d11-9efa3cb0d91d\") " pod="openshift-must-gather-whjhw/must-gather-q8q4n" Jul 21 02:10:53.460519 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.460352 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7767ca72-e47a-45d5-8d11-9efa3cb0d91d-must-gather-output\") pod \"must-gather-q8q4n\" (UID: \"7767ca72-e47a-45d5-8d11-9efa3cb0d91d\") " pod="openshift-must-gather-whjhw/must-gather-q8q4n" Jul 21 02:10:53.561296 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.561204 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf77h\" (UniqueName: \"kubernetes.io/projected/7767ca72-e47a-45d5-8d11-9efa3cb0d91d-kube-api-access-hf77h\") pod \"must-gather-q8q4n\" (UID: \"7767ca72-e47a-45d5-8d11-9efa3cb0d91d\") " pod="openshift-must-gather-whjhw/must-gather-q8q4n" Jul 21 02:10:53.561296 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.561284 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7767ca72-e47a-45d5-8d11-9efa3cb0d91d-must-gather-output\") pod \"must-gather-q8q4n\" (UID: \"7767ca72-e47a-45d5-8d11-9efa3cb0d91d\") " pod="openshift-must-gather-whjhw/must-gather-q8q4n" Jul 21 02:10:53.561640 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.561619 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7767ca72-e47a-45d5-8d11-9efa3cb0d91d-must-gather-output\") pod \"must-gather-q8q4n\" (UID: \"7767ca72-e47a-45d5-8d11-9efa3cb0d91d\") " pod="openshift-must-gather-whjhw/must-gather-q8q4n" Jul 21 02:10:53.579105 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.579070 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf77h\" (UniqueName: \"kubernetes.io/projected/7767ca72-e47a-45d5-8d11-9efa3cb0d91d-kube-api-access-hf77h\") pod \"must-gather-q8q4n\" (UID: \"7767ca72-e47a-45d5-8d11-9efa3cb0d91d\") " pod="openshift-must-gather-whjhw/must-gather-q8q4n" Jul 21 02:10:53.618206 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.618172 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whjhw/must-gather-q8q4n" Jul 21 02:10:53.768222 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:53.768182 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whjhw/must-gather-q8q4n"] Jul 21 02:10:53.769734 ip-10-0-132-244 kubenswrapper[2553]: W0721 02:10:53.769709 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7767ca72_e47a_45d5_8d11_9efa3cb0d91d.slice/crio-99015f477a846e9ea9a39f4b2837b72742345cd92892cb2c3ec1073bbddff2a6 WatchSource:0}: Error finding container 99015f477a846e9ea9a39f4b2837b72742345cd92892cb2c3ec1073bbddff2a6: Status 404 returned error can't find the container with id 99015f477a846e9ea9a39f4b2837b72742345cd92892cb2c3ec1073bbddff2a6 Jul 21 02:10:54.005198 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:54.005168 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whjhw/must-gather-q8q4n" event={"ID":"7767ca72-e47a-45d5-8d11-9efa3cb0d91d","Type":"ContainerStarted","Data":"99015f477a846e9ea9a39f4b2837b72742345cd92892cb2c3ec1073bbddff2a6"} Jul 21 02:10:55.016155 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:55.016107 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whjhw/must-gather-q8q4n" event={"ID":"7767ca72-e47a-45d5-8d11-9efa3cb0d91d","Type":"ContainerStarted","Data":"1907aca054138e3a9ac918ec8f6d1406dfd6f8dec11e37ff10821f8422166b72"} Jul 21 02:10:55.016669 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:55.016169 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whjhw/must-gather-q8q4n" event={"ID":"7767ca72-e47a-45d5-8d11-9efa3cb0d91d","Type":"ContainerStarted","Data":"2d639324eef212791e0c1e0c01d58e4c43790dd3e3421ef8dfdd6fb0d56ca0dd"} Jul 21 02:10:55.037479 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:55.037409 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-whjhw/must-gather-q8q4n" podStartSLOduration=1.190380926 podStartE2EDuration="2.037385003s" totalImagesPullingTime="847.004077ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:55.034537418 +0000 UTC m=+2934.721185975" watchObservedRunningTime="2026-07-21 02:10:55.037385003 +0000 UTC m=+2934.724033560" Jul 21 02:10:56.179241 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:56.179214 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gssj9_47b65ca9-dc09-4748-a6db-6a40b0b156aa/global-pull-secret-syncer/0.log" Jul 21 02:10:56.380979 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:56.380946 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xwk4v_b016df69-313e-4c83-9a41-db3e34730566/konnectivity-agent/0.log" Jul 21 02:10:56.529019 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:10:56.528986 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-244.ec2.internal_33bb07fd6488aabd85ee56d2bdf92fd8/haproxy/0.log" Jul 21 02:11:00.574472 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:00.574444 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb_a91016dc-76fe-4084-a1b2-b09cc6f2a4bb/extract/0.log" Jul 21 02:11:00.594667 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:00.594637 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb_a91016dc-76fe-4084-a1b2-b09cc6f2a4bb/util/0.log" Jul 21 02:11:00.613692 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:00.613663 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vq9xb_a91016dc-76fe-4084-a1b2-b09cc6f2a4bb/pull/0.log" Jul 21 02:11:00.647679 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:00.647646 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp_d259804e-7ec4-4b58-86fa-884a71977fc6/extract/0.log" Jul 21 02:11:00.700923 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:00.700890 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp_d259804e-7ec4-4b58-86fa-884a71977fc6/util/0.log" Jul 21 02:11:00.764010 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:00.763642 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzpgp_d259804e-7ec4-4b58-86fa-884a71977fc6/pull/0.log" Jul 21 02:11:00.796645 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:00.796621 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc_13c55319-0019-4c62-bedf-360bbe883528/extract/0.log" Jul 21 02:11:00.819879 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:00.819852 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc_13c55319-0019-4c62-bedf-360bbe883528/util/0.log" Jul 21 02:11:00.846815 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:00.846717 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cwsbc_13c55319-0019-4c62-bedf-360bbe883528/pull/0.log" Jul 21 02:11:00.877602 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:00.877565 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq_716404c9-8285-4b94-9e70-a80fda11795c/extract/0.log" Jul 21 02:11:00.903500 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:00.903472 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq_716404c9-8285-4b94-9e70-a80fda11795c/util/0.log" Jul 21 02:11:00.924837 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:00.924789 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c2wsq_716404c9-8285-4b94-9e70-a80fda11795c/pull/0.log" Jul 21 02:11:01.420604 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:01.420223 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-784686956b-flxbc_50216fc0-4af4-45c3-a3c9-582df1698921/authorino/0.log" Jul 21 02:11:01.456830 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:01.454192 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-m5nl9_104697a2-70c6-44eb-9413-3c502c68c87c/manager/0.log" Jul 21 02:11:01.498260 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:01.498226 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qmpr4_7a5bdf0d-9e31-4b3a-bf49-898358287568/manager/0.log" Jul 21 02:11:01.572596 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:01.572495 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tmfxb_f8c628e1-1592-4759-8bf5-1add00a1fe7f/registry-server/0.log" Jul 21 02:11:01.774371 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:01.774348 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dk67b_40914193-ef9a-4964-a822-ab0888884c7b/manager/0.log" Jul 21 02:11:01.887881 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:01.886482 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cf2bw_5d403120-e90e-44b3-8cc6-e0b0ec14743a/manager/0.log" Jul 21 02:11:03.865911 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:03.865870 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-b7jkk_f1fd6a51-620f-4a81-83c1-1fdfc308cf6b/cluster-monitoring-operator/0.log" Jul 21 02:11:04.059020 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:04.058993 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9dssm_7bb12194-2b28-413b-9f03-42f8b0405385/node-exporter/0.log" Jul 21 02:11:04.079008 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:04.078980 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9dssm_7bb12194-2b28-413b-9f03-42f8b0405385/kube-rbac-proxy/0.log" Jul 21 02:11:04.098840 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:04.098811 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9dssm_7bb12194-2b28-413b-9f03-42f8b0405385/init-textfile/0.log" Jul 21 02:11:06.068929 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.068899 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-9znl2_a3871dc2-4b1d-48c5-9654-488e1c2eba0a/networking-console-plugin/0.log" Jul 21 02:11:06.647247 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.647211 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t"] Jul 21 02:11:06.653637 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.653601 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.660446 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.660413 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t"] Jul 21 02:11:06.706564 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.706505 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/2.log" Jul 21 02:11:06.712558 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.712533 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6s4th_73bb25b0-6876-4c1b-8fdd-fde15f47b714/console-operator/3.log" Jul 21 02:11:06.729941 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.727163 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e999f41b-cf46-43b9-a4f9-ad66157952e5-lib-modules\") pod \"perf-node-gather-daemonset-qmx8t\" (UID: \"e999f41b-cf46-43b9-a4f9-ad66157952e5\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.729941 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.727254 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e999f41b-cf46-43b9-a4f9-ad66157952e5-podres\") pod \"perf-node-gather-daemonset-qmx8t\" (UID: \"e999f41b-cf46-43b9-a4f9-ad66157952e5\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.729941 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.727368 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e999f41b-cf46-43b9-a4f9-ad66157952e5-sys\") pod \"perf-node-gather-daemonset-qmx8t\" (UID: \"e999f41b-cf46-43b9-a4f9-ad66157952e5\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.729941 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.727401 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26vdm\" (UniqueName: \"kubernetes.io/projected/e999f41b-cf46-43b9-a4f9-ad66157952e5-kube-api-access-26vdm\") pod \"perf-node-gather-daemonset-qmx8t\" (UID: \"e999f41b-cf46-43b9-a4f9-ad66157952e5\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.729941 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.727465 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e999f41b-cf46-43b9-a4f9-ad66157952e5-proc\") pod \"perf-node-gather-daemonset-qmx8t\" (UID: \"e999f41b-cf46-43b9-a4f9-ad66157952e5\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.828701 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.828658 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e999f41b-cf46-43b9-a4f9-ad66157952e5-lib-modules\") pod \"perf-node-gather-daemonset-qmx8t\" (UID: \"e999f41b-cf46-43b9-a4f9-ad66157952e5\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.828986 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.828967 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e999f41b-cf46-43b9-a4f9-ad66157952e5-podres\") pod \"perf-node-gather-daemonset-qmx8t\" (UID: \"e999f41b-cf46-43b9-a4f9-ad66157952e5\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.829101 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.829077 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e999f41b-cf46-43b9-a4f9-ad66157952e5-podres\") pod \"perf-node-gather-daemonset-qmx8t\" (UID: \"e999f41b-cf46-43b9-a4f9-ad66157952e5\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.829184 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.828903 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e999f41b-cf46-43b9-a4f9-ad66157952e5-lib-modules\") pod \"perf-node-gather-daemonset-qmx8t\" (UID: \"e999f41b-cf46-43b9-a4f9-ad66157952e5\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.829331 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.829315 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e999f41b-cf46-43b9-a4f9-ad66157952e5-sys\") pod \"perf-node-gather-daemonset-qmx8t\" (UID: \"e999f41b-cf46-43b9-a4f9-ad66157952e5\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.829442 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.829428 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26vdm\" (UniqueName: \"kubernetes.io/projected/e999f41b-cf46-43b9-a4f9-ad66157952e5-kube-api-access-26vdm\") pod \"perf-node-gather-daemonset-qmx8t\" (UID: \"e999f41b-cf46-43b9-a4f9-ad66157952e5\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.829561 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.829532 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e999f41b-cf46-43b9-a4f9-ad66157952e5-proc\") pod \"perf-node-gather-daemonset-qmx8t\" (UID: \"e999f41b-cf46-43b9-a4f9-ad66157952e5\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.829836 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.829817 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e999f41b-cf46-43b9-a4f9-ad66157952e5-proc\") pod \"perf-node-gather-daemonset-qmx8t\" (UID: \"e999f41b-cf46-43b9-a4f9-ad66157952e5\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.829992 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.829975 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e999f41b-cf46-43b9-a4f9-ad66157952e5-sys\") pod \"perf-node-gather-daemonset-qmx8t\" (UID: \"e999f41b-cf46-43b9-a4f9-ad66157952e5\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.844821 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.843288 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26vdm\" (UniqueName: \"kubernetes.io/projected/e999f41b-cf46-43b9-a4f9-ad66157952e5-kube-api-access-26vdm\") pod \"perf-node-gather-daemonset-qmx8t\" (UID: \"e999f41b-cf46-43b9-a4f9-ad66157952e5\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:06.967958 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:06.967873 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:07.170784 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:07.170750 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t"] Jul 21 02:11:07.176132 ip-10-0-132-244 kubenswrapper[2553]: W0721 02:11:07.176096 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode999f41b_cf46_43b9_a4f9_ad66157952e5.slice/crio-eb38ebe37d63748cdda8a1eda5619e956f70d15a3f995a273de256798119c04e WatchSource:0}: Error finding container eb38ebe37d63748cdda8a1eda5619e956f70d15a3f995a273de256798119c04e: Status 404 returned error can't find the container with id eb38ebe37d63748cdda8a1eda5619e956f70d15a3f995a273de256798119c04e Jul 21 02:11:07.365282 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:07.365252 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-58cc6599c8-l998m_433961d5-047d-4f2b-ab9e-52a632247bad/console/0.log" Jul 21 02:11:08.029821 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:08.029767 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-p9cfq_32b91753-c60e-4b08-badc-dc0773d8143b/volume-data-source-validator/0.log" Jul 21 02:11:08.178358 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:08.178322 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" event={"ID":"e999f41b-cf46-43b9-a4f9-ad66157952e5","Type":"ContainerStarted","Data":"2ed560bf0a34606daa5dd41ea34bc81fb22688eeee8162992d6bbf8e296fd25d"} Jul 21 02:11:08.178820 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:08.178384 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" event={"ID":"e999f41b-cf46-43b9-a4f9-ad66157952e5","Type":"ContainerStarted","Data":"eb38ebe37d63748cdda8a1eda5619e956f70d15a3f995a273de256798119c04e"} Jul 21 02:11:08.178820 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:08.178495 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:08.197999 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:08.197949 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" podStartSLOduration=2.197933095 podStartE2EDuration="2.197933095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:11:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:11:08.196008493 +0000 UTC m=+2947.882657049" watchObservedRunningTime="2026-07-21 02:11:08.197933095 +0000 UTC m=+2947.884581649" Jul 21 02:11:09.116903 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:09.116862 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zdmk7_5d85b020-179c-45af-aa56-b2d590ec10b8/dns/0.log" Jul 21 02:11:09.134383 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:09.134354 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zdmk7_5d85b020-179c-45af-aa56-b2d590ec10b8/kube-rbac-proxy/0.log" Jul 21 02:11:09.175001 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:09.174976 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dfxqd_8fbee072-3882-4927-832c-417b526001f8/dns-node-resolver/0.log" Jul 21 02:11:09.767149 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:09.767120 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t99s5_832d95fc-ede2-4c3f-88df-2e819c834774/node-ca/0.log" Jul 21 02:11:10.694155 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:10.694121 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6787h68s_1b38387d-1fd0-4053-9a05-16b7bd7c3462/istio-proxy/0.log" Jul 21 02:11:10.852327 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:10.852296 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dd4bbd9-j2kp9_ee9bc36f-5a20-4a59-87b4-c31d365326d6/kube-auth-proxy/0.log" Jul 21 02:11:10.882315 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:10.882282 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-lxqcx_ce470538-e0e7-402b-bf10-5f77b137c4ef/istio-proxy/0.log" Jul 21 02:11:10.917223 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:10.917192 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-lxqcx_ce470538-e0e7-402b-bf10-5f77b137c4ef/istio-proxy/1.log" Jul 21 02:11:10.976142 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:10.976113 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-krn4g_8f6aab8f-ec51-4e02-9571-3d67f696da3f/payload-processing/0.log" Jul 21 02:11:10.996539 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:10.996497 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7789f5dbd8-ppcw5_9255a818-3a1b-4d27-b06c-a668e13160fe/router/0.log" Jul 21 02:11:11.684686 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:11.684653 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-44fmn_c5b6b6a0-c584-40dd-b282-138bac6eb9fb/serve-healthcheck-canary/0.log" Jul 21 02:11:12.181619 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:12.181587 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-xfd6h_b54a3b1b-9ca0-4912-9983-57ad08dafdd5/insights-operator/0.log" Jul 21 02:11:12.182566 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:12.182540 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-xfd6h_b54a3b1b-9ca0-4912-9983-57ad08dafdd5/insights-operator/1.log" Jul 21 02:11:12.201609 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:12.201580 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9vf8g_a40d3be0-6f40-4051-b315-bd86c50f939c/kube-rbac-proxy/0.log" Jul 21 02:11:12.225922 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:12.225895 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9vf8g_a40d3be0-6f40-4051-b315-bd86c50f939c/exporter/0.log" Jul 21 02:11:12.243583 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:12.243553 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9vf8g_a40d3be0-6f40-4051-b315-bd86c50f939c/extractor/0.log" Jul 21 02:11:14.197730 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:14.197692 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-qmx8t" Jul 21 02:11:14.501516 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:14.501483 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fzhsm_b52c61c1-a6aa-417e-9d4f-37030b5f3f8e/manager/0.log" Jul 21 02:11:14.729226 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:14.729189 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-r5qkc_532f1f78-aa89-40b8-95ad-6f6ec02d2c4b/manager/0.log" Jul 21 02:11:14.858756 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:14.858668 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5jp44_62ae8016-3970-4793-99e1-db4a3e3b8b25/server/0.log" Jul 21 02:11:14.943907 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:14.943873 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-khdgr_9df12abe-28a2-4998-b63f-fe5b60e5aead/manager/0.log" Jul 21 02:11:14.971913 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:14.971884 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74c7b5f9f-6tp6g_f19a9334-decc-46cd-8d77-9c85d5f2e5d5/manager/0.log" Jul 21 02:11:14.997456 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:14.997431 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74c7b5f9f-6tp6g_f19a9334-decc-46cd-8d77-9c85d5f2e5d5/copy-manifests/0.log" Jul 21 02:11:16.659654 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:16.659622 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-7jcdv_eecc3d5a-da40-425f-8b56-9af604cc9411/openshift-lws-operator/0.log" Jul 21 02:11:17.397553 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:17.397519 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6787h68s_1b38387d-1fd0-4053-9a05-16b7bd7c3462/istio-proxy/0.log" Jul 21 02:11:17.543308 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:17.543275 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dd4bbd9-j2kp9_ee9bc36f-5a20-4a59-87b4-c31d365326d6/kube-auth-proxy/0.log" Jul 21 02:11:17.560695 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:17.560648 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-lxqcx_ce470538-e0e7-402b-bf10-5f77b137c4ef/istio-proxy/0.log" Jul 21 02:11:17.597427 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:17.597389 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-lxqcx_ce470538-e0e7-402b-bf10-5f77b137c4ef/istio-proxy/1.log" Jul 21 02:11:17.642900 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:17.642869 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-krn4g_8f6aab8f-ec51-4e02-9571-3d67f696da3f/payload-processing/0.log" Jul 21 02:11:17.656214 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:17.656125 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7789f5dbd8-ppcw5_9255a818-3a1b-4d27-b06c-a668e13160fe/router/0.log" Jul 21 02:11:18.889274 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:18.889245 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6787h68s_1b38387d-1fd0-4053-9a05-16b7bd7c3462/istio-proxy/0.log" Jul 21 02:11:19.033822 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:19.033727 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dd4bbd9-j2kp9_ee9bc36f-5a20-4a59-87b4-c31d365326d6/kube-auth-proxy/0.log" Jul 21 02:11:19.051762 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:19.051732 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-lxqcx_ce470538-e0e7-402b-bf10-5f77b137c4ef/istio-proxy/0.log" Jul 21 02:11:19.083529 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:19.083498 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-lxqcx_ce470538-e0e7-402b-bf10-5f77b137c4ef/istio-proxy/1.log" Jul 21 02:11:19.128517 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:19.128488 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-krn4g_8f6aab8f-ec51-4e02-9571-3d67f696da3f/payload-processing/0.log" Jul 21 02:11:19.145103 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:19.145078 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7789f5dbd8-ppcw5_9255a818-3a1b-4d27-b06c-a668e13160fe/router/0.log" Jul 21 02:11:22.037000 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:22.036914 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-t66c8_7d50086c-1067-4d0a-8c37-73f113f4161e/kube-storage-version-migrator-operator/1.log" Jul 21 02:11:22.037911 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:22.037889 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-t66c8_7d50086c-1067-4d0a-8c37-73f113f4161e/kube-storage-version-migrator-operator/0.log" Jul 21 02:11:23.139133 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:23.139104 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h5rs6_cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236/kube-multus-additional-cni-plugins/0.log" Jul 21 02:11:23.162171 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:23.162143 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h5rs6_cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236/egress-router-binary-copy/0.log" Jul 21 02:11:23.182002 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:23.181950 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h5rs6_cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236/cni-plugins/0.log" Jul 21 02:11:23.200860 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:23.200832 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h5rs6_cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236/bond-cni-plugin/0.log" Jul 21 02:11:23.221662 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:23.221632 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h5rs6_cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236/routeoverride-cni/0.log" Jul 21 02:11:23.239438 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:23.239408 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h5rs6_cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236/whereabouts-cni-bincopy/0.log" Jul 21 02:11:23.256792 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:23.256768 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h5rs6_cd5c9d62-e3c5-4a09-ae14-a7c3b8cf1236/whereabouts-cni/0.log" Jul 21 02:11:23.460346 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:23.460269 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hbscb_acc75cec-2891-45d1-bfad-4946a33005ef/kube-multus/0.log" Jul 21 02:11:23.599669 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:23.599638 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zmvvl_00543583-912d-4354-8810-fc0e9f4a54be/network-metrics-daemon/0.log" Jul 21 02:11:23.620306 ip-10-0-132-244 kubenswrapper[2553]: I0721 02:11:23.620280 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zmvvl_00543583-912d-4354-8810-fc0e9f4a54be/kube-rbac-proxy/0.log"