Jul 07 11:10:53.390848 ip-10-0-137-8 systemd[1]: Starting Kubernetes Kubelet... Jul 07 11:10:53.839390 ip-10-0-137-8 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 11:10:53.839390 ip-10-0-137-8 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 11:10:53.839390 ip-10-0-137-8 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 11:10:53.839390 ip-10-0-137-8 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 11:10:53.840051 ip-10-0-137-8 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 11:10:53.840485 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.840403 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 11:10:53.845156 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845141 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 11:10:53.845193 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845157 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 11:10:53.845193 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845161 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 11:10:53.845193 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845164 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 11:10:53.845193 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845167 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 11:10:53.845193 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845170 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 11:10:53.845193 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845173 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 11:10:53.845193 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845176 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 11:10:53.845193 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845179 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 11:10:53.845193 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845181 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 11:10:53.845193 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845191 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 11:10:53.845193 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845194 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 11:10:53.845193 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845198 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845202 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845205 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845208 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845211 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845214 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845216 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845219 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845221 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845224 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845226 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845229 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845231 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845234 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845238 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845241 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845244 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845246 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845249 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 11:10:53.845479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845252 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845255 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845257 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845260 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845264 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845268 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845271 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845274 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845277 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845279 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845282 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845285 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845287 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845289 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845292 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845295 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845298 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845301 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845303 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 11:10:53.845938 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845306 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845308 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845311 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845314 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845316 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845319 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845322 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845324 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845327 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845329 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845332 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845334 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845337 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845339 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845342 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845344 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845347 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845349 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845352 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845355 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845358 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 11:10:53.846446 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845361 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845363 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845366 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845368 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845370 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845373 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845375 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845379 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845382 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845385 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845387 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845390 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845392 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845395 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845397 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845400 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845402 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845405 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845407 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845410 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 11:10:53.846958 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845412 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845414 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845417 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845420 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845422 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845425 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845427 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.845430 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846147 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846154 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846157 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846160 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846163 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846166 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846168 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846171 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846174 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846177 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846180 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846184 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 11:10:53.847435 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846187 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846189 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846192 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846195 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846197 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846200 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846203 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846206 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846208 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846211 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846213 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846216 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846218 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846221 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846223 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846228 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846232 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846235 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846238 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846242 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 11:10:53.847940 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846245 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846247 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846250 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846253 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846256 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846272 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846276 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846279 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846282 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846285 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846287 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846290 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846292 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846295 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846297 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846301 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846305 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846308 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846310 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 11:10:53.848433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846313 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846316 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846318 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846321 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846324 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846326 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846329 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846331 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846334 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846336 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846339 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846341 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846344 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846346 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846349 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846351 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846354 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846356 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846359 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846362 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 11:10:53.848909 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846365 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846368 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846372 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846375 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846378 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846380 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846383 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846385 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846388 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846390 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846393 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846396 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846398 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846400 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846403 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846406 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846408 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846410 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846415 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846417 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 11:10:53.849408 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846420 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846422 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846425 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846428 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846430 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846433 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846435 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846438 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846789 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846795 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846798 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846801 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846804 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846807 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846809 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846812 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846814 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846817 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846819 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846822 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 11:10:53.849908 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846824 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846827 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846830 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846832 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846835 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846837 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846839 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846842 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846845 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846847 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846852 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846854 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846857 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846859 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846862 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846864 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846867 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846869 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846872 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846875 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 11:10:53.850402 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846877 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846880 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846883 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846885 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846888 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846891 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846893 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846896 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846898 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846901 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846903 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846905 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846908 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846911 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846913 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846915 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846918 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846921 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846924 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846926 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 11:10:53.850891 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846929 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846931 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846935 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846938 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846940 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846943 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846945 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846948 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846950 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846954 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846957 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846960 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846962 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846965 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846969 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846973 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846976 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846979 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846982 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846985 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 11:10:53.851417 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846988 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846992 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846996 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.846999 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847002 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847004 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847007 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847010 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847012 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847015 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847018 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847020 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847023 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847025 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847028 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847031 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847033 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847036 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 11:10:53.851914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847038 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847041 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847043 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847047 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847050 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847053 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847055 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847058 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847061 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847134 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847140 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847145 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847149 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847153 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847156 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847161 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847164 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847167 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847170 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847173 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847176 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 11:10:53.852342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847179 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847182 2576 flags.go:64] FLAG: --cgroup-root="" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847185 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847188 2576 flags.go:64] FLAG: --client-ca-file="" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847190 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847193 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847197 2576 flags.go:64] FLAG: --cluster-domain="" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847200 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847203 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847206 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847209 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847213 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847215 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847218 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847222 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847225 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847228 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847230 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847234 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847237 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847241 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847244 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847247 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847250 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847252 2576 flags.go:64] FLAG: --enable-server="true" Jul 07 11:10:53.852844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847256 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847264 2576 flags.go:64] FLAG: --event-burst="100" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847267 2576 flags.go:64] FLAG: --event-qps="50" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847270 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847273 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847276 2576 flags.go:64] FLAG: --eviction-hard="" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847283 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847287 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847289 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847292 2576 flags.go:64] FLAG: --eviction-soft="" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847295 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847298 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847301 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847303 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847307 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847309 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847312 2576 flags.go:64] FLAG: --feature-gates="" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847316 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847319 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847322 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847326 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847329 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847332 2576 flags.go:64] FLAG: --help="false" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847335 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-137-8.ec2.internal" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847338 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 11:10:53.853469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847341 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847344 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847347 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847350 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847353 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847356 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847359 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847362 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847365 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847368 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847371 2576 flags.go:64] FLAG: --kube-reserved="" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847374 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847377 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847379 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847382 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847385 2576 flags.go:64] FLAG: --lock-file="" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847388 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847390 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847393 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847399 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847401 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847404 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847407 2576 flags.go:64] FLAG: --logging-format="text" Jul 07 11:10:53.854243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847410 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847413 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847415 2576 flags.go:64] FLAG: --manifest-url="" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847418 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847422 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847425 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847429 2576 flags.go:64] FLAG: --max-pods="110" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847432 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847434 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847437 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847440 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847443 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847447 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847450 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847456 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847458 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847461 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847464 2576 flags.go:64] FLAG: --pod-cidr="" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847467 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847472 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847475 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847478 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847482 2576 flags.go:64] FLAG: --port="10250" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847485 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 11:10:53.854853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847488 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0accb3e5631104b33" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847491 2576 flags.go:64] FLAG: --qos-reserved="" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847494 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847497 2576 flags.go:64] FLAG: --register-node="true" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847500 2576 flags.go:64] FLAG: --register-with-taints="" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847504 2576 flags.go:64] FLAG: --registry-burst="10" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847506 2576 flags.go:64] FLAG: --registry-qps="5" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847509 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847512 2576 flags.go:64] FLAG: --reserved-memory="" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847515 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847518 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847521 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847523 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847526 2576 flags.go:64] FLAG: --runonce="false" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847532 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847535 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847538 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847541 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847544 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847546 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847550 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847553 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847555 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847558 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847561 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847564 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 11:10:53.855423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847567 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847583 2576 flags.go:64] FLAG: --system-cgroups="" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847586 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847591 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847595 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847597 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847601 2576 flags.go:64] FLAG: --tls-min-version="" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847604 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847607 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847609 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847612 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847615 2576 flags.go:64] FLAG: --v="2" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847618 2576 flags.go:64] FLAG: --version="false" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847622 2576 flags.go:64] FLAG: --vmodule="" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847626 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.847629 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847737 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847740 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847754 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847758 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847763 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847767 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847770 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 11:10:53.856200 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847773 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847776 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847779 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847782 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847785 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847788 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847791 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847793 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847795 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847798 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847800 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847803 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847806 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847810 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847812 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847815 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847817 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847820 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847822 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847825 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 11:10:53.857148 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847827 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847830 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847832 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847835 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847838 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847841 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847843 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847846 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847848 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847852 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847855 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847858 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847860 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847863 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847865 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847869 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847873 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847876 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847878 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847881 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 11:10:53.857737 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847883 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847886 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847888 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847891 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847896 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847903 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847906 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847908 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847911 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847914 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847916 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847918 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847921 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847923 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847926 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847929 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847931 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847934 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847936 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 11:10:53.858232 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847940 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847943 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847948 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847951 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847954 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847956 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847959 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847961 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847964 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847967 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847969 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847971 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847974 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847976 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847979 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847981 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847984 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847987 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847991 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 11:10:53.858715 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847994 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 11:10:53.859165 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847996 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 11:10:53.859165 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.847999 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 11:10:53.859165 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.848002 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 11:10:53.859165 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.848004 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 11:10:53.859165 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.848007 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 11:10:53.859165 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.848009 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 11:10:53.859165 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.848012 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 11:10:53.859165 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.848016 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 11:10:53.859165 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.848019 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 11:10:53.859165 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.848022 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 11:10:53.859165 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.848025 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 11:10:53.859165 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.848028 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 11:10:53.859165 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.848030 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 11:10:53.859165 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.848035 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 11:10:53.859165 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.854825 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.854839 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.855735 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.855743 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856038 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856051 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856057 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856063 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856067 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856079 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856084 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856088 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856093 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856097 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856102 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856106 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856110 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856115 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856119 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856124 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 11:10:53.859527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856128 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856138 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856143 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856147 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856151 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856155 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856160 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856165 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856169 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856174 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856179 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856185 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856191 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856205 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856211 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856216 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856221 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856226 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856231 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 11:10:53.860050 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856236 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856240 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856247 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856252 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856256 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856261 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856265 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856274 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856279 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856283 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856287 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856291 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856296 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856300 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856304 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856309 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856313 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856318 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856322 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 11:10:53.860518 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856330 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856335 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856339 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856344 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856348 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856352 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856356 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856361 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856368 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856372 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856376 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856381 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856385 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856394 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856398 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856403 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856407 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856412 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856416 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856420 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 11:10:53.861027 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856424 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856429 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856433 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856438 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856442 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856446 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856456 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856461 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856465 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856470 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856474 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856478 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856483 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856487 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856493 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856497 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856501 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856506 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856515 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 11:10:53.861514 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856521 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 11:10:53.862088 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856525 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 11:10:53.862088 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856531 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 11:10:53.862088 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856535 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 11:10:53.862088 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856539 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 11:10:53.862088 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.856544 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 11:10:53.862088 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.856553 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 11:10:53.862088 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857159 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 11:10:53.862088 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857174 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 11:10:53.862088 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857178 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 11:10:53.862088 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857181 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 11:10:53.862088 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857183 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 11:10:53.862088 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857186 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 11:10:53.862088 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857190 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 11:10:53.862088 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857193 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 11:10:53.862088 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857196 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857198 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857201 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857204 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857206 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857209 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857214 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857218 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857222 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857226 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857230 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857233 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857236 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857238 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857241 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857244 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857247 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857249 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857252 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 11:10:53.862470 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857255 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857260 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857263 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857266 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857268 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857271 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857274 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857277 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857280 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857282 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857284 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857287 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857290 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857292 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857295 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857297 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857300 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857303 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857305 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857308 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 11:10:53.862945 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857311 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857314 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857316 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857319 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857321 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857324 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857326 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857329 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857331 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857334 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857336 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857339 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857342 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857344 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857347 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857350 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857352 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857355 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857359 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857362 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 11:10:53.863490 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857364 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857367 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857369 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857372 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857374 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857378 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857380 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857383 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857385 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857388 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857390 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857393 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857396 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857398 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857401 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857405 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857407 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857410 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857412 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857415 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 11:10:53.863997 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857417 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 11:10:53.864519 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857420 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 11:10:53.864519 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857422 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 11:10:53.864519 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857425 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 11:10:53.864519 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857427 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 11:10:53.864519 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857430 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 11:10:53.864519 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857432 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 11:10:53.864519 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857435 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 11:10:53.864519 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857438 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 11:10:53.864519 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857440 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 11:10:53.864519 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857443 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 11:10:53.864519 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:53.857446 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 11:10:53.864519 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.857451 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 11:10:53.864519 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.857563 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 11:10:53.864519 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.862975 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 11:10:53.864519 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.864513 2576 server.go:1019] "Starting client certificate rotation" Jul 07 11:10:53.864927 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.864601 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 11:10:53.864927 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.864636 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 11:10:53.867964 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.867951 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 11:10:53.869003 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.868991 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 11:10:53.881604 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.881567 2576 log.go:25] "Validated CRI v1 runtime API" Jul 07 11:10:53.883723 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.883706 2576 log.go:25] "Validated CRI v1 image API" Jul 07 11:10:53.885287 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.885270 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 11:10:53.887785 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.887766 2576 fs.go:135] Filesystem UUIDs: map[35b50e7f-a1f7-4a7e-9a0c-97b125ab1f24:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a007cc26-b55f-4a5c-ba4a-63e07ef2d52c:/dev/nvme0n1p3] Jul 07 11:10:53.887856 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.887784 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 11:10:53.893622 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.893488 2576 manager.go:216] Machine: {Timestamp:2026-07-07 11:10:53.891905519 +0000 UTC m=+0.371387529 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3117685 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23f3590e412692d2dd970fc4dfe3a1 SystemUUID:ec23f359-0e41-2692-d2dd-970fc4dfe3a1 BootID:a2e9f714-48c0-4e00-8719-4068f1ca7937 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:46:51:83:43:93 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:46:51:83:43:93 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:3e:94:c8:ae:d3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 11:10:53.893622 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.893615 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 11:10:53.893743 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.893695 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 11:10:53.895560 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.895534 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 11:10:53.895700 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.895562 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 11:10:53.896274 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.896265 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 11:10:53.896303 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.896278 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 11:10:53.896303 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.896285 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 11:10:53.897001 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.896991 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 11:10:53.898314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.898304 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 11:10:53.901147 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.901135 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 07 11:10:53.901402 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.901392 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 11:10:53.902168 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.902155 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 07 11:10:53.902234 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.902170 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 11:10:53.902234 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.902190 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 11:10:53.902234 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.902199 2576 kubelet.go:398] "Adding apiserver pod source" Jul 07 11:10:53.902234 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.902211 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 11:10:53.902702 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.902682 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 11:10:53.902741 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.902729 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 11:10:53.905153 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.905121 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 11:10:53.906950 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.906929 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 11:10:53.908812 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.908796 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 11:10:53.908899 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.908834 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 11:10:53.910147 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.910133 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 11:10:53.910213 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.910153 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 11:10:53.910213 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.910161 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 11:10:53.910213 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.910169 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 11:10:53.910213 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.910182 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 11:10:53.910213 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.910191 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 11:10:53.910213 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.910203 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 11:10:53.910213 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.910210 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 11:10:53.910430 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.910220 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 11:10:53.910430 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.910228 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 11:10:53.910430 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.910241 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 11:10:53.910430 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.910250 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 11:10:53.911894 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.911883 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 11:10:53.911946 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.911897 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 11:10:53.914976 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.914959 2576 server.go:1268] "Started kubelet" Jul 07 11:10:53.915084 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.915057 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 11:10:53.915129 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.915063 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 11:10:53.915167 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.915133 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 11:10:53.915886 ip-10-0-137-8 systemd[1]: Started Kubernetes Kubelet. Jul 07 11:10:53.916988 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.916971 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 11:10:53.917392 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.917379 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 07 11:10:53.919783 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:53.919763 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 11:10:53.920459 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.920443 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 11:10:53.921022 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:53.921001 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 11:10:53.921072 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:53.921001 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 11:10:53.923809 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.923789 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 11:10:53.923809 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.923802 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 11:10:53.923948 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:53.923916 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-8.ec2.internal\" not found" Jul 07 11:10:53.924408 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.924386 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 11:10:53.924501 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.924420 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 11:10:53.924628 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.924614 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 11:10:53.924711 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.924695 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 07 11:10:53.924764 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.924714 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 07 11:10:53.924890 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.924874 2576 factory.go:55] Registering systemd factory Jul 07 11:10:53.924970 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.924894 2576 factory.go:223] Registration of the systemd container factory successfully Jul 07 11:10:53.925168 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.925153 2576 factory.go:153] Registering CRI-O factory Jul 07 11:10:53.925237 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.925172 2576 factory.go:223] Registration of the crio container factory successfully Jul 07 11:10:53.925237 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.925216 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 11:10:53.925337 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.925249 2576 factory.go:103] Registering Raw factory Jul 07 11:10:53.925337 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.925264 2576 manager.go:1196] Started watching for new ooms in manager Jul 07 11:10:53.925641 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.925627 2576 manager.go:349] Starting recovery of all containers Jul 07 11:10:53.925699 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:53.924437 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-8.ec2.internal.18bffd746afbad8e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-8.ec2.internal,UID:ip-10-0-137-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-8.ec2.internal,},FirstTimestamp:2026-07-07 11:10:53.914918286 +0000 UTC m=+0.394400295,LastTimestamp:2026-07-07 11:10:53.914918286 +0000 UTC m=+0.394400295,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-8.ec2.internal,}" Jul 07 11:10:53.931337 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:53.931187 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 11:10:53.931702 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:53.931217 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 11:10:53.935439 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.935418 2576 manager.go:354] Recovery completed Jul 07 11:10:53.937675 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:53.937655 2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 07 11:10:53.940512 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.940500 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 11:10:53.942447 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.942416 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasSufficientMemory" Jul 07 11:10:53.942522 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.942457 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 11:10:53.942522 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.942468 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasSufficientPID" Jul 07 11:10:53.942904 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.942891 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 11:10:53.942950 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.942904 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 11:10:53.942950 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.942918 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 07 11:10:53.942950 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.942943 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 11:10:53.943613 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.943596 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasSufficientMemory" Jul 07 11:10:53.943693 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.943628 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 11:10:53.943693 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.943640 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasSufficientPID" Jul 07 11:10:53.944126 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.944111 2576 policy_none.go:49] "None policy: Start" Jul 07 11:10:53.944222 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.944129 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 11:10:53.944222 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.944140 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 11:10:53.945084 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.945070 2576 policy_none.go:47] "Start" Jul 07 11:10:53.945151 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:53.945076 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-8.ec2.internal.18bffd746c9fb240 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-8.ec2.internal,UID:ip-10-0-137-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-8.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-8.ec2.internal,},FirstTimestamp:2026-07-07 11:10:53.942444608 +0000 UTC m=+0.421926616,LastTimestamp:2026-07-07 11:10:53.942444608 +0000 UTC m=+0.421926616,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-8.ec2.internal,}" Jul 07 11:10:53.955626 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.955605 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9x5qg" Jul 07 11:10:53.955712 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:53.955647 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-8.ec2.internal.18bffd746c9ff819 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-8.ec2.internal,UID:ip-10-0-137-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-8.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-8.ec2.internal,},FirstTimestamp:2026-07-07 11:10:53.942462489 +0000 UTC m=+0.421944498,LastTimestamp:2026-07-07 11:10:53.942462489 +0000 UTC m=+0.421944498,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-8.ec2.internal,}" Jul 07 11:10:53.967370 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:53.967315 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-8.ec2.internal.18bffd746ca01c04 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-8.ec2.internal,UID:ip-10-0-137-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-8.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-8.ec2.internal,},FirstTimestamp:2026-07-07 11:10:53.942471684 +0000 UTC m=+0.421953693,LastTimestamp:2026-07-07 11:10:53.942471684 +0000 UTC m=+0.421953693,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-8.ec2.internal,}" Jul 07 11:10:53.968977 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.968962 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9x5qg" Jul 07 11:10:53.982114 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.982100 2576 manager.go:337] "Starting Device Plugin manager" Jul 07 11:10:53.982175 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:53.982131 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 11:10:53.982175 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.982143 2576 server.go:87] "Starting device plugin registration server" Jul 07 11:10:53.982364 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.982352 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 11:10:53.982417 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.982364 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 11:10:53.982736 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.982532 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 11:10:53.982736 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.982658 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 11:10:53.982736 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:53.982678 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 11:10:53.983034 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:53.983014 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 11:10:53.983088 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:53.983072 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-8.ec2.internal\" not found" Jul 07 11:10:54.044537 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.044513 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 11:10:54.045804 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.045790 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 11:10:54.045862 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.045825 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 11:10:54.045862 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.045844 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 11:10:54.045938 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:54.045874 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 11:10:54.049564 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.049542 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 11:10:54.082783 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.082756 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 11:10:54.085127 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.085112 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasSufficientMemory" Jul 07 11:10:54.085195 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.085140 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 11:10:54.085195 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.085156 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasSufficientPID" Jul 07 11:10:54.085195 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.085182 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.098951 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.098912 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.098951 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:54.098930 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-8.ec2.internal\": node \"ip-10-0-137-8.ec2.internal\" not found" Jul 07 11:10:54.146713 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.146687 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-8.ec2.internal"] Jul 07 11:10:54.146787 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.146740 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 11:10:54.147433 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.147416 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasSufficientMemory" Jul 07 11:10:54.147481 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.147440 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 11:10:54.147481 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.147449 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasSufficientPID" Jul 07 11:10:54.148643 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.148631 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 11:10:54.148726 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.148711 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.148781 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.148742 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 11:10:54.149288 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.149256 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasSufficientMemory" Jul 07 11:10:54.149288 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.149282 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 11:10:54.149408 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.149295 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasSufficientPID" Jul 07 11:10:54.149408 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.149306 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasSufficientMemory" Jul 07 11:10:54.149408 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.149325 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 11:10:54.149408 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.149337 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasSufficientPID" Jul 07 11:10:54.150358 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.150344 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.150412 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.150373 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 11:10:54.150993 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.150976 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasSufficientMemory" Jul 07 11:10:54.151079 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.151008 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 11:10:54.151079 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.151022 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeHasSufficientPID" Jul 07 11:10:54.168196 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:54.168178 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-8.ec2.internal\" not found" Jul 07 11:10:54.170101 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:54.170087 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-8.ec2.internal\" not found" node="ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.173516 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:54.173502 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-8.ec2.internal\" not found" node="ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.225826 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.225806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ca19b4fae04ee4ffd4ef9397655850d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-8.ec2.internal\" (UID: \"2ca19b4fae04ee4ffd4ef9397655850d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.225889 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.225829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/178de8741949e5ed2708ec156f89e176-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal\" (UID: \"178de8741949e5ed2708ec156f89e176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.225889 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.225852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/178de8741949e5ed2708ec156f89e176-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal\" (UID: \"178de8741949e5ed2708ec156f89e176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.268809 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:54.268791 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-8.ec2.internal\" not found" Jul 07 11:10:54.326764 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.326743 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ca19b4fae04ee4ffd4ef9397655850d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-8.ec2.internal\" (UID: \"2ca19b4fae04ee4ffd4ef9397655850d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.326811 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.326710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ca19b4fae04ee4ffd4ef9397655850d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-8.ec2.internal\" (UID: \"2ca19b4fae04ee4ffd4ef9397655850d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.326845 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.326826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/178de8741949e5ed2708ec156f89e176-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal\" (UID: \"178de8741949e5ed2708ec156f89e176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.326877 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.326845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/178de8741949e5ed2708ec156f89e176-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal\" (UID: \"178de8741949e5ed2708ec156f89e176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.326877 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.326870 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/178de8741949e5ed2708ec156f89e176-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal\" (UID: \"178de8741949e5ed2708ec156f89e176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.326936 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.326908 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/178de8741949e5ed2708ec156f89e176-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal\" (UID: \"178de8741949e5ed2708ec156f89e176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.369549 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:54.369509 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-8.ec2.internal\" not found" Jul 07 11:10:54.470404 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:54.470386 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-8.ec2.internal\" not found" Jul 07 11:10:54.473542 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.473528 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.477762 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.477555 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.570626 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:54.570604 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-8.ec2.internal\" not found" Jul 07 11:10:54.671039 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:54.671016 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-8.ec2.internal\" not found" Jul 07 11:10:54.755382 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.755363 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 11:10:54.824454 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.824431 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.837646 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.837626 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 11:10:54.839559 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.839547 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-8.ec2.internal" Jul 07 11:10:54.847307 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.847291 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 11:10:54.863398 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.863379 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 11:10:54.863517 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.863497 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 11:10:54.863565 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.863531 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 11:10:54.903499 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.903475 2576 apiserver.go:52] "Watching apiserver" Jul 07 11:10:54.921888 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.921832 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 11:10:54.923879 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.922657 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-st4qc","openshift-multus/multus-nr5gq","openshift-multus/network-metrics-daemon-tz22d","kube-system/konnectivity-agent-zcp9j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal","openshift-multus/multus-additional-cni-plugins-6jn52","openshift-network-diagnostics/network-check-target-s4jm7","openshift-network-operator/iptables-alerter-vl8wg","openshift-ovn-kubernetes/ovnkube-node-lcsfq","kube-system/global-pull-secret-syncer-9ntcg","kube-system/kube-apiserver-proxy-ip-10-0-137-8.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s","openshift-cluster-node-tuning-operator/tuned-x7bwl","openshift-dns/node-resolver-87rvw"] Jul 07 11:10:54.924062 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.923915 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 11:10:54.925031 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.925008 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-st4qc" Jul 07 11:10:54.926743 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.926409 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nr5gq" Jul 07 11:10:54.927431 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.927414 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:10:54.927522 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:54.927502 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:10:54.927714 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.927698 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 11:10:54.927768 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.927746 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fs9bb\"" Jul 07 11:10:54.927995 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.927979 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 11:10:54.928199 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.928184 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 11:10:54.928806 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.928787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3080673e-c2c6-416d-8f5f-dee0e93de1b5-serviceca\") pod \"node-ca-st4qc\" (UID: \"3080673e-c2c6-416d-8f5f-dee0e93de1b5\") " pod="openshift-image-registry/node-ca-st4qc" Jul 07 11:10:54.928806 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.928792 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 11:10:54.928951 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.928837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl7tx\" (UniqueName: \"kubernetes.io/projected/3080673e-c2c6-416d-8f5f-dee0e93de1b5-kube-api-access-vl7tx\") pod \"node-ca-st4qc\" (UID: \"3080673e-c2c6-416d-8f5f-dee0e93de1b5\") " pod="openshift-image-registry/node-ca-st4qc" Jul 07 11:10:54.928951 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.928872 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3080673e-c2c6-416d-8f5f-dee0e93de1b5-host\") pod \"node-ca-st4qc\" (UID: \"3080673e-c2c6-416d-8f5f-dee0e93de1b5\") " pod="openshift-image-registry/node-ca-st4qc" Jul 07 11:10:54.928951 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.928887 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zcp9j" Jul 07 11:10:54.929452 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.929432 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 11:10:54.930067 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.930047 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 11:10:54.930152 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.930107 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 11:10:54.930212 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.930161 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k672b\"" Jul 07 11:10:54.930397 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.930381 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:54.931565 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.931521 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:10:54.931671 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:54.931655 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:10:54.932200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.932185 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8fnm4\"" Jul 07 11:10:54.932518 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.932499 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 11:10:54.932619 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.932523 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 11:10:54.932907 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.932893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vl8wg" Jul 07 11:10:54.934016 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.934000 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 11:10:54.934182 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.934157 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qqpsk\"" Jul 07 11:10:54.934251 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.934161 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 11:10:54.934302 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.934287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:54.935508 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.935491 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:10:54.935631 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:54.935607 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:10:54.936549 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.936531 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-25crw\"" Jul 07 11:10:54.936687 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.936665 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 11:10:54.936799 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.936780 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 11:10:54.937100 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.937083 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 11:10:54.937272 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.937258 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:54.937439 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.937390 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 11:10:54.937635 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.937619 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 11:10:54.937738 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.937643 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n99rt\"" Jul 07 11:10:54.937738 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.937684 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 11:10:54.937847 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.937754 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 11:10:54.938153 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.938121 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 11:10:54.938153 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.938125 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 11:10:54.938395 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.938379 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:54.939023 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.939002 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 11:10:54.939703 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.939682 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-87rvw" Jul 07 11:10:54.940056 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.940029 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 11:10:54.940181 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.940044 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h59f8\"" Jul 07 11:10:54.940631 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.940616 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 11:10:54.940712 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.940619 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 11:10:54.941275 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.941259 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 11:10:54.941275 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.941262 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 11:10:54.941413 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.941397 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wq59m\"" Jul 07 11:10:54.941979 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.941964 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 11:10:54.942067 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.942054 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 11:10:54.943187 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:54.943172 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k9xpx\"" Jul 07 11:10:56.971479 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:56.971461 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vk5sg" Jul 07 11:10:56.973211 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:56.973173 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 11:05:55 +0000 UTC" deadline="2028-02-23 21:41:12.668720052 +0000 UTC" Jul 07 11:10:56.973295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:56.973210 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14314h30m15.69551347s" Jul 07 11:10:56.981213 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:56.981198 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vk5sg" Jul 07 11:10:57.028579 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.028564 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 11:10:57.032219 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b530b5f3-833a-4b83-9cdc-0f496a0225ce-konnectivity-ca\") pod \"konnectivity-agent-zcp9j\" (UID: \"b530b5f3-833a-4b83-9cdc-0f496a0225ce\") " pod="kube-system/konnectivity-agent-zcp9j" Jul 07 11:10:57.032297 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/31c528ea-b661-4f45-9c17-a21058d52727-env-overrides\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.032297 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-socket-dir\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.032382 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-system-cni-dir\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.032382 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032328 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-cnibin\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.032499 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-var-lib-cni-multus\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.032499 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4mwx\" (UniqueName: \"kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx\") pod \"network-check-target-s4jm7\" (UID: \"1ddca397-3766-4e52-972e-bc7c6fc375a7\") " pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:10:57.032599 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-run-ovn\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.032599 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-modprobe-d\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.032599 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-kubernetes\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.032599 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-sysctl-conf\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.032599 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-multus-conf-dir\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.032915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9106972d-25a4-4ca7-b58b-72e4af5cbef9-dbus\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:10:57.032915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032637 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-systemd-units\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.032915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-multus-socket-dir-parent\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.032915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/375318b9-0adb-43e6-a740-c5d642af3e81-multus-daemon-config\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.032915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:10:57.032915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ad4910d-9603-4c7c-8955-6629120e2c70-hosts-file\") pod \"node-resolver-87rvw\" (UID: \"7ad4910d-9603-4c7c-8955-6629120e2c70\") " pod="openshift-dns/node-resolver-87rvw" Jul 07 11:10:57.032915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032762 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-sys-fs\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.032915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032788 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-sys\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.032915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032809 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-host\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.032915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-var-lib-kubelet\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.032915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f9b91f5-31fe-4d04-8119-a716f0b530c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.032915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-kubelet\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.032915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-cni-bin\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-run-multus-certs\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032947 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b530b5f3-833a-4b83-9cdc-0f496a0225ce-agent-certs\") pod \"konnectivity-agent-zcp9j\" (UID: \"b530b5f3-833a-4b83-9cdc-0f496a0225ce\") " pod="kube-system/konnectivity-agent-zcp9j" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxlzf\" (UniqueName: \"kubernetes.io/projected/2a515582-a597-4fce-a156-290dd468164d-kube-api-access-jxlzf\") pod \"iptables-alerter-vl8wg\" (UID: \"2a515582-a597-4fce-a156-290dd468164d\") " pod="openshift-network-operator/iptables-alerter-vl8wg" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.032994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/31c528ea-b661-4f45-9c17-a21058d52727-ovnkube-config\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-run\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3080673e-c2c6-416d-8f5f-dee0e93de1b5-host\") pod \"node-ca-st4qc\" (UID: \"3080673e-c2c6-416d-8f5f-dee0e93de1b5\") " pod="openshift-image-registry/node-ca-st4qc" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033068 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a515582-a597-4fce-a156-290dd468164d-host-slash\") pod \"iptables-alerter-vl8wg\" (UID: \"2a515582-a597-4fce-a156-290dd468164d\") " pod="openshift-network-operator/iptables-alerter-vl8wg" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033112 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3080673e-c2c6-416d-8f5f-dee0e93de1b5-host\") pod \"node-ca-st4qc\" (UID: \"3080673e-c2c6-416d-8f5f-dee0e93de1b5\") " pod="openshift-image-registry/node-ca-st4qc" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033110 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45zj6\" (UniqueName: \"kubernetes.io/projected/31c528ea-b661-4f45-9c17-a21058d52727-kube-api-access-45zj6\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-device-dir\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033205 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-lib-modules\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/348e8c3c-f2c2-4301-acfe-8b52284da5b8-tmp\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-os-release\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f9b91f5-31fe-4d04-8119-a716f0b530c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.033414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-run-openvswitch\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-registration-dir\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xlh9\" (UniqueName: \"kubernetes.io/projected/348e8c3c-f2c2-4301-acfe-8b52284da5b8-kube-api-access-2xlh9\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/375318b9-0adb-43e6-a740-c5d642af3e81-cni-binary-copy\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ad4910d-9603-4c7c-8955-6629120e2c70-tmp-dir\") pod \"node-resolver-87rvw\" (UID: \"7ad4910d-9603-4c7c-8955-6629120e2c70\") " pod="openshift-dns/node-resolver-87rvw" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f9b91f5-31fe-4d04-8119-a716f0b530c2-cnibin\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033420 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-run-netns\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-var-lib-openvswitch\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/31c528ea-b661-4f45-9c17-a21058d52727-ovnkube-script-lib\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-sysconfig\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-etc-kubernetes\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033529 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-slash\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033547 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-cni-netd\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-sysctl-d\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-tuned\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033647 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-hostroot\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9fkb\" (UniqueName: \"kubernetes.io/projected/375318b9-0adb-43e6-a740-c5d642af3e81-kube-api-access-l9fkb\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.033952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3080673e-c2c6-416d-8f5f-dee0e93de1b5-serviceca\") pod \"node-ca-st4qc\" (UID: \"3080673e-c2c6-416d-8f5f-dee0e93de1b5\") " pod="openshift-image-registry/node-ca-st4qc" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9106972d-25a4-4ca7-b58b-72e4af5cbef9-kubelet-config\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033734 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f9b91f5-31fe-4d04-8119-a716f0b530c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033746 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-node-log\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-systemd\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-multus-cni-dir\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2a515582-a597-4fce-a156-290dd468164d-iptables-alerter-script\") pod \"iptables-alerter-vl8wg\" (UID: \"2a515582-a597-4fce-a156-290dd468164d\") " pod="openshift-network-operator/iptables-alerter-vl8wg" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dccf\" (UniqueName: \"kubernetes.io/projected/443056e3-d655-409e-b8b2-040cd2adf8f6-kube-api-access-5dccf\") pod \"network-metrics-daemon-tz22d\" (UID: \"443056e3-d655-409e-b8b2-040cd2adf8f6\") " pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5tkv\" (UniqueName: \"kubernetes.io/projected/6f9b91f5-31fe-4d04-8119-a716f0b530c2-kube-api-access-c5tkv\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-run-systemd\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/31c528ea-b661-4f45-9c17-a21058d52727-ovn-node-metrics-cert\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-etc-selinux\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-var-lib-cni-bin\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vr4p\" (UniqueName: \"kubernetes.io/projected/848201b5-ab92-49c1-967f-4847f42c9b86-kube-api-access-6vr4p\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033931 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7btz\" (UniqueName: \"kubernetes.io/projected/7ad4910d-9603-4c7c-8955-6629120e2c70-kube-api-access-c7btz\") pod \"node-resolver-87rvw\" (UID: \"7ad4910d-9603-4c7c-8955-6629120e2c70\") " pod="openshift-dns/node-resolver-87rvw" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs\") pod \"network-metrics-daemon-tz22d\" (UID: \"443056e3-d655-409e-b8b2-040cd2adf8f6\") " pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:10:57.034436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f9b91f5-31fe-4d04-8119-a716f0b530c2-system-cni-dir\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.034915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.033995 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3080673e-c2c6-416d-8f5f-dee0e93de1b5-serviceca\") pod \"node-ca-st4qc\" (UID: \"3080673e-c2c6-416d-8f5f-dee0e93de1b5\") " pod="openshift-image-registry/node-ca-st4qc" Jul 07 11:10:57.034915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.034012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f9b91f5-31fe-4d04-8119-a716f0b530c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.034915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.034039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-run-ovn-kubernetes\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.034915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.034061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-run-k8s-cni-cncf-io\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.034915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.034075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-run-netns\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.034915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.034113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl7tx\" (UniqueName: \"kubernetes.io/projected/3080673e-c2c6-416d-8f5f-dee0e93de1b5-kube-api-access-vl7tx\") pod \"node-ca-st4qc\" (UID: \"3080673e-c2c6-416d-8f5f-dee0e93de1b5\") " pod="openshift-image-registry/node-ca-st4qc" Jul 07 11:10:57.034915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.034138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f9b91f5-31fe-4d04-8119-a716f0b530c2-os-release\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.034915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.034160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-etc-openvswitch\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.034915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.034254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-log-socket\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.034915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.034273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-var-lib-kubelet\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.036559 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:57.036527 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178de8741949e5ed2708ec156f89e176.slice/crio-ce3a87a5f03c120b7a2d1996ef4115c756a0faeca9f4395dde1d5fa45ec6ae98 WatchSource:0}: Error finding container ce3a87a5f03c120b7a2d1996ef4115c756a0faeca9f4395dde1d5fa45ec6ae98: Status 404 returned error can't find the container with id ce3a87a5f03c120b7a2d1996ef4115c756a0faeca9f4395dde1d5fa45ec6ae98 Jul 07 11:10:57.036790 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:57.036766 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca19b4fae04ee4ffd4ef9397655850d.slice/crio-6282d90aa6372cce03b38a81393fda255aa0607bf977125c298f5164fbca8390 WatchSource:0}: Error finding container 6282d90aa6372cce03b38a81393fda255aa0607bf977125c298f5164fbca8390: Status 404 returned error can't find the container with id 6282d90aa6372cce03b38a81393fda255aa0607bf977125c298f5164fbca8390 Jul 07 11:10:57.042730 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.042715 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 11:10:57.042794 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.042761 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 11:10:57.046497 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.046483 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl7tx\" (UniqueName: \"kubernetes.io/projected/3080673e-c2c6-416d-8f5f-dee0e93de1b5-kube-api-access-vl7tx\") pod \"node-ca-st4qc\" (UID: \"3080673e-c2c6-416d-8f5f-dee0e93de1b5\") " pod="openshift-image-registry/node-ca-st4qc" Jul 07 11:10:57.052465 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.052424 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-8.ec2.internal" event={"ID":"2ca19b4fae04ee4ffd4ef9397655850d","Type":"ContainerStarted","Data":"6282d90aa6372cce03b38a81393fda255aa0607bf977125c298f5164fbca8390"} Jul 07 11:10:57.053643 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.053624 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal" event={"ID":"178de8741949e5ed2708ec156f89e176","Type":"ContainerStarted","Data":"ce3a87a5f03c120b7a2d1996ef4115c756a0faeca9f4395dde1d5fa45ec6ae98"} Jul 07 11:10:57.134544 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-node-log\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.134657 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134548 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-systemd\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.134657 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-multus-cni-dir\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.134657 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2a515582-a597-4fce-a156-290dd468164d-iptables-alerter-script\") pod \"iptables-alerter-vl8wg\" (UID: \"2a515582-a597-4fce-a156-290dd468164d\") " pod="openshift-network-operator/iptables-alerter-vl8wg" Jul 07 11:10:57.134657 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134637 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-systemd\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.134657 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134646 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-node-log\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.134905 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134707 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-multus-cni-dir\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.134905 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dccf\" (UniqueName: \"kubernetes.io/projected/443056e3-d655-409e-b8b2-040cd2adf8f6-kube-api-access-5dccf\") pod \"network-metrics-daemon-tz22d\" (UID: \"443056e3-d655-409e-b8b2-040cd2adf8f6\") " pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:10:57.134905 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5tkv\" (UniqueName: \"kubernetes.io/projected/6f9b91f5-31fe-4d04-8119-a716f0b530c2-kube-api-access-c5tkv\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.134905 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-run-systemd\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.134905 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/31c528ea-b661-4f45-9c17-a21058d52727-ovn-node-metrics-cert\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.134905 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-etc-selinux\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.134905 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-var-lib-cni-bin\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.134905 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134863 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-run-systemd\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.134905 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vr4p\" (UniqueName: \"kubernetes.io/projected/848201b5-ab92-49c1-967f-4847f42c9b86-kube-api-access-6vr4p\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7btz\" (UniqueName: \"kubernetes.io/projected/7ad4910d-9603-4c7c-8955-6629120e2c70-kube-api-access-c7btz\") pod \"node-resolver-87rvw\" (UID: \"7ad4910d-9603-4c7c-8955-6629120e2c70\") " pod="openshift-dns/node-resolver-87rvw" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134926 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-var-lib-cni-bin\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs\") pod \"network-metrics-daemon-tz22d\" (UID: \"443056e3-d655-409e-b8b2-040cd2adf8f6\") " pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134960 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-etc-selinux\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.134963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f9b91f5-31fe-4d04-8119-a716f0b530c2-system-cni-dir\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f9b91f5-31fe-4d04-8119-a716f0b530c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135017 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f9b91f5-31fe-4d04-8119-a716f0b530c2-system-cni-dir\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-run-ovn-kubernetes\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135056 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2a515582-a597-4fce-a156-290dd468164d-iptables-alerter-script\") pod \"iptables-alerter-vl8wg\" (UID: \"2a515582-a597-4fce-a156-290dd468164d\") " pod="openshift-network-operator/iptables-alerter-vl8wg" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-run-k8s-cni-cncf-io\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.135091 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-run-netns\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135101 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-run-k8s-cni-cncf-io\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f9b91f5-31fe-4d04-8119-a716f0b530c2-os-release\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-etc-openvswitch\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135151 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-run-netns\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.135329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135088 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-run-ovn-kubernetes\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.135183 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs podName:443056e3-d655-409e-b8b2-040cd2adf8f6 nodeName:}" failed. No retries permitted until 2026-07-07 11:10:57.635143417 +0000 UTC m=+2.111801359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs") pod "network-metrics-daemon-tz22d" (UID: "443056e3-d655-409e-b8b2-040cd2adf8f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-etc-openvswitch\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-log-socket\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135259 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-log-socket\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-var-lib-kubelet\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f9b91f5-31fe-4d04-8119-a716f0b530c2-os-release\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b530b5f3-833a-4b83-9cdc-0f496a0225ce-konnectivity-ca\") pod \"konnectivity-agent-zcp9j\" (UID: \"b530b5f3-833a-4b83-9cdc-0f496a0225ce\") " pod="kube-system/konnectivity-agent-zcp9j" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135323 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/31c528ea-b661-4f45-9c17-a21058d52727-env-overrides\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-var-lib-kubelet\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-socket-dir\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-system-cni-dir\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135462 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-cnibin\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135473 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-socket-dir\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-var-lib-cni-multus\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4mwx\" (UniqueName: \"kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx\") pod \"network-check-target-s4jm7\" (UID: \"1ddca397-3766-4e52-972e-bc7c6fc375a7\") " pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135522 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-system-cni-dir\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.136139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-run-ovn\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135561 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-var-lib-cni-multus\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135625 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f9b91f5-31fe-4d04-8119-a716f0b530c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-modprobe-d\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135682 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-run-ovn\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-cnibin\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135692 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-kubernetes\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-sysctl-conf\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-kubernetes\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135782 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-modprobe-d\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-multus-conf-dir\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9106972d-25a4-4ca7-b58b-72e4af5cbef9-dbus\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135825 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-multus-conf-dir\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135830 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/31c528ea-b661-4f45-9c17-a21058d52727-env-overrides\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-systemd-units\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135887 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b530b5f3-833a-4b83-9cdc-0f496a0225ce-konnectivity-ca\") pod \"konnectivity-agent-zcp9j\" (UID: \"b530b5f3-833a-4b83-9cdc-0f496a0225ce\") " pod="kube-system/konnectivity-agent-zcp9j" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-multus-socket-dir-parent\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135894 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-sysctl-conf\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.136920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135905 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-systemd-units\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/375318b9-0adb-43e6-a740-c5d642af3e81-multus-daemon-config\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135933 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9106972d-25a4-4ca7-b58b-72e4af5cbef9-dbus\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135945 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-multus-socket-dir-parent\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.135985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ad4910d-9603-4c7c-8955-6629120e2c70-hosts-file\") pod \"node-resolver-87rvw\" (UID: \"7ad4910d-9603-4c7c-8955-6629120e2c70\") " pod="openshift-dns/node-resolver-87rvw" Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136009 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-sys-fs\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-sys\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.136039 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-host\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136068 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-sys-fs\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-var-lib-kubelet\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ad4910d-9603-4c7c-8955-6629120e2c70-hosts-file\") pod \"node-resolver-87rvw\" (UID: \"7ad4910d-9603-4c7c-8955-6629120e2c70\") " pod="openshift-dns/node-resolver-87rvw" Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.136110 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret podName:9106972d-25a4-4ca7-b58b-72e4af5cbef9 nodeName:}" failed. No retries permitted until 2026-07-07 11:10:57.636093819 +0000 UTC m=+2.112751759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret") pod "global-pull-secret-syncer-9ntcg" (UID: "9106972d-25a4-4ca7-b58b-72e4af5cbef9") : object "kube-system"/"original-pull-secret" not registered Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136114 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-sys\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f9b91f5-31fe-4d04-8119-a716f0b530c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136159 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-host\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.137944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-kubelet\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136197 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-cni-bin\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136229 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-cni-bin\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136133 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-var-lib-kubelet\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-run-multus-certs\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136200 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-kubelet\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136287 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b530b5f3-833a-4b83-9cdc-0f496a0225ce-agent-certs\") pod \"konnectivity-agent-zcp9j\" (UID: \"b530b5f3-833a-4b83-9cdc-0f496a0225ce\") " pod="kube-system/konnectivity-agent-zcp9j" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxlzf\" (UniqueName: \"kubernetes.io/projected/2a515582-a597-4fce-a156-290dd468164d-kube-api-access-jxlzf\") pod \"iptables-alerter-vl8wg\" (UID: \"2a515582-a597-4fce-a156-290dd468164d\") " pod="openshift-network-operator/iptables-alerter-vl8wg" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/31c528ea-b661-4f45-9c17-a21058d52727-ovnkube-config\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136279 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-host-run-multus-certs\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-run\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a515582-a597-4fce-a156-290dd468164d-host-slash\") pod \"iptables-alerter-vl8wg\" (UID: \"2a515582-a597-4fce-a156-290dd468164d\") " pod="openshift-network-operator/iptables-alerter-vl8wg" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136428 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-run\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136442 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/375318b9-0adb-43e6-a740-c5d642af3e81-multus-daemon-config\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136455 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45zj6\" (UniqueName: \"kubernetes.io/projected/31c528ea-b661-4f45-9c17-a21058d52727-kube-api-access-45zj6\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136481 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136495 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a515582-a597-4fce-a156-290dd468164d-host-slash\") pod \"iptables-alerter-vl8wg\" (UID: \"2a515582-a597-4fce-a156-290dd468164d\") " pod="openshift-network-operator/iptables-alerter-vl8wg" Jul 07 11:10:57.138778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136506 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-device-dir\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136566 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-lib-modules\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136582 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f9b91f5-31fe-4d04-8119-a716f0b530c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/348e8c3c-f2c2-4301-acfe-8b52284da5b8-tmp\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-device-dir\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136587 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-os-release\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f9b91f5-31fe-4d04-8119-a716f0b530c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136675 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-run-openvswitch\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-registration-dir\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xlh9\" (UniqueName: \"kubernetes.io/projected/348e8c3c-f2c2-4301-acfe-8b52284da5b8-kube-api-access-2xlh9\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136757 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-lib-modules\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/375318b9-0adb-43e6-a740-c5d642af3e81-cni-binary-copy\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ad4910d-9603-4c7c-8955-6629120e2c70-tmp-dir\") pod \"node-resolver-87rvw\" (UID: \"7ad4910d-9603-4c7c-8955-6629120e2c70\") " pod="openshift-dns/node-resolver-87rvw" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136808 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/848201b5-ab92-49c1-967f-4847f42c9b86-registration-dir\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.139314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136814 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f9b91f5-31fe-4d04-8119-a716f0b530c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f9b91f5-31fe-4d04-8119-a716f0b530c2-cnibin\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-run-netns\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-var-lib-openvswitch\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/31c528ea-b661-4f45-9c17-a21058d52727-ovnkube-script-lib\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-sysconfig\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136926 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/31c528ea-b661-4f45-9c17-a21058d52727-ovnkube-config\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-etc-kubernetes\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-slash\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-cni-netd\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-sysctl-d\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-tuned\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-hostroot\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9fkb\" (UniqueName: \"kubernetes.io/projected/375318b9-0adb-43e6-a740-c5d642af3e81-kube-api-access-l9fkb\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ad4910d-9603-4c7c-8955-6629120e2c70-tmp-dir\") pod \"node-resolver-87rvw\" (UID: \"7ad4910d-9603-4c7c-8955-6629120e2c70\") " pod="openshift-dns/node-resolver-87rvw" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9106972d-25a4-4ca7-b58b-72e4af5cbef9-kubelet-config\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f9b91f5-31fe-4d04-8119-a716f0b530c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137159 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-os-release\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.139788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137162 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-etc-kubernetes\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f9b91f5-31fe-4d04-8119-a716f0b530c2-cnibin\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137225 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/375318b9-0adb-43e6-a740-c5d642af3e81-hostroot\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137227 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/375318b9-0adb-43e6-a740-c5d642af3e81-cni-binary-copy\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137232 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-run-netns\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.136846 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-run-openvswitch\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137461 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-cni-netd\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137473 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-sysctl-d\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137508 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9106972d-25a4-4ca7-b58b-72e4af5cbef9-kubelet-config\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137529 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-host-slash\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137547 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31c528ea-b661-4f45-9c17-a21058d52727-var-lib-openvswitch\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137590 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-sysconfig\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f9b91f5-31fe-4d04-8119-a716f0b530c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137676 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/31c528ea-b661-4f45-9c17-a21058d52727-ovn-node-metrics-cert\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.137966 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/31c528ea-b661-4f45-9c17-a21058d52727-ovnkube-script-lib\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.138631 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b530b5f3-833a-4b83-9cdc-0f496a0225ce-agent-certs\") pod \"konnectivity-agent-zcp9j\" (UID: \"b530b5f3-833a-4b83-9cdc-0f496a0225ce\") " pod="kube-system/konnectivity-agent-zcp9j" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.139055 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/348e8c3c-f2c2-4301-acfe-8b52284da5b8-tmp\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.140295 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.139344 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/348e8c3c-f2c2-4301-acfe-8b52284da5b8-etc-tuned\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.145871 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.145848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vr4p\" (UniqueName: \"kubernetes.io/projected/848201b5-ab92-49c1-967f-4847f42c9b86-kube-api-access-6vr4p\") pod \"aws-ebs-csi-driver-node-bhx9s\" (UID: \"848201b5-ab92-49c1-967f-4847f42c9b86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.146732 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.146715 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5tkv\" (UniqueName: \"kubernetes.io/projected/6f9b91f5-31fe-4d04-8119-a716f0b530c2-kube-api-access-c5tkv\") pod \"multus-additional-cni-plugins-6jn52\" (UID: \"6f9b91f5-31fe-4d04-8119-a716f0b530c2\") " pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.146976 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.146961 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7btz\" (UniqueName: \"kubernetes.io/projected/7ad4910d-9603-4c7c-8955-6629120e2c70-kube-api-access-c7btz\") pod \"node-resolver-87rvw\" (UID: \"7ad4910d-9603-4c7c-8955-6629120e2c70\") " pod="openshift-dns/node-resolver-87rvw" Jul 07 11:10:57.147762 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.147748 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dccf\" (UniqueName: \"kubernetes.io/projected/443056e3-d655-409e-b8b2-040cd2adf8f6-kube-api-access-5dccf\") pod \"network-metrics-daemon-tz22d\" (UID: \"443056e3-d655-409e-b8b2-040cd2adf8f6\") " pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:10:57.151304 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.151291 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 11:10:57.151359 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.151308 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 11:10:57.151359 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.151317 2576 projected.go:196] Error preparing data for projected volume kube-api-access-j4mwx for pod openshift-network-diagnostics/network-check-target-s4jm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 11:10:57.151359 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.151358 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx podName:1ddca397-3766-4e52-972e-bc7c6fc375a7 nodeName:}" failed. No retries permitted until 2026-07-07 11:10:57.651346102 +0000 UTC m=+2.128004074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j4mwx" (UniqueName: "kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx") pod "network-check-target-s4jm7" (UID: "1ddca397-3766-4e52-972e-bc7c6fc375a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 11:10:57.153619 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.153593 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45zj6\" (UniqueName: \"kubernetes.io/projected/31c528ea-b661-4f45-9c17-a21058d52727-kube-api-access-45zj6\") pod \"ovnkube-node-lcsfq\" (UID: \"31c528ea-b661-4f45-9c17-a21058d52727\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.153759 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.153741 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xlh9\" (UniqueName: \"kubernetes.io/projected/348e8c3c-f2c2-4301-acfe-8b52284da5b8-kube-api-access-2xlh9\") pod \"tuned-x7bwl\" (UID: \"348e8c3c-f2c2-4301-acfe-8b52284da5b8\") " pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.154568 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.154553 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxlzf\" (UniqueName: \"kubernetes.io/projected/2a515582-a597-4fce-a156-290dd468164d-kube-api-access-jxlzf\") pod \"iptables-alerter-vl8wg\" (UID: \"2a515582-a597-4fce-a156-290dd468164d\") " pod="openshift-network-operator/iptables-alerter-vl8wg" Jul 07 11:10:57.154624 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.154610 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9fkb\" (UniqueName: \"kubernetes.io/projected/375318b9-0adb-43e6-a740-c5d642af3e81-kube-api-access-l9fkb\") pod \"multus-nr5gq\" (UID: \"375318b9-0adb-43e6-a740-c5d642af3e81\") " pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.257759 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.257708 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-st4qc" Jul 07 11:10:57.265893 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:57.265874 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3080673e_c2c6_416d_8f5f_dee0e93de1b5.slice/crio-a6e5c992068d4a880f83893ad9b23ec1a3bdbdcaa9f3e91286b3b08b43256bf1 WatchSource:0}: Error finding container a6e5c992068d4a880f83893ad9b23ec1a3bdbdcaa9f3e91286b3b08b43256bf1: Status 404 returned error can't find the container with id a6e5c992068d4a880f83893ad9b23ec1a3bdbdcaa9f3e91286b3b08b43256bf1 Jul 07 11:10:57.276285 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.276269 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nr5gq" Jul 07 11:10:57.283006 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:57.282979 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375318b9_0adb_43e6_a740_c5d642af3e81.slice/crio-5dc6779b78b7a1bd3456858883757f4c48694a9c66a3d7f77aa250aeebef1112 WatchSource:0}: Error finding container 5dc6779b78b7a1bd3456858883757f4c48694a9c66a3d7f77aa250aeebef1112: Status 404 returned error can't find the container with id 5dc6779b78b7a1bd3456858883757f4c48694a9c66a3d7f77aa250aeebef1112 Jul 07 11:10:57.291323 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.291306 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zcp9j" Jul 07 11:10:57.297880 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:57.297863 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb530b5f3_833a_4b83_9cdc_0f496a0225ce.slice/crio-ee422195b2df39758acb4c29af902e5d094cb084295f9af92f2d458f5b16ee3f WatchSource:0}: Error finding container ee422195b2df39758acb4c29af902e5d094cb084295f9af92f2d458f5b16ee3f: Status 404 returned error can't find the container with id ee422195b2df39758acb4c29af902e5d094cb084295f9af92f2d458f5b16ee3f Jul 07 11:10:57.303682 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.303665 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6jn52" Jul 07 11:10:57.310030 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:57.310011 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9b91f5_31fe_4d04_8119_a716f0b530c2.slice/crio-94f4566640e57eb418251eab90af2a8355fadac094e37e81b598aeac97698e0d WatchSource:0}: Error finding container 94f4566640e57eb418251eab90af2a8355fadac094e37e81b598aeac97698e0d: Status 404 returned error can't find the container with id 94f4566640e57eb418251eab90af2a8355fadac094e37e81b598aeac97698e0d Jul 07 11:10:57.321204 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.321177 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vl8wg" Jul 07 11:10:57.327363 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:57.327339 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a515582_a597_4fce_a156_290dd468164d.slice/crio-10a6eb38fdaece24411898c49efc1ceba4ce892c22ef97c5b2406f0a3de37a08 WatchSource:0}: Error finding container 10a6eb38fdaece24411898c49efc1ceba4ce892c22ef97c5b2406f0a3de37a08: Status 404 returned error can't find the container with id 10a6eb38fdaece24411898c49efc1ceba4ce892c22ef97c5b2406f0a3de37a08 Jul 07 11:10:57.343515 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.343496 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:10:57.349407 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.349371 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" Jul 07 11:10:57.349659 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:57.349642 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c528ea_b661_4f45_9c17_a21058d52727.slice/crio-4b7298cbff970f1c5a0210bddb122105ae471fce8c277485e347fb0815d532e7 WatchSource:0}: Error finding container 4b7298cbff970f1c5a0210bddb122105ae471fce8c277485e347fb0815d532e7: Status 404 returned error can't find the container with id 4b7298cbff970f1c5a0210bddb122105ae471fce8c277485e347fb0815d532e7 Jul 07 11:10:57.355715 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.355691 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" Jul 07 11:10:57.356077 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:57.356058 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod848201b5_ab92_49c1_967f_4847f42c9b86.slice/crio-8e77028640fb27d5fc60df106b8016cdac171e70ebc7f185ec1adfd250bee714 WatchSource:0}: Error finding container 8e77028640fb27d5fc60df106b8016cdac171e70ebc7f185ec1adfd250bee714: Status 404 returned error can't find the container with id 8e77028640fb27d5fc60df106b8016cdac171e70ebc7f185ec1adfd250bee714 Jul 07 11:10:57.360313 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.360230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-87rvw" Jul 07 11:10:57.361879 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:57.361862 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod348e8c3c_f2c2_4301_acfe_8b52284da5b8.slice/crio-5320ea6a866a043a396720ba973965e4b3058713f545ba46a953ee3fe8c98b47 WatchSource:0}: Error finding container 5320ea6a866a043a396720ba973965e4b3058713f545ba46a953ee3fe8c98b47: Status 404 returned error can't find the container with id 5320ea6a866a043a396720ba973965e4b3058713f545ba46a953ee3fe8c98b47 Jul 07 11:10:57.367767 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:10:57.367749 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad4910d_9603_4c7c_8955_6629120e2c70.slice/crio-a3f7d7b317310e05600ace1e2e32c8e9392c07c45ee5a48b6992b46e92e49300 WatchSource:0}: Error finding container a3f7d7b317310e05600ace1e2e32c8e9392c07c45ee5a48b6992b46e92e49300: Status 404 returned error can't find the container with id a3f7d7b317310e05600ace1e2e32c8e9392c07c45ee5a48b6992b46e92e49300 Jul 07 11:10:57.413636 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.413620 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 11:10:57.501504 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.501474 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 11:10:57.649020 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.648937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs\") pod \"network-metrics-daemon-tz22d\" (UID: \"443056e3-d655-409e-b8b2-040cd2adf8f6\") " pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:10:57.649020 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.649002 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:10:57.649230 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.649105 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 11:10:57.649230 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.649106 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 11:10:57.649230 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.649164 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret podName:9106972d-25a4-4ca7-b58b-72e4af5cbef9 nodeName:}" failed. No retries permitted until 2026-07-07 11:10:58.649146404 +0000 UTC m=+3.125804360 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret") pod "global-pull-secret-syncer-9ntcg" (UID: "9106972d-25a4-4ca7-b58b-72e4af5cbef9") : object "kube-system"/"original-pull-secret" not registered Jul 07 11:10:57.649230 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.649184 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs podName:443056e3-d655-409e-b8b2-040cd2adf8f6 nodeName:}" failed. No retries permitted until 2026-07-07 11:10:58.649173491 +0000 UTC m=+3.125831432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs") pod "network-metrics-daemon-tz22d" (UID: "443056e3-d655-409e-b8b2-040cd2adf8f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 11:10:57.750756 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.750149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4mwx\" (UniqueName: \"kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx\") pod \"network-check-target-s4jm7\" (UID: \"1ddca397-3766-4e52-972e-bc7c6fc375a7\") " pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:10:57.750756 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.750330 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 11:10:57.750756 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.750352 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 11:10:57.750756 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.750365 2576 projected.go:196] Error preparing data for projected volume kube-api-access-j4mwx for pod openshift-network-diagnostics/network-check-target-s4jm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 11:10:57.750756 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:57.750443 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx podName:1ddca397-3766-4e52-972e-bc7c6fc375a7 nodeName:}" failed. No retries permitted until 2026-07-07 11:10:58.750424341 +0000 UTC m=+3.227082284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j4mwx" (UniqueName: "kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx") pod "network-check-target-s4jm7" (UID: "1ddca397-3766-4e52-972e-bc7c6fc375a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 11:10:57.984473 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.984346 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 11:05:56 +0000 UTC" deadline="2028-01-23 22:11:27.187212615 +0000 UTC" Jul 07 11:10:57.984473 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:57.984421 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13571h0m29.202796146s" Jul 07 11:10:58.069193 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:58.069110 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zcp9j" event={"ID":"b530b5f3-833a-4b83-9cdc-0f496a0225ce","Type":"ContainerStarted","Data":"ee422195b2df39758acb4c29af902e5d094cb084295f9af92f2d458f5b16ee3f"} Jul 07 11:10:58.077046 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:58.076971 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-st4qc" event={"ID":"3080673e-c2c6-416d-8f5f-dee0e93de1b5","Type":"ContainerStarted","Data":"a6e5c992068d4a880f83893ad9b23ec1a3bdbdcaa9f3e91286b3b08b43256bf1"} Jul 07 11:10:58.086925 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:58.086881 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" event={"ID":"348e8c3c-f2c2-4301-acfe-8b52284da5b8","Type":"ContainerStarted","Data":"5320ea6a866a043a396720ba973965e4b3058713f545ba46a953ee3fe8c98b47"} Jul 07 11:10:58.092113 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:58.092079 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" event={"ID":"31c528ea-b661-4f45-9c17-a21058d52727","Type":"ContainerStarted","Data":"4b7298cbff970f1c5a0210bddb122105ae471fce8c277485e347fb0815d532e7"} Jul 07 11:10:58.099473 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:58.099422 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vl8wg" event={"ID":"2a515582-a597-4fce-a156-290dd468164d","Type":"ContainerStarted","Data":"10a6eb38fdaece24411898c49efc1ceba4ce892c22ef97c5b2406f0a3de37a08"} Jul 07 11:10:58.112607 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:58.112538 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jn52" event={"ID":"6f9b91f5-31fe-4d04-8119-a716f0b530c2","Type":"ContainerStarted","Data":"94f4566640e57eb418251eab90af2a8355fadac094e37e81b598aeac97698e0d"} Jul 07 11:10:58.115297 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:58.115226 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nr5gq" event={"ID":"375318b9-0adb-43e6-a740-c5d642af3e81","Type":"ContainerStarted","Data":"5dc6779b78b7a1bd3456858883757f4c48694a9c66a3d7f77aa250aeebef1112"} Jul 07 11:10:58.117718 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:58.117655 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-87rvw" event={"ID":"7ad4910d-9603-4c7c-8955-6629120e2c70","Type":"ContainerStarted","Data":"a3f7d7b317310e05600ace1e2e32c8e9392c07c45ee5a48b6992b46e92e49300"} Jul 07 11:10:58.119428 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:58.119383 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" event={"ID":"848201b5-ab92-49c1-967f-4847f42c9b86","Type":"ContainerStarted","Data":"8e77028640fb27d5fc60df106b8016cdac171e70ebc7f185ec1adfd250bee714"} Jul 07 11:10:58.180264 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:58.180240 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 11:10:58.657839 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:58.657793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs\") pod \"network-metrics-daemon-tz22d\" (UID: \"443056e3-d655-409e-b8b2-040cd2adf8f6\") " pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:10:58.658020 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:58.657870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:10:58.658083 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:58.658021 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 11:10:58.658136 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:58.658084 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret podName:9106972d-25a4-4ca7-b58b-72e4af5cbef9 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:00.658064156 +0000 UTC m=+5.134722117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret") pod "global-pull-secret-syncer-9ntcg" (UID: "9106972d-25a4-4ca7-b58b-72e4af5cbef9") : object "kube-system"/"original-pull-secret" not registered Jul 07 11:10:58.658194 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:58.658158 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 11:10:58.658245 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:58.658195 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs podName:443056e3-d655-409e-b8b2-040cd2adf8f6 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:00.658180793 +0000 UTC m=+5.134838751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs") pod "network-metrics-daemon-tz22d" (UID: "443056e3-d655-409e-b8b2-040cd2adf8f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 11:10:58.758639 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:58.758602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4mwx\" (UniqueName: \"kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx\") pod \"network-check-target-s4jm7\" (UID: \"1ddca397-3766-4e52-972e-bc7c6fc375a7\") " pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:10:58.758812 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:58.758765 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 11:10:58.758812 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:58.758787 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 11:10:58.758812 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:58.758799 2576 projected.go:196] Error preparing data for projected volume kube-api-access-j4mwx for pod openshift-network-diagnostics/network-check-target-s4jm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 11:10:58.758957 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:58.758854 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx podName:1ddca397-3766-4e52-972e-bc7c6fc375a7 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:00.7588362 +0000 UTC m=+5.235494142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j4mwx" (UniqueName: "kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx") pod "network-check-target-s4jm7" (UID: "1ddca397-3766-4e52-972e-bc7c6fc375a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 11:10:58.985453 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:58.985411 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 11:05:56 +0000 UTC" deadline="2028-01-15 02:41:16.820602243 +0000 UTC" Jul 07 11:10:58.985453 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:58.985452 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13359h30m17.835155449s" Jul 07 11:10:59.050030 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:59.049137 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:10:59.050030 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:59.049269 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:10:59.050030 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:59.049714 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:10:59.050030 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:59.049818 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:10:59.050030 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:59.049884 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:10:59.050030 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:10:59.049974 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:10:59.691901 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:10:59.691687 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 11:11:00.675928 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:00.674958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs\") pod \"network-metrics-daemon-tz22d\" (UID: \"443056e3-d655-409e-b8b2-040cd2adf8f6\") " pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:00.675928 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:00.675244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:00.675928 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:00.675414 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 11:11:00.675928 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:00.675470 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret podName:9106972d-25a4-4ca7-b58b-72e4af5cbef9 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:04.675452137 +0000 UTC m=+9.152110091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret") pod "global-pull-secret-syncer-9ntcg" (UID: "9106972d-25a4-4ca7-b58b-72e4af5cbef9") : object "kube-system"/"original-pull-secret" not registered Jul 07 11:11:00.675928 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:00.675834 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 11:11:00.675928 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:00.675877 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs podName:443056e3-d655-409e-b8b2-040cd2adf8f6 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:04.67586284 +0000 UTC m=+9.152520792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs") pod "network-metrics-daemon-tz22d" (UID: "443056e3-d655-409e-b8b2-040cd2adf8f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 11:11:00.776142 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:00.776111 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4mwx\" (UniqueName: \"kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx\") pod \"network-check-target-s4jm7\" (UID: \"1ddca397-3766-4e52-972e-bc7c6fc375a7\") " pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:00.776336 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:00.776280 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 11:11:00.776336 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:00.776299 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 11:11:00.776336 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:00.776321 2576 projected.go:196] Error preparing data for projected volume kube-api-access-j4mwx for pod openshift-network-diagnostics/network-check-target-s4jm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 11:11:00.776565 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:00.776408 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx podName:1ddca397-3766-4e52-972e-bc7c6fc375a7 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:04.77637102 +0000 UTC m=+9.253028989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j4mwx" (UniqueName: "kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx") pod "network-check-target-s4jm7" (UID: "1ddca397-3766-4e52-972e-bc7c6fc375a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 11:11:01.049488 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:01.049390 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:01.049653 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:01.049555 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:01.050058 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:01.049996 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:01.050159 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:01.050135 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:01.050210 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:01.050171 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:01.050280 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:01.050249 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:03.049706 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:03.049671 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:03.050149 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:03.049802 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:03.050198 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:03.050176 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:03.050290 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:03.050267 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:03.050538 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:03.050329 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:03.050538 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:03.050417 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:04.710573 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:04.710540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs\") pod \"network-metrics-daemon-tz22d\" (UID: \"443056e3-d655-409e-b8b2-040cd2adf8f6\") " pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:04.711034 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:04.710588 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:04.711034 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:04.710676 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 11:11:04.711034 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:04.710723 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret podName:9106972d-25a4-4ca7-b58b-72e4af5cbef9 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:12.710710594 +0000 UTC m=+17.187368545 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret") pod "global-pull-secret-syncer-9ntcg" (UID: "9106972d-25a4-4ca7-b58b-72e4af5cbef9") : object "kube-system"/"original-pull-secret" not registered Jul 07 11:11:04.711034 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:04.711014 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 11:11:04.711278 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:04.711047 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs podName:443056e3-d655-409e-b8b2-040cd2adf8f6 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:12.711036765 +0000 UTC m=+17.187694717 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs") pod "network-metrics-daemon-tz22d" (UID: "443056e3-d655-409e-b8b2-040cd2adf8f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 11:11:04.811491 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:04.811440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4mwx\" (UniqueName: \"kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx\") pod \"network-check-target-s4jm7\" (UID: \"1ddca397-3766-4e52-972e-bc7c6fc375a7\") " pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:04.811680 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:04.811619 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 11:11:04.811680 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:04.811639 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 11:11:04.811680 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:04.811652 2576 projected.go:196] Error preparing data for projected volume kube-api-access-j4mwx for pod openshift-network-diagnostics/network-check-target-s4jm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 11:11:04.811838 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:04.811709 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx podName:1ddca397-3766-4e52-972e-bc7c6fc375a7 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:12.811689629 +0000 UTC m=+17.288347591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j4mwx" (UniqueName: "kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx") pod "network-check-target-s4jm7" (UID: "1ddca397-3766-4e52-972e-bc7c6fc375a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 11:11:05.049633 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:05.049548 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:05.049783 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:05.049672 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:05.050164 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:05.050140 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:05.050289 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:05.050265 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:05.050362 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:05.050319 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:05.050468 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:05.050451 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:07.049698 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:07.049234 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:07.049698 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:07.049233 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:07.049698 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:07.049367 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:07.049698 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:07.049522 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:07.049698 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:07.049248 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:07.049698 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:07.049611 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:09.049369 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:09.049337 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:09.049805 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:09.049337 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:09.049805 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:09.049453 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:09.049805 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:09.049536 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:09.049805 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:09.049337 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:09.049805 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:09.049625 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:11.049726 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:11.049692 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:11.049726 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:11.049710 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:11.050191 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:11.049749 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:11.050191 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:11.049843 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:11.050191 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:11.049970 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:11.050191 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:11.050046 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:12.774535 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:12.774506 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs\") pod \"network-metrics-daemon-tz22d\" (UID: \"443056e3-d655-409e-b8b2-040cd2adf8f6\") " pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:12.775026 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:12.774556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:12.775026 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:12.774670 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 11:11:12.775026 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:12.774672 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 11:11:12.775026 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:12.774725 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret podName:9106972d-25a4-4ca7-b58b-72e4af5cbef9 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:28.774711463 +0000 UTC m=+33.251369401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret") pod "global-pull-secret-syncer-9ntcg" (UID: "9106972d-25a4-4ca7-b58b-72e4af5cbef9") : object "kube-system"/"original-pull-secret" not registered Jul 07 11:11:12.775026 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:12.774740 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs podName:443056e3-d655-409e-b8b2-040cd2adf8f6 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:28.774732123 +0000 UTC m=+33.251390062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs") pod "network-metrics-daemon-tz22d" (UID: "443056e3-d655-409e-b8b2-040cd2adf8f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 11:11:12.875584 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:12.875557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4mwx\" (UniqueName: \"kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx\") pod \"network-check-target-s4jm7\" (UID: \"1ddca397-3766-4e52-972e-bc7c6fc375a7\") " pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:12.875785 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:12.875700 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 11:11:12.875785 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:12.875725 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 11:11:12.875785 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:12.875739 2576 projected.go:196] Error preparing data for projected volume kube-api-access-j4mwx for pod openshift-network-diagnostics/network-check-target-s4jm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 11:11:12.875911 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:12.875799 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx podName:1ddca397-3766-4e52-972e-bc7c6fc375a7 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:28.875781406 +0000 UTC m=+33.352439360 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j4mwx" (UniqueName: "kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx") pod "network-check-target-s4jm7" (UID: "1ddca397-3766-4e52-972e-bc7c6fc375a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 11:11:13.049952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:13.049868 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:13.050137 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:13.049985 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:13.050137 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:13.050009 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:13.050137 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:13.049985 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:13.050137 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:13.050103 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:13.050347 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:13.050233 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:15.049574 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:15.049521 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:15.050036 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:15.049666 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:15.050036 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:15.049670 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:15.050036 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:15.049700 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:15.050036 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:15.049766 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:15.050036 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:15.049839 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:17.049487 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:17.049458 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:17.049487 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:17.049481 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:17.049927 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:17.049482 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:17.049927 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:17.049560 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:17.049927 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:17.049674 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:17.049927 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:17.049754 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:19.049818 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.049557 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:19.050372 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.049610 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:19.050372 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:19.049900 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:19.050372 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.049610 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:19.050372 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:19.049957 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:19.050372 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:19.050053 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:19.183741 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.183718 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" event={"ID":"31c528ea-b661-4f45-9c17-a21058d52727","Type":"ContainerStarted","Data":"b524330af091b297618e985281fe60aa26563bf571497419c38c3cebe617db3f"} Jul 07 11:11:19.183877 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.183786 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" event={"ID":"31c528ea-b661-4f45-9c17-a21058d52727","Type":"ContainerStarted","Data":"5b1732b52777ded1a088b8b698854cae703d98f1899cd6b1f75308bfb9bf77c0"} Jul 07 11:11:19.183877 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.183836 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" event={"ID":"31c528ea-b661-4f45-9c17-a21058d52727","Type":"ContainerStarted","Data":"e51c8bb787a9eb4cd802876b0c850c61fc0389c23ab9c4d088bb5408ab7db8de"} Jul 07 11:11:19.183877 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.183873 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" event={"ID":"31c528ea-b661-4f45-9c17-a21058d52727","Type":"ContainerStarted","Data":"b4cf438f6e01d0f34110afec71ca958f8ad75d2763cafac3834ae601723be8e7"} Jul 07 11:11:19.184003 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.183910 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" event={"ID":"31c528ea-b661-4f45-9c17-a21058d52727","Type":"ContainerStarted","Data":"3e11a262e80906d1ad7ecc1636698de40ee9b4226ef069058a1388c29df41d16"} Jul 07 11:11:19.184003 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.183955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" event={"ID":"31c528ea-b661-4f45-9c17-a21058d52727","Type":"ContainerStarted","Data":"cd3e759878bc091b05b0e7397e7a8687fe84cc29a7e835c9825143ef787114f0"} Jul 07 11:11:19.185083 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.185062 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f9b91f5-31fe-4d04-8119-a716f0b530c2" containerID="be4d620575d8c6223f4b0e1f68cf5319b591c766cfb6b6faf0c6492c1dcf1548" exitCode=0 Jul 07 11:11:19.185177 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.185135 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jn52" event={"ID":"6f9b91f5-31fe-4d04-8119-a716f0b530c2","Type":"ContainerDied","Data":"be4d620575d8c6223f4b0e1f68cf5319b591c766cfb6b6faf0c6492c1dcf1548"} Jul 07 11:11:19.186516 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.186492 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nr5gq" event={"ID":"375318b9-0adb-43e6-a740-c5d642af3e81","Type":"ContainerStarted","Data":"94b990759b4aff8b38f1dee7abfee33efb633173d9b91decf12b4bb06618d331"} Jul 07 11:11:19.188079 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.188058 2576 generic.go:356] "Generic (PLEG): container finished" podID="178de8741949e5ed2708ec156f89e176" containerID="b2b5523820413bc16f13a42136bbc75f87ce99e2534e23adcfa6fbfd50c88ea7" exitCode=0 Jul 07 11:11:19.188159 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.188143 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal" event={"ID":"178de8741949e5ed2708ec156f89e176","Type":"ContainerDied","Data":"b2b5523820413bc16f13a42136bbc75f87ce99e2534e23adcfa6fbfd50c88ea7"} Jul 07 11:11:19.189573 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.189553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-87rvw" event={"ID":"7ad4910d-9603-4c7c-8955-6629120e2c70","Type":"ContainerStarted","Data":"f169560f6780ad246cff670719e57b56f6d597755541c6837d99c0f43b8549bc"} Jul 07 11:11:19.191154 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.191137 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" event={"ID":"848201b5-ab92-49c1-967f-4847f42c9b86","Type":"ContainerStarted","Data":"a75f51ad3b0032de6d8ddf22eb80ee6aed375d05a4ecc23382adba36f7ac03a0"} Jul 07 11:11:19.192565 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.192543 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zcp9j" event={"ID":"b530b5f3-833a-4b83-9cdc-0f496a0225ce","Type":"ContainerStarted","Data":"8e5c4c74494b4bd5e4aaa16a19c8b0e57964b07fd5a23832ad1f9077e79c5e16"} Jul 07 11:11:19.193824 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.193805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-st4qc" event={"ID":"3080673e-c2c6-416d-8f5f-dee0e93de1b5","Type":"ContainerStarted","Data":"4b2b63b567307627f4e3215fe34709bdc0238eec444dc5d9b4b5cbab1d968543"} Jul 07 11:11:19.195101 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.195083 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-8.ec2.internal" event={"ID":"2ca19b4fae04ee4ffd4ef9397655850d","Type":"ContainerStarted","Data":"bf7abd16a5f90eff1bf49ed2120185ca5a59f8d4392ab60ef059ba660e9f26d3"} Jul 07 11:11:19.196432 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.196411 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" event={"ID":"348e8c3c-f2c2-4301-acfe-8b52284da5b8","Type":"ContainerStarted","Data":"dd042a5985f641d775908dc88793c120b7768d4c608d2c2364f1f3e3e00f4c6e"} Jul 07 11:11:19.224731 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.224695 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-8.ec2.internal" podStartSLOduration=23.224680096 podStartE2EDuration="23.224680096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:11:19.224599328 +0000 UTC m=+23.701257288" watchObservedRunningTime="2026-07-07 11:11:19.224680096 +0000 UTC m=+23.701338058" Jul 07 11:11:19.255049 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.255017 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zcp9j" podStartSLOduration=7.244769538 podStartE2EDuration="23.255005282s" totalImagesPullingTime="16.010235744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:11:19.254874147 +0000 UTC m=+23.731532109" watchObservedRunningTime="2026-07-07 11:11:19.255005282 +0000 UTC m=+23.731663294" Jul 07 11:11:19.255513 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.255488 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-st4qc" podStartSLOduration=2.506720295 podStartE2EDuration="23.255481888s" totalImagesPullingTime="20.748761593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:11:19.239929368 +0000 UTC m=+23.716587329" watchObservedRunningTime="2026-07-07 11:11:19.255481888 +0000 UTC m=+23.732139898" Jul 07 11:11:19.299010 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.298976 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x7bwl" podStartSLOduration=2.60441716 podStartE2EDuration="23.298965618s" totalImagesPullingTime="20.694548458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:11:19.298376212 +0000 UTC m=+23.775034174" watchObservedRunningTime="2026-07-07 11:11:19.298965618 +0000 UTC m=+23.775623579" Jul 07 11:11:19.299152 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.299125 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nr5gq" podStartSLOduration=2.515352091 podStartE2EDuration="23.299119883s" totalImagesPullingTime="20.783767792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:11:19.275599505 +0000 UTC m=+23.752257470" watchObservedRunningTime="2026-07-07 11:11:19.299119883 +0000 UTC m=+23.775777844" Jul 07 11:11:19.338599 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.338564 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-87rvw" podStartSLOduration=2.735056381 podStartE2EDuration="23.33855216s" totalImagesPullingTime="20.603495779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:11:19.316331828 +0000 UTC m=+23.792989789" watchObservedRunningTime="2026-07-07 11:11:19.33855216 +0000 UTC m=+23.815210121" Jul 07 11:11:19.572066 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.571967 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zcp9j" Jul 07 11:11:19.572482 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:19.572465 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zcp9j" Jul 07 11:11:20.199581 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:20.199555 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vl8wg" event={"ID":"2a515582-a597-4fce-a156-290dd468164d","Type":"ContainerStarted","Data":"8cbb8de8a6e6686d465bcaed41760aabe44dcaa46c3c1fb4737ecc889d8ab8f0"} Jul 07 11:11:20.201379 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:20.201326 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal" event={"ID":"178de8741949e5ed2708ec156f89e176","Type":"ContainerStarted","Data":"8409b1f027f1f3e7f57725c0f775f81ceb817ec7d16c05f9675ce3ac75363373"} Jul 07 11:11:20.218603 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:20.218543 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vl8wg" podStartSLOduration=3.489749292 podStartE2EDuration="24.218523646s" totalImagesPullingTime="20.728774354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:11:20.218087275 +0000 UTC m=+24.694745240" watchObservedRunningTime="2026-07-07 11:11:20.218523646 +0000 UTC m=+24.695181609" Jul 07 11:11:20.246786 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:20.246743 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-8.ec2.internal" podStartSLOduration=24.246724347 podStartE2EDuration="24.246724347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:11:20.24567556 +0000 UTC m=+24.722333523" watchObservedRunningTime="2026-07-07 11:11:20.246724347 +0000 UTC m=+24.723382308" Jul 07 11:11:20.307842 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:20.307776 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 11:11:20.673584 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:20.673547 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zcp9j" Jul 07 11:11:20.674116 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:20.674089 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zcp9j" Jul 07 11:11:20.999014 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:20.998893 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T11:11:20.307800324Z","UUID":"c9ba7432-044b-4bc9-a585-b2825dacac8b","Handler":null,"Name":"","Endpoint":""} Jul 07 11:11:21.000613 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:21.000591 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 11:11:21.000763 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:21.000626 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 11:11:21.049573 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:21.049342 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:21.049573 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:21.049505 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:21.049573 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:21.049517 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:21.049573 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:21.049535 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:21.049874 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:21.049622 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:21.049874 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:21.049701 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:21.206135 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:21.206056 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" event={"ID":"848201b5-ab92-49c1-967f-4847f42c9b86","Type":"ContainerStarted","Data":"74480a727ee7b44575e6013b17a275f3ba19012288d91d7b831255cb0d0bc667"} Jul 07 11:11:21.209864 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:21.209831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" event={"ID":"31c528ea-b661-4f45-9c17-a21058d52727","Type":"ContainerStarted","Data":"40ea3050156e2bf8f3c8c9ecae6299f67dd5ce09974842a5fae507fdd88a922b"} Jul 07 11:11:22.215151 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:22.215113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" event={"ID":"848201b5-ab92-49c1-967f-4847f42c9b86","Type":"ContainerStarted","Data":"d46ad25d76b8fe5f4bf1aa90fe33fa1b69108b7145361550a6a1b4c107c1cba3"} Jul 07 11:11:22.234714 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:22.234667 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhx9s" podStartSLOduration=3.264585766 podStartE2EDuration="26.234646165s" totalImagesPullingTime="22.970060399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:10:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:11:22.234610099 +0000 UTC m=+26.711268070" watchObservedRunningTime="2026-07-07 11:11:22.234646165 +0000 UTC m=+26.711304127" Jul 07 11:11:23.049365 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:23.049336 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:23.049524 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:23.049453 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:23.049524 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:23.049467 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:23.049524 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:23.049462 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:23.049675 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:23.049569 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:23.049675 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:23.049666 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:24.224430 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:24.224170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" event={"ID":"31c528ea-b661-4f45-9c17-a21058d52727","Type":"ContainerStarted","Data":"8b8331209eb0f6add0d37b309a0e31002f753c543d9a749ebdb9611fb510e974"} Jul 07 11:11:24.225061 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:24.224484 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:11:24.226301 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:24.226280 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f9b91f5-31fe-4d04-8119-a716f0b530c2" containerID="1aaa36d89144259345aa36133b77be8df264fa2698964f07852c2e81caf261d2" exitCode=0 Jul 07 11:11:24.226417 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:24.226316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jn52" event={"ID":"6f9b91f5-31fe-4d04-8119-a716f0b530c2","Type":"ContainerDied","Data":"1aaa36d89144259345aa36133b77be8df264fa2698964f07852c2e81caf261d2"} Jul 07 11:11:24.239915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:24.239891 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:11:24.252468 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:24.252427 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" podStartSLOduration=7.420525637 podStartE2EDuration="28.252392536s" totalImagesPullingTime="20.831866899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:11:24.252063316 +0000 UTC m=+28.728721276" watchObservedRunningTime="2026-07-07 11:11:24.252392536 +0000 UTC m=+28.729050498" Jul 07 11:11:25.049828 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:25.049799 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:25.050000 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:25.049802 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:25.050000 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:25.049908 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:25.050000 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:25.049929 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:25.050099 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:25.050021 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:25.050136 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:25.050098 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:25.229222 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:25.229076 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:11:25.229222 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:25.229167 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:11:25.255253 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:25.255227 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:11:25.909760 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:25.909464 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9ntcg"] Jul 07 11:11:25.909981 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:25.909808 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:25.909981 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:25.909903 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:25.910204 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:25.910185 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s4jm7"] Jul 07 11:11:25.910283 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:25.910273 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:25.910358 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:25.910343 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:25.923082 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:25.923052 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tz22d"] Jul 07 11:11:25.923196 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:25.923160 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:25.923284 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:25.923246 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:26.232716 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:26.232680 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f9b91f5-31fe-4d04-8119-a716f0b530c2" containerID="62aca89973616930af4321c06158cfe1c687baeab5fe3bcc34a70a0c9e81058e" exitCode=0 Jul 07 11:11:26.233174 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:26.232762 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jn52" event={"ID":"6f9b91f5-31fe-4d04-8119-a716f0b530c2","Type":"ContainerDied","Data":"62aca89973616930af4321c06158cfe1c687baeab5fe3bcc34a70a0c9e81058e"} Jul 07 11:11:27.049004 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:27.048969 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:27.049189 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:27.049078 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:28.049218 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:28.049194 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:28.049562 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:28.049194 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:28.049562 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:28.049323 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:28.049562 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:28.049362 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:28.242177 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:28.242142 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f9b91f5-31fe-4d04-8119-a716f0b530c2" containerID="72cb1c5dd6500f71a4e458d1ff2d54b41edfd02cb6b1622f8c24b4e0db52d0a4" exitCode=0 Jul 07 11:11:28.242336 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:28.242200 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jn52" event={"ID":"6f9b91f5-31fe-4d04-8119-a716f0b530c2","Type":"ContainerDied","Data":"72cb1c5dd6500f71a4e458d1ff2d54b41edfd02cb6b1622f8c24b4e0db52d0a4"} Jul 07 11:11:28.793308 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:28.793268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs\") pod \"network-metrics-daemon-tz22d\" (UID: \"443056e3-d655-409e-b8b2-040cd2adf8f6\") " pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:28.793485 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:28.793334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:28.793485 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:28.793456 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 11:11:28.793485 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:28.793458 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 11:11:28.793611 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:28.793516 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret podName:9106972d-25a4-4ca7-b58b-72e4af5cbef9 nodeName:}" failed. No retries permitted until 2026-07-07 11:12:00.793501133 +0000 UTC m=+65.270159076 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret") pod "global-pull-secret-syncer-9ntcg" (UID: "9106972d-25a4-4ca7-b58b-72e4af5cbef9") : object "kube-system"/"original-pull-secret" not registered Jul 07 11:11:28.793611 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:28.793530 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs podName:443056e3-d655-409e-b8b2-040cd2adf8f6 nodeName:}" failed. No retries permitted until 2026-07-07 11:12:00.793524181 +0000 UTC m=+65.270182119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs") pod "network-metrics-daemon-tz22d" (UID: "443056e3-d655-409e-b8b2-040cd2adf8f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 11:11:28.894288 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:28.894256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4mwx\" (UniqueName: \"kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx\") pod \"network-check-target-s4jm7\" (UID: \"1ddca397-3766-4e52-972e-bc7c6fc375a7\") " pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:28.894478 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:28.894450 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 11:11:28.894478 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:28.894470 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 11:11:28.894575 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:28.894480 2576 projected.go:196] Error preparing data for projected volume kube-api-access-j4mwx for pod openshift-network-diagnostics/network-check-target-s4jm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 11:11:28.894575 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:28.894544 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx podName:1ddca397-3766-4e52-972e-bc7c6fc375a7 nodeName:}" failed. No retries permitted until 2026-07-07 11:12:00.894528592 +0000 UTC m=+65.371186546 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j4mwx" (UniqueName: "kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx") pod "network-check-target-s4jm7" (UID: "1ddca397-3766-4e52-972e-bc7c6fc375a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 11:11:29.049937 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:29.049851 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:29.050315 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:29.049987 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:30.048997 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:30.048962 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:30.049181 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:30.048961 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:30.049181 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:30.049075 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz22d" podUID="443056e3-d655-409e-b8b2-040cd2adf8f6" Jul 07 11:11:30.049181 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:30.049154 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4jm7" podUID="1ddca397-3766-4e52-972e-bc7c6fc375a7" Jul 07 11:11:31.049568 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.049538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:31.049991 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:31.049664 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9ntcg" podUID="9106972d-25a4-4ca7-b58b-72e4af5cbef9" Jul 07 11:11:31.850469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.850162 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-8.ec2.internal" event="NodeReady" Jul 07 11:11:31.850597 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.850532 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 11:11:31.910197 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.910122 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f74bdc6b8-4vpdz"] Jul 07 11:11:31.912182 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.912162 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:31.915359 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.915335 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 11:11:31.915531 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.915448 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 11:11:31.915531 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.915525 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 11:11:31.915751 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.915735 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hg565\"" Jul 07 11:11:31.921570 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.921181 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 11:11:31.940476 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.939906 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5mnfm"] Jul 07 11:11:31.942165 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.942143 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f74bdc6b8-4vpdz"] Jul 07 11:11:31.942281 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.942178 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5h9rt"] Jul 07 11:11:31.942281 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.942273 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5mnfm" Jul 07 11:11:31.944501 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.944480 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:31.945099 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.945080 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jjlcq\"" Jul 07 11:11:31.949908 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.949885 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 11:11:31.950007 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.949916 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 11:11:31.950069 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.950056 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 11:11:31.950342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.950325 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2gjl2\"" Jul 07 11:11:31.950628 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.950614 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 11:11:31.950715 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.950645 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 11:11:31.962577 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.962553 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5mnfm"] Jul 07 11:11:31.969853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:31.969825 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5h9rt"] Jul 07 11:11:32.021474 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.021437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgw77\" (UniqueName: \"kubernetes.io/projected/d320459c-a431-4b6e-9ce6-8081cb31087b-kube-api-access-fgw77\") pod \"ingress-canary-5mnfm\" (UID: \"d320459c-a431-4b6e-9ce6-8081cb31087b\") " pod="openshift-ingress-canary/ingress-canary-5mnfm" Jul 07 11:11:32.021660 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.021495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnnzg\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-kube-api-access-gnnzg\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.021660 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.021574 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83c82870-97ad-4c67-9d7e-16305d9f8d61-image-registry-private-configuration\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.021660 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.021619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83c82870-97ad-4c67-9d7e-16305d9f8d61-ca-trust-extracted\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.021660 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.021646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d320459c-a431-4b6e-9ce6-8081cb31087b-cert\") pod \"ingress-canary-5mnfm\" (UID: \"d320459c-a431-4b6e-9ce6-8081cb31087b\") " pod="openshift-ingress-canary/ingress-canary-5mnfm" Jul 07 11:11:32.021792 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.021673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83c82870-97ad-4c67-9d7e-16305d9f8d61-installation-pull-secrets\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.021792 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.021690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-bound-sa-token\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.021792 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.021712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.021792 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.021737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83c82870-97ad-4c67-9d7e-16305d9f8d61-trusted-ca\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.021917 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.021793 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-certificates\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.049375 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.049333 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:11:32.049375 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.049376 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:11:32.056909 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.056749 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 11:11:32.057019 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.057002 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 11:11:32.057348 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.057307 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 11:11:32.057348 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.057324 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7b27w\"" Jul 07 11:11:32.057543 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.057326 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cn2cx\"" Jul 07 11:11:32.122203 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83c82870-97ad-4c67-9d7e-16305d9f8d61-ca-trust-extracted\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.122203 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d320459c-a431-4b6e-9ce6-8081cb31087b-cert\") pod \"ingress-canary-5mnfm\" (UID: \"d320459c-a431-4b6e-9ce6-8081cb31087b\") " pod="openshift-ingress-canary/ingress-canary-5mnfm" Jul 07 11:11:32.122203 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:32.122507 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83c82870-97ad-4c67-9d7e-16305d9f8d61-installation-pull-secrets\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.122507 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-bound-sa-token\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.122507 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122258 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.122507 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83c82870-97ad-4c67-9d7e-16305d9f8d61-trusted-ca\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.122507 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-certificates\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.122507 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5j42\" (UniqueName: \"kubernetes.io/projected/a8b7f788-470c-4494-9a49-491222a25879-kube-api-access-s5j42\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:32.122507 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgw77\" (UniqueName: \"kubernetes.io/projected/d320459c-a431-4b6e-9ce6-8081cb31087b-kube-api-access-fgw77\") pod \"ingress-canary-5mnfm\" (UID: \"d320459c-a431-4b6e-9ce6-8081cb31087b\") " pod="openshift-ingress-canary/ingress-canary-5mnfm" Jul 07 11:11:32.122507 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:32.122458 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 11:11:32.122507 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:32.122476 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f74bdc6b8-4vpdz: secret "image-registry-tls" not found Jul 07 11:11:32.123160 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:32.122534 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls podName:83c82870-97ad-4c67-9d7e-16305d9f8d61 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:32.622516106 +0000 UTC m=+37.099174062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls") pod "image-registry-6f74bdc6b8-4vpdz" (UID: "83c82870-97ad-4c67-9d7e-16305d9f8d61") : secret "image-registry-tls" not found Jul 07 11:11:32.123160 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122638 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83c82870-97ad-4c67-9d7e-16305d9f8d61-ca-trust-extracted\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.123160 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122689 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnnzg\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-kube-api-access-gnnzg\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.123160 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8b7f788-470c-4494-9a49-491222a25879-config-volume\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:32.123160 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8b7f788-470c-4494-9a49-491222a25879-tmp-dir\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:32.123160 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83c82870-97ad-4c67-9d7e-16305d9f8d61-image-registry-private-configuration\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.123160 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.122919 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-certificates\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.123501 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.123472 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83c82870-97ad-4c67-9d7e-16305d9f8d61-trusted-ca\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.126689 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.126670 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d320459c-a431-4b6e-9ce6-8081cb31087b-cert\") pod \"ingress-canary-5mnfm\" (UID: \"d320459c-a431-4b6e-9ce6-8081cb31087b\") " pod="openshift-ingress-canary/ingress-canary-5mnfm" Jul 07 11:11:32.126689 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.126683 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83c82870-97ad-4c67-9d7e-16305d9f8d61-installation-pull-secrets\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.126841 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.126690 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83c82870-97ad-4c67-9d7e-16305d9f8d61-image-registry-private-configuration\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.134379 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.134353 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-bound-sa-token\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.135156 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.135128 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgw77\" (UniqueName: \"kubernetes.io/projected/d320459c-a431-4b6e-9ce6-8081cb31087b-kube-api-access-fgw77\") pod \"ingress-canary-5mnfm\" (UID: \"d320459c-a431-4b6e-9ce6-8081cb31087b\") " pod="openshift-ingress-canary/ingress-canary-5mnfm" Jul 07 11:11:32.138023 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.138004 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnnzg\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-kube-api-access-gnnzg\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.224172 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.224136 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8b7f788-470c-4494-9a49-491222a25879-config-volume\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:32.224172 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.224177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8b7f788-470c-4494-9a49-491222a25879-tmp-dir\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:32.224386 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.224227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:32.224386 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:32.224337 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 11:11:32.224386 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.224372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5j42\" (UniqueName: \"kubernetes.io/projected/a8b7f788-470c-4494-9a49-491222a25879-kube-api-access-s5j42\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:32.224572 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:32.224438 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls podName:a8b7f788-470c-4494-9a49-491222a25879 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:32.724392239 +0000 UTC m=+37.201050178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls") pod "dns-default-5h9rt" (UID: "a8b7f788-470c-4494-9a49-491222a25879") : secret "dns-default-metrics-tls" not found Jul 07 11:11:32.224627 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.224581 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8b7f788-470c-4494-9a49-491222a25879-tmp-dir\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:32.224776 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.224759 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8b7f788-470c-4494-9a49-491222a25879-config-volume\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:32.235684 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.235658 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5j42\" (UniqueName: \"kubernetes.io/projected/a8b7f788-470c-4494-9a49-491222a25879-kube-api-access-s5j42\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:32.255526 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.255495 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5mnfm" Jul 07 11:11:32.627466 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.627423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:32.627652 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:32.627594 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 11:11:32.627652 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:32.627615 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f74bdc6b8-4vpdz: secret "image-registry-tls" not found Jul 07 11:11:32.627761 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:32.627684 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls podName:83c82870-97ad-4c67-9d7e-16305d9f8d61 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:33.627665382 +0000 UTC m=+38.104323338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls") pod "image-registry-6f74bdc6b8-4vpdz" (UID: "83c82870-97ad-4c67-9d7e-16305d9f8d61") : secret "image-registry-tls" not found Jul 07 11:11:32.728583 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:32.728546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:32.728753 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:32.728687 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 11:11:32.728795 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:32.728768 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls podName:a8b7f788-470c-4494-9a49-491222a25879 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:33.728749244 +0000 UTC m=+38.205407203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls") pod "dns-default-5h9rt" (UID: "a8b7f788-470c-4494-9a49-491222a25879") : secret "dns-default-metrics-tls" not found Jul 07 11:11:33.049088 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:33.049053 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:11:33.052131 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:33.052101 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 11:11:33.635797 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:33.635753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:33.635982 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:33.635939 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 11:11:33.635982 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:33.635963 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f74bdc6b8-4vpdz: secret "image-registry-tls" not found Jul 07 11:11:33.636060 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:33.636032 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls podName:83c82870-97ad-4c67-9d7e-16305d9f8d61 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:35.636011364 +0000 UTC m=+40.112669319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls") pod "image-registry-6f74bdc6b8-4vpdz" (UID: "83c82870-97ad-4c67-9d7e-16305d9f8d61") : secret "image-registry-tls" not found Jul 07 11:11:33.736431 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:33.736359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:33.736623 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:33.736574 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 11:11:33.736694 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:33.736660 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls podName:a8b7f788-470c-4494-9a49-491222a25879 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:35.736633878 +0000 UTC m=+40.213291821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls") pod "dns-default-5h9rt" (UID: "a8b7f788-470c-4494-9a49-491222a25879") : secret "dns-default-metrics-tls" not found Jul 07 11:11:33.927657 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:33.927349 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5mnfm"] Jul 07 11:11:33.933479 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:11:33.933450 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd320459c_a431_4b6e_9ce6_8081cb31087b.slice/crio-99b3c9e5fb8548c956c7fe9dc05b2e3410133c7749798a3c12bea7cc006e927b WatchSource:0}: Error finding container 99b3c9e5fb8548c956c7fe9dc05b2e3410133c7749798a3c12bea7cc006e927b: Status 404 returned error can't find the container with id 99b3c9e5fb8548c956c7fe9dc05b2e3410133c7749798a3c12bea7cc006e927b Jul 07 11:11:34.259189 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:34.259109 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f9b91f5-31fe-4d04-8119-a716f0b530c2" containerID="98fb8c8c75f9babf54ef977c03c3765937aedcf973c453e6b7dc5b9a4829dc2d" exitCode=0 Jul 07 11:11:34.259865 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:34.259186 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jn52" event={"ID":"6f9b91f5-31fe-4d04-8119-a716f0b530c2","Type":"ContainerDied","Data":"98fb8c8c75f9babf54ef977c03c3765937aedcf973c453e6b7dc5b9a4829dc2d"} Jul 07 11:11:34.260388 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:34.260367 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5mnfm" event={"ID":"d320459c-a431-4b6e-9ce6-8081cb31087b","Type":"ContainerStarted","Data":"99b3c9e5fb8548c956c7fe9dc05b2e3410133c7749798a3c12bea7cc006e927b"} Jul 07 11:11:35.266356 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:35.266317 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f9b91f5-31fe-4d04-8119-a716f0b530c2" containerID="38b2451ff22866cf6cf3ee7d34e94ff151eab79c2480769abdd811651745010e" exitCode=0 Jul 07 11:11:35.266855 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:35.266380 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jn52" event={"ID":"6f9b91f5-31fe-4d04-8119-a716f0b530c2","Type":"ContainerDied","Data":"38b2451ff22866cf6cf3ee7d34e94ff151eab79c2480769abdd811651745010e"} Jul 07 11:11:35.653217 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:35.653127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:35.653384 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:35.653337 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 11:11:35.653384 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:35.653361 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f74bdc6b8-4vpdz: secret "image-registry-tls" not found Jul 07 11:11:35.653527 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:35.653456 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls podName:83c82870-97ad-4c67-9d7e-16305d9f8d61 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:39.653434165 +0000 UTC m=+44.130092130 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls") pod "image-registry-6f74bdc6b8-4vpdz" (UID: "83c82870-97ad-4c67-9d7e-16305d9f8d61") : secret "image-registry-tls" not found Jul 07 11:11:35.753889 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:35.753848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:35.754032 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:35.753981 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 11:11:35.754097 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:35.754039 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls podName:a8b7f788-470c-4494-9a49-491222a25879 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:39.754022207 +0000 UTC m=+44.230680145 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls") pod "dns-default-5h9rt" (UID: "a8b7f788-470c-4494-9a49-491222a25879") : secret "dns-default-metrics-tls" not found Jul 07 11:11:36.273372 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:36.273332 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jn52" event={"ID":"6f9b91f5-31fe-4d04-8119-a716f0b530c2","Type":"ContainerStarted","Data":"a2a7057c1ca08b28c9aee87ea443563ed08ffddbf8c87b8efb6779cdc1cb80c8"} Jul 07 11:11:36.301264 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:36.301203 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6jn52" podStartSLOduration=6.890372541 podStartE2EDuration="40.301181938s" totalImagesPullingTime="33.410809397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:10:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:11:36.299357226 +0000 UTC m=+40.776015196" watchObservedRunningTime="2026-07-07 11:11:36.301181938 +0000 UTC m=+40.777839900" Jul 07 11:11:37.276718 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.276670 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5mnfm" event={"ID":"d320459c-a431-4b6e-9ce6-8081cb31087b","Type":"ContainerStarted","Data":"b36c817919d671dd2bb90a7cb8aa489afc3a99f04a004fd62f5acdfcd3321509"} Jul 07 11:11:37.294556 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.294511 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5mnfm" podStartSLOduration=3.369166667 podStartE2EDuration="6.294495917s" totalImagesPullingTime="2.92532925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:11:37.294138124 +0000 UTC m=+41.770796086" watchObservedRunningTime="2026-07-07 11:11:37.294495917 +0000 UTC m=+41.771153878" Jul 07 11:11:37.667387 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.667355 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dg7s8"] Jul 07 11:11:37.687625 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.687589 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dg7s8"] Jul 07 11:11:37.687772 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.687701 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:37.691456 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.691434 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 11:11:37.691649 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.691528 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tnjrv\"" Jul 07 11:11:37.692415 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.692377 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 11:11:37.692494 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.692450 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 11:11:37.692531 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.692382 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 11:11:37.868672 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.868631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxnv4\" (UniqueName: \"kubernetes.io/projected/efd30219-18cc-478b-ac1e-d013112f11ee-kube-api-access-wxnv4\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:37.868845 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.868730 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:37.868845 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.868767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/efd30219-18cc-478b-ac1e-d013112f11ee-crio-socket\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:37.868845 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.868793 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/efd30219-18cc-478b-ac1e-d013112f11ee-data-volume\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:37.868845 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.868838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efd30219-18cc-478b-ac1e-d013112f11ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:37.969635 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.969546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/efd30219-18cc-478b-ac1e-d013112f11ee-data-volume\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:37.969635 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.969595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efd30219-18cc-478b-ac1e-d013112f11ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:37.969635 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.969619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxnv4\" (UniqueName: \"kubernetes.io/projected/efd30219-18cc-478b-ac1e-d013112f11ee-kube-api-access-wxnv4\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:37.969839 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.969668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:37.969839 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:37.969687 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 11:11:37.969839 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.969708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/efd30219-18cc-478b-ac1e-d013112f11ee-crio-socket\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:37.969839 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:37.969790 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efd30219-18cc-478b-ac1e-d013112f11ee-kube-rbac-proxy-cm podName:efd30219-18cc-478b-ac1e-d013112f11ee nodeName:}" failed. No retries permitted until 2026-07-07 11:11:38.469768255 +0000 UTC m=+42.946426195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/efd30219-18cc-478b-ac1e-d013112f11ee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dg7s8" (UID: "efd30219-18cc-478b-ac1e-d013112f11ee") : configmap "kube-rbac-proxy" not found Jul 07 11:11:37.969839 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:37.969805 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 11:11:37.970037 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:37.969871 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls podName:efd30219-18cc-478b-ac1e-d013112f11ee nodeName:}" failed. No retries permitted until 2026-07-07 11:11:38.469855333 +0000 UTC m=+42.946513285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dg7s8" (UID: "efd30219-18cc-478b-ac1e-d013112f11ee") : secret "insights-runtime-extractor-tls" not found Jul 07 11:11:37.970037 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.969914 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/efd30219-18cc-478b-ac1e-d013112f11ee-crio-socket\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:37.970037 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.969941 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/efd30219-18cc-478b-ac1e-d013112f11ee-data-volume\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:37.980448 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:37.980424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxnv4\" (UniqueName: \"kubernetes.io/projected/efd30219-18cc-478b-ac1e-d013112f11ee-kube-api-access-wxnv4\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:38.474469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:38.474434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:38.474855 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:38.474505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efd30219-18cc-478b-ac1e-d013112f11ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:38.474855 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:38.474593 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 11:11:38.474855 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:38.474598 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 11:11:38.474855 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:38.474661 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efd30219-18cc-478b-ac1e-d013112f11ee-kube-rbac-proxy-cm podName:efd30219-18cc-478b-ac1e-d013112f11ee nodeName:}" failed. No retries permitted until 2026-07-07 11:11:39.47464625 +0000 UTC m=+43.951304188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/efd30219-18cc-478b-ac1e-d013112f11ee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dg7s8" (UID: "efd30219-18cc-478b-ac1e-d013112f11ee") : configmap "kube-rbac-proxy" not found Jul 07 11:11:38.474855 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:38.474678 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls podName:efd30219-18cc-478b-ac1e-d013112f11ee nodeName:}" failed. No retries permitted until 2026-07-07 11:11:39.474671163 +0000 UTC m=+43.951329101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dg7s8" (UID: "efd30219-18cc-478b-ac1e-d013112f11ee") : secret "insights-runtime-extractor-tls" not found Jul 07 11:11:38.594912 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:38.594878 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-nkgjz"] Jul 07 11:11:38.625781 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:38.625744 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-nkgjz"] Jul 07 11:11:38.625964 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:38.625888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nkgjz" Jul 07 11:11:38.628973 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:38.628950 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 07 11:11:38.629092 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:38.628957 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 07 11:11:38.629872 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:38.629857 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-j6227\"" Jul 07 11:11:38.776985 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:38.776886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgvbq\" (UniqueName: \"kubernetes.io/projected/28eb1119-0a4f-4231-a052-47e23675bfe8-kube-api-access-pgvbq\") pod \"migrator-d57d58cc9-nkgjz\" (UID: \"28eb1119-0a4f-4231-a052-47e23675bfe8\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nkgjz" Jul 07 11:11:38.877672 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:38.877627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgvbq\" (UniqueName: \"kubernetes.io/projected/28eb1119-0a4f-4231-a052-47e23675bfe8-kube-api-access-pgvbq\") pod \"migrator-d57d58cc9-nkgjz\" (UID: \"28eb1119-0a4f-4231-a052-47e23675bfe8\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nkgjz" Jul 07 11:11:38.886157 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:38.886126 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgvbq\" (UniqueName: \"kubernetes.io/projected/28eb1119-0a4f-4231-a052-47e23675bfe8-kube-api-access-pgvbq\") pod \"migrator-d57d58cc9-nkgjz\" (UID: \"28eb1119-0a4f-4231-a052-47e23675bfe8\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nkgjz" Jul 07 11:11:38.935432 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:38.935376 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nkgjz" Jul 07 11:11:39.083637 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:39.083604 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-nkgjz"] Jul 07 11:11:39.087142 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:11:39.087118 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28eb1119_0a4f_4231_a052_47e23675bfe8.slice/crio-0efddca2406059568383973877cd3a158fa5a7c71f0da45b8168a17538b676be WatchSource:0}: Error finding container 0efddca2406059568383973877cd3a158fa5a7c71f0da45b8168a17538b676be: Status 404 returned error can't find the container with id 0efddca2406059568383973877cd3a158fa5a7c71f0da45b8168a17538b676be Jul 07 11:11:39.243558 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:39.243529 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-87rvw_7ad4910d-9603-4c7c-8955-6629120e2c70/dns-node-resolver/0.log" Jul 07 11:11:39.282908 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:39.282826 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nkgjz" event={"ID":"28eb1119-0a4f-4231-a052-47e23675bfe8","Type":"ContainerStarted","Data":"0efddca2406059568383973877cd3a158fa5a7c71f0da45b8168a17538b676be"} Jul 07 11:11:39.482463 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:39.482428 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efd30219-18cc-478b-ac1e-d013112f11ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:39.482808 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:39.482521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:39.482808 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:39.482534 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 11:11:39.482808 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:39.482597 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 11:11:39.482808 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:39.482623 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efd30219-18cc-478b-ac1e-d013112f11ee-kube-rbac-proxy-cm podName:efd30219-18cc-478b-ac1e-d013112f11ee nodeName:}" failed. No retries permitted until 2026-07-07 11:11:41.482609315 +0000 UTC m=+45.959267257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/efd30219-18cc-478b-ac1e-d013112f11ee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dg7s8" (UID: "efd30219-18cc-478b-ac1e-d013112f11ee") : configmap "kube-rbac-proxy" not found Jul 07 11:11:39.482808 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:39.482644 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls podName:efd30219-18cc-478b-ac1e-d013112f11ee nodeName:}" failed. No retries permitted until 2026-07-07 11:11:41.482631505 +0000 UTC m=+45.959289444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dg7s8" (UID: "efd30219-18cc-478b-ac1e-d013112f11ee") : secret "insights-runtime-extractor-tls" not found Jul 07 11:11:39.684011 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:39.683975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:39.684165 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:39.684095 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 11:11:39.684165 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:39.684106 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f74bdc6b8-4vpdz: secret "image-registry-tls" not found Jul 07 11:11:39.684165 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:39.684155 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls podName:83c82870-97ad-4c67-9d7e-16305d9f8d61 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:47.684141885 +0000 UTC m=+52.160799838 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls") pod "image-registry-6f74bdc6b8-4vpdz" (UID: "83c82870-97ad-4c67-9d7e-16305d9f8d61") : secret "image-registry-tls" not found Jul 07 11:11:39.785140 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:39.785087 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:39.785335 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:39.785222 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 11:11:39.785335 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:39.785283 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls podName:a8b7f788-470c-4494-9a49-491222a25879 nodeName:}" failed. No retries permitted until 2026-07-07 11:11:47.78526719 +0000 UTC m=+52.261925130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls") pod "dns-default-5h9rt" (UID: "a8b7f788-470c-4494-9a49-491222a25879") : secret "dns-default-metrics-tls" not found Jul 07 11:11:40.242866 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:40.242843 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-st4qc_3080673e-c2c6-416d-8f5f-dee0e93de1b5/node-ca/0.log" Jul 07 11:11:40.844792 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:40.844764 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5mnfm_d320459c-a431-4b6e-9ce6-8081cb31087b/serve-healthcheck-canary/0.log" Jul 07 11:11:41.292751 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.292721 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nkgjz" event={"ID":"28eb1119-0a4f-4231-a052-47e23675bfe8","Type":"ContainerStarted","Data":"68b60788c215fb9f5fe26f792c899b63bc52699c3d447faccbf5c079b79bad33"} Jul 07 11:11:41.292892 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.292798 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nkgjz" event={"ID":"28eb1119-0a4f-4231-a052-47e23675bfe8","Type":"ContainerStarted","Data":"53ff2e983c450d489792a6a238b7e44e8a2f89c258656cd6e63939b1fb182a90"} Jul 07 11:11:41.313253 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.313192 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nkgjz" podStartSLOduration=1.548869077 podStartE2EDuration="3.313180169s" totalImagesPullingTime="1.764311092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:11:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:11:41.312501139 +0000 UTC m=+45.789159099" watchObservedRunningTime="2026-07-07 11:11:41.313180169 +0000 UTC m=+45.789838169" Jul 07 11:11:41.424263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.424238 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-r8k49"] Jul 07 11:11:41.434351 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.434331 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-r8k49" Jul 07 11:11:41.437600 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.437570 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-r8k49"] Jul 07 11:11:41.437939 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.437916 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 07 11:11:41.438035 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.437952 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 07 11:11:41.438035 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.437977 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-r55ln\"" Jul 07 11:11:41.438035 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.437922 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 07 11:11:41.438171 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.438078 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 07 11:11:41.496423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.496382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efd30219-18cc-478b-ac1e-d013112f11ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:41.496580 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.496471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:41.496580 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:41.496523 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 11:11:41.496580 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:41.496567 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 11:11:41.496767 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:41.496600 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efd30219-18cc-478b-ac1e-d013112f11ee-kube-rbac-proxy-cm podName:efd30219-18cc-478b-ac1e-d013112f11ee nodeName:}" failed. No retries permitted until 2026-07-07 11:11:45.496579384 +0000 UTC m=+49.973237323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/efd30219-18cc-478b-ac1e-d013112f11ee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dg7s8" (UID: "efd30219-18cc-478b-ac1e-d013112f11ee") : configmap "kube-rbac-proxy" not found Jul 07 11:11:41.496767 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:41.496619 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls podName:efd30219-18cc-478b-ac1e-d013112f11ee nodeName:}" failed. No retries permitted until 2026-07-07 11:11:45.496609355 +0000 UTC m=+49.973267296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dg7s8" (UID: "efd30219-18cc-478b-ac1e-d013112f11ee") : secret "insights-runtime-extractor-tls" not found Jul 07 11:11:41.597750 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.597684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a6195024-2173-47c9-93ef-690ef251eed5-signing-cabundle\") pod \"service-ca-758f599c5-r8k49\" (UID: \"a6195024-2173-47c9-93ef-690ef251eed5\") " pod="openshift-service-ca/service-ca-758f599c5-r8k49" Jul 07 11:11:41.597895 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.597752 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv4zd\" (UniqueName: \"kubernetes.io/projected/a6195024-2173-47c9-93ef-690ef251eed5-kube-api-access-tv4zd\") pod \"service-ca-758f599c5-r8k49\" (UID: \"a6195024-2173-47c9-93ef-690ef251eed5\") " pod="openshift-service-ca/service-ca-758f599c5-r8k49" Jul 07 11:11:41.597895 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.597849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a6195024-2173-47c9-93ef-690ef251eed5-signing-key\") pod \"service-ca-758f599c5-r8k49\" (UID: \"a6195024-2173-47c9-93ef-690ef251eed5\") " pod="openshift-service-ca/service-ca-758f599c5-r8k49" Jul 07 11:11:41.698832 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.698805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a6195024-2173-47c9-93ef-690ef251eed5-signing-key\") pod \"service-ca-758f599c5-r8k49\" (UID: \"a6195024-2173-47c9-93ef-690ef251eed5\") " pod="openshift-service-ca/service-ca-758f599c5-r8k49" Jul 07 11:11:41.698945 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.698851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a6195024-2173-47c9-93ef-690ef251eed5-signing-cabundle\") pod \"service-ca-758f599c5-r8k49\" (UID: \"a6195024-2173-47c9-93ef-690ef251eed5\") " pod="openshift-service-ca/service-ca-758f599c5-r8k49" Jul 07 11:11:41.699050 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.699030 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv4zd\" (UniqueName: \"kubernetes.io/projected/a6195024-2173-47c9-93ef-690ef251eed5-kube-api-access-tv4zd\") pod \"service-ca-758f599c5-r8k49\" (UID: \"a6195024-2173-47c9-93ef-690ef251eed5\") " pod="openshift-service-ca/service-ca-758f599c5-r8k49" Jul 07 11:11:41.699562 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.699511 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a6195024-2173-47c9-93ef-690ef251eed5-signing-cabundle\") pod \"service-ca-758f599c5-r8k49\" (UID: \"a6195024-2173-47c9-93ef-690ef251eed5\") " pod="openshift-service-ca/service-ca-758f599c5-r8k49" Jul 07 11:11:41.701275 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.701253 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a6195024-2173-47c9-93ef-690ef251eed5-signing-key\") pod \"service-ca-758f599c5-r8k49\" (UID: \"a6195024-2173-47c9-93ef-690ef251eed5\") " pod="openshift-service-ca/service-ca-758f599c5-r8k49" Jul 07 11:11:41.708938 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.708916 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv4zd\" (UniqueName: \"kubernetes.io/projected/a6195024-2173-47c9-93ef-690ef251eed5-kube-api-access-tv4zd\") pod \"service-ca-758f599c5-r8k49\" (UID: \"a6195024-2173-47c9-93ef-690ef251eed5\") " pod="openshift-service-ca/service-ca-758f599c5-r8k49" Jul 07 11:11:41.743609 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.743589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-r8k49" Jul 07 11:11:41.887324 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:41.887259 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-r8k49"] Jul 07 11:11:41.892057 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:11:41.892028 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6195024_2173_47c9_93ef_690ef251eed5.slice/crio-8e915ae5e489a5d612b6db76fa497c6cf5964f5ba386efaa1ff4b814b144de6f WatchSource:0}: Error finding container 8e915ae5e489a5d612b6db76fa497c6cf5964f5ba386efaa1ff4b814b144de6f: Status 404 returned error can't find the container with id 8e915ae5e489a5d612b6db76fa497c6cf5964f5ba386efaa1ff4b814b144de6f Jul 07 11:11:42.295704 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:42.295673 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-r8k49" event={"ID":"a6195024-2173-47c9-93ef-690ef251eed5","Type":"ContainerStarted","Data":"8e915ae5e489a5d612b6db76fa497c6cf5964f5ba386efaa1ff4b814b144de6f"} Jul 07 11:11:45.304097 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:45.304013 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-r8k49" event={"ID":"a6195024-2173-47c9-93ef-690ef251eed5","Type":"ContainerStarted","Data":"7b4105b94fe77f996af16df562984151c0402ff97cdc1898776ceb1ef1d71dc5"} Jul 07 11:11:45.325248 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:45.325200 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-r8k49" podStartSLOduration=1.28762094 podStartE2EDuration="4.325184356s" totalImagesPullingTime="3.037563416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:11:45.324886372 +0000 UTC m=+49.801544332" watchObservedRunningTime="2026-07-07 11:11:45.325184356 +0000 UTC m=+49.801842317" Jul 07 11:11:45.529416 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:45.529369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:45.529606 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:45.529505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efd30219-18cc-478b-ac1e-d013112f11ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:45.529606 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:45.529527 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 11:11:45.529606 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:45.529593 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls podName:efd30219-18cc-478b-ac1e-d013112f11ee nodeName:}" failed. No retries permitted until 2026-07-07 11:11:53.529574994 +0000 UTC m=+58.006232953 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dg7s8" (UID: "efd30219-18cc-478b-ac1e-d013112f11ee") : secret "insights-runtime-extractor-tls" not found Jul 07 11:11:45.530081 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:45.530060 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efd30219-18cc-478b-ac1e-d013112f11ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:47.749790 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:47.749740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:11:47.750291 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:47.749884 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 11:11:47.750291 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:47.749905 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f74bdc6b8-4vpdz: secret "image-registry-tls" not found Jul 07 11:11:47.750291 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:47.749959 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls podName:83c82870-97ad-4c67-9d7e-16305d9f8d61 nodeName:}" failed. No retries permitted until 2026-07-07 11:12:03.749943804 +0000 UTC m=+68.226601747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls") pod "image-registry-6f74bdc6b8-4vpdz" (UID: "83c82870-97ad-4c67-9d7e-16305d9f8d61") : secret "image-registry-tls" not found Jul 07 11:11:47.851199 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:47.851157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:11:47.851495 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:47.851282 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 11:11:47.851495 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:11:47.851341 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls podName:a8b7f788-470c-4494-9a49-491222a25879 nodeName:}" failed. No retries permitted until 2026-07-07 11:12:03.85132447 +0000 UTC m=+68.327982410 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls") pod "dns-default-5h9rt" (UID: "a8b7f788-470c-4494-9a49-491222a25879") : secret "dns-default-metrics-tls" not found Jul 07 11:11:53.597696 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:53.597651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:53.600141 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:53.600116 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efd30219-18cc-478b-ac1e-d013112f11ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dg7s8\" (UID: \"efd30219-18cc-478b-ac1e-d013112f11ee\") " pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:53.899053 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:53.898948 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dg7s8" Jul 07 11:11:54.029147 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:54.029118 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dg7s8"] Jul 07 11:11:54.032407 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:11:54.032364 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefd30219_18cc_478b_ac1e_d013112f11ee.slice/crio-96f00f7e9a75cc0c8c2018086d6f1f7344e2d5262bc8c0b2e2b1f1aa3e15263e WatchSource:0}: Error finding container 96f00f7e9a75cc0c8c2018086d6f1f7344e2d5262bc8c0b2e2b1f1aa3e15263e: Status 404 returned error can't find the container with id 96f00f7e9a75cc0c8c2018086d6f1f7344e2d5262bc8c0b2e2b1f1aa3e15263e Jul 07 11:11:54.326881 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:54.326844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dg7s8" event={"ID":"efd30219-18cc-478b-ac1e-d013112f11ee","Type":"ContainerStarted","Data":"96f00f7e9a75cc0c8c2018086d6f1f7344e2d5262bc8c0b2e2b1f1aa3e15263e"} Jul 07 11:11:57.255193 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:57.255167 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lcsfq" Jul 07 11:11:58.340306 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:58.340268 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dg7s8" event={"ID":"efd30219-18cc-478b-ac1e-d013112f11ee","Type":"ContainerStarted","Data":"e78cc3f22d4e52067ac33b3f9b5e06c7bf53155ee275e798faf29d09353dd425"} Jul 07 11:11:59.345903 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:11:59.345859 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dg7s8" event={"ID":"efd30219-18cc-478b-ac1e-d013112f11ee","Type":"ContainerStarted","Data":"3b69fba2c6b7b23da0df3c2d03c6d12d5c8b3e0551fb351239331def2cb2d298"} Jul 07 11:12:00.851739 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:00.851696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs\") pod \"network-metrics-daemon-tz22d\" (UID: \"443056e3-d655-409e-b8b2-040cd2adf8f6\") " pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:12:00.852190 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:00.851790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:12:00.854964 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:00.854941 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 11:12:00.855140 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:00.855122 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 11:12:00.865703 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:00.865677 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/443056e3-d655-409e-b8b2-040cd2adf8f6-metrics-certs\") pod \"network-metrics-daemon-tz22d\" (UID: \"443056e3-d655-409e-b8b2-040cd2adf8f6\") " pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:12:00.865791 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:00.865772 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9106972d-25a4-4ca7-b58b-72e4af5cbef9-original-pull-secret\") pod \"global-pull-secret-syncer-9ntcg\" (UID: \"9106972d-25a4-4ca7-b58b-72e4af5cbef9\") " pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:12:00.952459 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:00.952423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4mwx\" (UniqueName: \"kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx\") pod \"network-check-target-s4jm7\" (UID: \"1ddca397-3766-4e52-972e-bc7c6fc375a7\") " pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:12:00.955877 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:00.955851 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 11:12:00.958550 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:00.958528 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9ntcg" Jul 07 11:12:00.966646 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:00.966626 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 11:12:00.977657 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:00.977638 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4mwx\" (UniqueName: \"kubernetes.io/projected/1ddca397-3766-4e52-972e-bc7c6fc375a7-kube-api-access-j4mwx\") pod \"network-check-target-s4jm7\" (UID: \"1ddca397-3766-4e52-972e-bc7c6fc375a7\") " pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:12:01.164528 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:01.164490 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7b27w\"" Jul 07 11:12:01.169590 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:01.169566 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cn2cx\"" Jul 07 11:12:01.171836 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:01.171816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz22d" Jul 07 11:12:01.176598 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:01.176579 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:12:01.425226 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:01.425203 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9ntcg"] Jul 07 11:12:01.427566 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:12:01.427534 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9106972d_25a4_4ca7_b58b_72e4af5cbef9.slice/crio-becc516bffb4c1cbab3fc5fba10a2922326a4f39ea1b969906dbcf4229532dee WatchSource:0}: Error finding container becc516bffb4c1cbab3fc5fba10a2922326a4f39ea1b969906dbcf4229532dee: Status 404 returned error can't find the container with id becc516bffb4c1cbab3fc5fba10a2922326a4f39ea1b969906dbcf4229532dee Jul 07 11:12:01.647729 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:01.647700 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tz22d"] Jul 07 11:12:01.651000 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:12:01.650964 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod443056e3_d655_409e_b8b2_040cd2adf8f6.slice/crio-10c352cefe15f847f54e75591f39222d5877cb0a24f83559e49e329a9c2cf808 WatchSource:0}: Error finding container 10c352cefe15f847f54e75591f39222d5877cb0a24f83559e49e329a9c2cf808: Status 404 returned error can't find the container with id 10c352cefe15f847f54e75591f39222d5877cb0a24f83559e49e329a9c2cf808 Jul 07 11:12:01.651390 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:01.651370 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s4jm7"] Jul 07 11:12:01.654358 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:12:01.654338 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ddca397_3766_4e52_972e_bc7c6fc375a7.slice/crio-84902561e85d393f1e41ee87e0078bf1de4d1d2dd8c26f874fa00f0b20f982d9 WatchSource:0}: Error finding container 84902561e85d393f1e41ee87e0078bf1de4d1d2dd8c26f874fa00f0b20f982d9: Status 404 returned error can't find the container with id 84902561e85d393f1e41ee87e0078bf1de4d1d2dd8c26f874fa00f0b20f982d9 Jul 07 11:12:02.366598 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:02.366550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dg7s8" event={"ID":"efd30219-18cc-478b-ac1e-d013112f11ee","Type":"ContainerStarted","Data":"96c775263d922e155f974b82bc89004b069f7ac1be91d5403cced6f64412e69e"} Jul 07 11:12:02.370445 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:02.370388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s4jm7" event={"ID":"1ddca397-3766-4e52-972e-bc7c6fc375a7","Type":"ContainerStarted","Data":"84902561e85d393f1e41ee87e0078bf1de4d1d2dd8c26f874fa00f0b20f982d9"} Jul 07 11:12:02.374223 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:02.374156 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9ntcg" event={"ID":"9106972d-25a4-4ca7-b58b-72e4af5cbef9","Type":"ContainerStarted","Data":"becc516bffb4c1cbab3fc5fba10a2922326a4f39ea1b969906dbcf4229532dee"} Jul 07 11:12:02.377002 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:02.376946 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tz22d" event={"ID":"443056e3-d655-409e-b8b2-040cd2adf8f6","Type":"ContainerStarted","Data":"10c352cefe15f847f54e75591f39222d5877cb0a24f83559e49e329a9c2cf808"} Jul 07 11:12:02.391681 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:02.391627 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dg7s8" podStartSLOduration=18.295168564 podStartE2EDuration="25.391607422s" totalImagesPullingTime="7.096438858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:11:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:12:02.390811234 +0000 UTC m=+66.867469195" watchObservedRunningTime="2026-07-07 11:12:02.391607422 +0000 UTC m=+66.868265365" Jul 07 11:12:03.383054 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.383005 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tz22d" event={"ID":"443056e3-d655-409e-b8b2-040cd2adf8f6","Type":"ContainerStarted","Data":"c967c819759a52758c6e0978749db1bbfc92f28c2e3c250b4a252b9ada8cf626"} Jul 07 11:12:03.383512 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.383088 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tz22d" event={"ID":"443056e3-d655-409e-b8b2-040cd2adf8f6","Type":"ContainerStarted","Data":"fcdc46b434567f5ae06a63b2fb9b47e069af57371e0f23e65468f1a90f76c2ce"} Jul 07 11:12:03.401756 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.401707 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tz22d" podStartSLOduration=66.283284166 podStartE2EDuration="1m7.401690965s" totalImagesPullingTime="1.118406799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:12:03.400719176 +0000 UTC m=+67.877377138" watchObservedRunningTime="2026-07-07 11:12:03.401690965 +0000 UTC m=+67.878348926" Jul 07 11:12:03.775825 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.775785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:12:03.779224 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.779198 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls\") pod \"image-registry-6f74bdc6b8-4vpdz\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:12:03.876619 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.876580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:12:03.879635 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.879608 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b7f788-470c-4494-9a49-491222a25879-metrics-tls\") pod \"dns-default-5h9rt\" (UID: \"a8b7f788-470c-4494-9a49-491222a25879\") " pod="openshift-dns/dns-default-5h9rt" Jul 07 11:12:03.940848 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.940810 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p"] Jul 07 11:12:03.945221 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.945200 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" Jul 07 11:12:03.948029 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.948006 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 11:12:03.948375 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.948319 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 11:12:03.949470 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.949451 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 11:12:03.949591 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.949459 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 11:12:03.954741 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.954719 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5"] Jul 07 11:12:03.958790 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.958768 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p"] Jul 07 11:12:03.958909 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.958876 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5" Jul 07 11:12:03.962213 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.961818 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f74bdc6b8-4vpdz"] Jul 07 11:12:03.962213 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.961943 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wcsll\"" Jul 07 11:12:03.962213 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.962208 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 07 11:12:03.969587 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.969555 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hg565\"" Jul 07 11:12:03.970749 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.970728 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5"] Jul 07 11:12:03.972372 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.972175 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:12:03.977139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.977116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j67jl\" (UniqueName: \"kubernetes.io/projected/dd22e1e0-ce7c-460e-8094-b1a1fcf6a538-kube-api-access-j67jl\") pod \"klusterlet-addon-workmgr-d88d8d947-5jk8p\" (UID: \"dd22e1e0-ce7c-460e-8094-b1a1fcf6a538\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" Jul 07 11:12:03.977243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.977171 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dd22e1e0-ce7c-460e-8094-b1a1fcf6a538-klusterlet-config\") pod \"klusterlet-addon-workmgr-d88d8d947-5jk8p\" (UID: \"dd22e1e0-ce7c-460e-8094-b1a1fcf6a538\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" Jul 07 11:12:03.977243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:03.977204 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd22e1e0-ce7c-460e-8094-b1a1fcf6a538-tmp\") pod \"klusterlet-addon-workmgr-d88d8d947-5jk8p\" (UID: \"dd22e1e0-ce7c-460e-8094-b1a1fcf6a538\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" Jul 07 11:12:04.063708 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.063619 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2gjl2\"" Jul 07 11:12:04.071217 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.071184 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5h9rt" Jul 07 11:12:04.076551 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.076528 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-568b5bc9b4-n8hcv"] Jul 07 11:12:04.077934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.077857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j67jl\" (UniqueName: \"kubernetes.io/projected/dd22e1e0-ce7c-460e-8094-b1a1fcf6a538-kube-api-access-j67jl\") pod \"klusterlet-addon-workmgr-d88d8d947-5jk8p\" (UID: \"dd22e1e0-ce7c-460e-8094-b1a1fcf6a538\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" Jul 07 11:12:04.077934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.077893 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ac3ba76-2d60-48f4-9f82-c4d4549c8da6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5\" (UID: \"0ac3ba76-2d60-48f4-9f82-c4d4549c8da6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5" Jul 07 11:12:04.077934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.077921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dd22e1e0-ce7c-460e-8094-b1a1fcf6a538-klusterlet-config\") pod \"klusterlet-addon-workmgr-d88d8d947-5jk8p\" (UID: \"dd22e1e0-ce7c-460e-8094-b1a1fcf6a538\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" Jul 07 11:12:04.078327 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.077948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd22e1e0-ce7c-460e-8094-b1a1fcf6a538-tmp\") pod \"klusterlet-addon-workmgr-d88d8d947-5jk8p\" (UID: \"dd22e1e0-ce7c-460e-8094-b1a1fcf6a538\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" Jul 07 11:12:04.078327 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.078002 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rvmb\" (UniqueName: \"kubernetes.io/projected/0ac3ba76-2d60-48f4-9f82-c4d4549c8da6-kube-api-access-6rvmb\") pod \"managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5\" (UID: \"0ac3ba76-2d60-48f4-9f82-c4d4549c8da6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5" Jul 07 11:12:04.078512 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.078489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd22e1e0-ce7c-460e-8094-b1a1fcf6a538-tmp\") pod \"klusterlet-addon-workmgr-d88d8d947-5jk8p\" (UID: \"dd22e1e0-ce7c-460e-8094-b1a1fcf6a538\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" Jul 07 11:12:04.081192 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.081169 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dd22e1e0-ce7c-460e-8094-b1a1fcf6a538-klusterlet-config\") pod \"klusterlet-addon-workmgr-d88d8d947-5jk8p\" (UID: \"dd22e1e0-ce7c-460e-8094-b1a1fcf6a538\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" Jul 07 11:12:04.083912 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.083896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.096529 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.096432 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j67jl\" (UniqueName: \"kubernetes.io/projected/dd22e1e0-ce7c-460e-8094-b1a1fcf6a538-kube-api-access-j67jl\") pod \"klusterlet-addon-workmgr-d88d8d947-5jk8p\" (UID: \"dd22e1e0-ce7c-460e-8094-b1a1fcf6a538\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" Jul 07 11:12:04.109702 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.109671 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-568b5bc9b4-n8hcv"] Jul 07 11:12:04.179120 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.179085 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/adde301b-7bda-4097-9ee5-69bbfda2aefe-installation-pull-secrets\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.179120 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.179126 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/adde301b-7bda-4097-9ee5-69bbfda2aefe-trusted-ca\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.179360 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.179154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/adde301b-7bda-4097-9ee5-69bbfda2aefe-registry-tls\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.179360 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.179225 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adde301b-7bda-4097-9ee5-69bbfda2aefe-bound-sa-token\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.179360 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.179254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/adde301b-7bda-4097-9ee5-69bbfda2aefe-image-registry-private-configuration\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.179360 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.179284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/adde301b-7bda-4097-9ee5-69bbfda2aefe-registry-certificates\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.179360 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.179314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rvmb\" (UniqueName: \"kubernetes.io/projected/0ac3ba76-2d60-48f4-9f82-c4d4549c8da6-kube-api-access-6rvmb\") pod \"managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5\" (UID: \"0ac3ba76-2d60-48f4-9f82-c4d4549c8da6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5" Jul 07 11:12:04.179628 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.179368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/adde301b-7bda-4097-9ee5-69bbfda2aefe-ca-trust-extracted\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.179628 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.179424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wvn9\" (UniqueName: \"kubernetes.io/projected/adde301b-7bda-4097-9ee5-69bbfda2aefe-kube-api-access-4wvn9\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.179628 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.179459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ac3ba76-2d60-48f4-9f82-c4d4549c8da6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5\" (UID: \"0ac3ba76-2d60-48f4-9f82-c4d4549c8da6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5" Jul 07 11:12:04.183034 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.183000 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ac3ba76-2d60-48f4-9f82-c4d4549c8da6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5\" (UID: \"0ac3ba76-2d60-48f4-9f82-c4d4549c8da6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5" Jul 07 11:12:04.189728 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.189697 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rvmb\" (UniqueName: \"kubernetes.io/projected/0ac3ba76-2d60-48f4-9f82-c4d4549c8da6-kube-api-access-6rvmb\") pod \"managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5\" (UID: \"0ac3ba76-2d60-48f4-9f82-c4d4549c8da6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5" Jul 07 11:12:04.258023 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.257986 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" Jul 07 11:12:04.280607 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.280575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5" Jul 07 11:12:04.280815 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.280784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adde301b-7bda-4097-9ee5-69bbfda2aefe-bound-sa-token\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.280927 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.280830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/adde301b-7bda-4097-9ee5-69bbfda2aefe-image-registry-private-configuration\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.280927 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.280875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/adde301b-7bda-4097-9ee5-69bbfda2aefe-registry-certificates\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.280927 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.280909 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/adde301b-7bda-4097-9ee5-69bbfda2aefe-ca-trust-extracted\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.281034 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.280929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wvn9\" (UniqueName: \"kubernetes.io/projected/adde301b-7bda-4097-9ee5-69bbfda2aefe-kube-api-access-4wvn9\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.281034 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.280957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/adde301b-7bda-4097-9ee5-69bbfda2aefe-installation-pull-secrets\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.281034 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.280975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/adde301b-7bda-4097-9ee5-69bbfda2aefe-trusted-ca\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.281034 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.280992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/adde301b-7bda-4097-9ee5-69bbfda2aefe-registry-tls\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.281472 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.281448 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/adde301b-7bda-4097-9ee5-69bbfda2aefe-ca-trust-extracted\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.282262 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.282238 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/adde301b-7bda-4097-9ee5-69bbfda2aefe-registry-certificates\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.282692 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.282676 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/adde301b-7bda-4097-9ee5-69bbfda2aefe-trusted-ca\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.283874 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.283852 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/adde301b-7bda-4097-9ee5-69bbfda2aefe-installation-pull-secrets\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.284301 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.284274 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/adde301b-7bda-4097-9ee5-69bbfda2aefe-registry-tls\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.284737 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.284689 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/adde301b-7bda-4097-9ee5-69bbfda2aefe-image-registry-private-configuration\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.296289 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.296266 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adde301b-7bda-4097-9ee5-69bbfda2aefe-bound-sa-token\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.296642 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.296610 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wvn9\" (UniqueName: \"kubernetes.io/projected/adde301b-7bda-4097-9ee5-69bbfda2aefe-kube-api-access-4wvn9\") pod \"image-registry-568b5bc9b4-n8hcv\" (UID: \"adde301b-7bda-4097-9ee5-69bbfda2aefe\") " pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:04.405694 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:04.405607 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:06.587316 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:06.586689 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5h9rt"] Jul 07 11:12:06.590306 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:12:06.590240 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b7f788_470c_4494_9a49_491222a25879.slice/crio-ed6557e4fb37ada9eea6331f192f2dd7cb9590bf1b758e98769c795847bf34ba WatchSource:0}: Error finding container ed6557e4fb37ada9eea6331f192f2dd7cb9590bf1b758e98769c795847bf34ba: Status 404 returned error can't find the container with id ed6557e4fb37ada9eea6331f192f2dd7cb9590bf1b758e98769c795847bf34ba Jul 07 11:12:06.647110 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:06.647076 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p"] Jul 07 11:12:06.650285 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:12:06.650258 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd22e1e0_ce7c_460e_8094_b1a1fcf6a538.slice/crio-cbb40d4900d1dc79e1884f159938dd7aadffb77e67cdf4650a8734a20c2e6e28 WatchSource:0}: Error finding container cbb40d4900d1dc79e1884f159938dd7aadffb77e67cdf4650a8734a20c2e6e28: Status 404 returned error can't find the container with id cbb40d4900d1dc79e1884f159938dd7aadffb77e67cdf4650a8734a20c2e6e28 Jul 07 11:12:06.809935 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:06.809900 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5"] Jul 07 11:12:06.813678 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:06.813649 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f74bdc6b8-4vpdz"] Jul 07 11:12:06.814522 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:12:06.814495 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ac3ba76_2d60_48f4_9f82_c4d4549c8da6.slice/crio-5df6a91f16cb3dc0430a0901508175d69a65b172d4858164088363956bf398f3 WatchSource:0}: Error finding container 5df6a91f16cb3dc0430a0901508175d69a65b172d4858164088363956bf398f3: Status 404 returned error can't find the container with id 5df6a91f16cb3dc0430a0901508175d69a65b172d4858164088363956bf398f3 Jul 07 11:12:06.814593 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:06.814580 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-568b5bc9b4-n8hcv"] Jul 07 11:12:06.816950 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:12:06.816926 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83c82870_97ad_4c67_9d7e_16305d9f8d61.slice/crio-6dd589ff90d416f15e213523091240437bed1798a21980bd1017067314d2db97 WatchSource:0}: Error finding container 6dd589ff90d416f15e213523091240437bed1798a21980bd1017067314d2db97: Status 404 returned error can't find the container with id 6dd589ff90d416f15e213523091240437bed1798a21980bd1017067314d2db97 Jul 07 11:12:06.817578 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:12:06.817559 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadde301b_7bda_4097_9ee5_69bbfda2aefe.slice/crio-f4605e23639666017a0b2e452a028c9c6a5345307a918fa082179b42d9daa7cf WatchSource:0}: Error finding container f4605e23639666017a0b2e452a028c9c6a5345307a918fa082179b42d9daa7cf: Status 404 returned error can't find the container with id f4605e23639666017a0b2e452a028c9c6a5345307a918fa082179b42d9daa7cf Jul 07 11:12:07.335666 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.335626 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fpp8s"] Jul 07 11:12:07.339356 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.339332 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fpp8s" Jul 07 11:12:07.342477 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.342453 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 07 11:12:07.342592 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.342493 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sqm6z\"" Jul 07 11:12:07.349205 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.349182 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fpp8s"] Jul 07 11:12:07.405145 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.405053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed391f3a-9f7b-44c0-bd4f-a6362de9d7ce-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fpp8s\" (UID: \"ed391f3a-9f7b-44c0-bd4f-a6362de9d7ce\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fpp8s" Jul 07 11:12:07.407090 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.407061 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" event={"ID":"dd22e1e0-ce7c-460e-8094-b1a1fcf6a538","Type":"ContainerStarted","Data":"cbb40d4900d1dc79e1884f159938dd7aadffb77e67cdf4650a8734a20c2e6e28"} Jul 07 11:12:07.409102 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.409073 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5h9rt" event={"ID":"a8b7f788-470c-4494-9a49-491222a25879","Type":"ContainerStarted","Data":"ed6557e4fb37ada9eea6331f192f2dd7cb9590bf1b758e98769c795847bf34ba"} Jul 07 11:12:07.410857 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.410775 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" event={"ID":"adde301b-7bda-4097-9ee5-69bbfda2aefe","Type":"ContainerStarted","Data":"70455e6ba0afdfc1802664b6b3e0e735a7260c05b0c91bc7cb9f5aa8813ef9f3"} Jul 07 11:12:07.410857 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.410825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" event={"ID":"adde301b-7bda-4097-9ee5-69bbfda2aefe","Type":"ContainerStarted","Data":"f4605e23639666017a0b2e452a028c9c6a5345307a918fa082179b42d9daa7cf"} Jul 07 11:12:07.411022 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.410880 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:07.413034 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.413011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s4jm7" event={"ID":"1ddca397-3766-4e52-972e-bc7c6fc375a7","Type":"ContainerStarted","Data":"ec9f1fdf954abb858228c2f49b2d8d52ad14f4cd417eef7932dabfc68c5e5299"} Jul 07 11:12:07.413157 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.413138 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:12:07.414704 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.414657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9ntcg" event={"ID":"9106972d-25a4-4ca7-b58b-72e4af5cbef9","Type":"ContainerStarted","Data":"b498bb945c148e3cb2cba7157408bc149db83763461cca7b039825729eae812c"} Jul 07 11:12:07.415964 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.415942 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5" event={"ID":"0ac3ba76-2d60-48f4-9f82-c4d4549c8da6","Type":"ContainerStarted","Data":"5df6a91f16cb3dc0430a0901508175d69a65b172d4858164088363956bf398f3"} Jul 07 11:12:07.417541 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.417518 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" event={"ID":"83c82870-97ad-4c67-9d7e-16305d9f8d61","Type":"ContainerStarted","Data":"e4310783b95d50194dd96e7b8b9c17d5c6e4a197a890bca843a951bc766bffc7"} Jul 07 11:12:07.417642 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.417558 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" event={"ID":"83c82870-97ad-4c67-9d7e-16305d9f8d61","Type":"ContainerStarted","Data":"6dd589ff90d416f15e213523091240437bed1798a21980bd1017067314d2db97"} Jul 07 11:12:07.417706 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.417675 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:12:07.436323 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.436278 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" podStartSLOduration=3.436262729 podStartE2EDuration="3.436262729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:12:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:12:07.434789431 +0000 UTC m=+71.911447392" watchObservedRunningTime="2026-07-07 11:12:07.436262729 +0000 UTC m=+71.912920694" Jul 07 11:12:07.458804 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.458749 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s4jm7" podStartSLOduration=66.750079448 podStartE2EDuration="1m11.45873494s" totalImagesPullingTime="4.708655492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:12:07.457326786 +0000 UTC m=+71.933984759" watchObservedRunningTime="2026-07-07 11:12:07.45873494 +0000 UTC m=+71.935392901" Jul 07 11:12:07.481349 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.481288 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" podStartSLOduration=39.481265762 podStartE2EDuration="39.481265762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:11:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:12:07.47999697 +0000 UTC m=+71.956654932" watchObservedRunningTime="2026-07-07 11:12:07.481265762 +0000 UTC m=+71.957923719" Jul 07 11:12:07.496378 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.496324 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9ntcg" podStartSLOduration=66.575502051 podStartE2EDuration="1m11.496308876s" totalImagesPullingTime="4.920806825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:12:07.496193026 +0000 UTC m=+71.972850987" watchObservedRunningTime="2026-07-07 11:12:07.496308876 +0000 UTC m=+71.972966836" Jul 07 11:12:07.505884 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.505840 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed391f3a-9f7b-44c0-bd4f-a6362de9d7ce-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fpp8s\" (UID: \"ed391f3a-9f7b-44c0-bd4f-a6362de9d7ce\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fpp8s" Jul 07 11:12:07.509015 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.508988 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed391f3a-9f7b-44c0-bd4f-a6362de9d7ce-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fpp8s\" (UID: \"ed391f3a-9f7b-44c0-bd4f-a6362de9d7ce\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fpp8s" Jul 07 11:12:07.658243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.658160 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fpp8s" Jul 07 11:12:07.818426 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:07.817387 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fpp8s"] Jul 07 11:12:07.822477 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:12:07.822442 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded391f3a_9f7b_44c0_bd4f_a6362de9d7ce.slice/crio-f3b5a1cba4aa07f463ccf76712f8c2b73a9af4dd09d297800acb29ae5529edff WatchSource:0}: Error finding container f3b5a1cba4aa07f463ccf76712f8c2b73a9af4dd09d297800acb29ae5529edff: Status 404 returned error can't find the container with id f3b5a1cba4aa07f463ccf76712f8c2b73a9af4dd09d297800acb29ae5529edff Jul 07 11:12:08.424589 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:08.424525 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fpp8s" event={"ID":"ed391f3a-9f7b-44c0-bd4f-a6362de9d7ce","Type":"ContainerStarted","Data":"f3b5a1cba4aa07f463ccf76712f8c2b73a9af4dd09d297800acb29ae5529edff"} Jul 07 11:12:10.434776 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:10.434734 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5h9rt" event={"ID":"a8b7f788-470c-4494-9a49-491222a25879","Type":"ContainerStarted","Data":"d33ea5e6252976c3643efa63c5f91d08d6e5b4d73d111e503be22bb181c0459a"} Jul 07 11:12:10.435224 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:10.434807 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5h9rt" Jul 07 11:12:10.435224 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:10.434834 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5h9rt" event={"ID":"a8b7f788-470c-4494-9a49-491222a25879","Type":"ContainerStarted","Data":"4639d362fcd63571c8d2055aa56db22794f3b6ad7b44c34a3b61125f9428ddbe"} Jul 07 11:12:10.436598 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:10.436565 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5" event={"ID":"0ac3ba76-2d60-48f4-9f82-c4d4549c8da6","Type":"ContainerStarted","Data":"580009cdebda56ed56ab7bcc5068397bd200b0413b1fbdfac550261a76964ddf"} Jul 07 11:12:10.438142 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:10.438116 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fpp8s" event={"ID":"ed391f3a-9f7b-44c0-bd4f-a6362de9d7ce","Type":"ContainerStarted","Data":"89d328f0f216971dc53ce85c4c22800f4147a354812a0af6f9b2d8ec7a24c809"} Jul 07 11:12:10.438353 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:10.438332 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fpp8s" Jul 07 11:12:10.445166 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:10.445120 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fpp8s" Jul 07 11:12:10.455656 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:10.455610 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5h9rt" podStartSLOduration=36.140192948 podStartE2EDuration="39.455594609s" totalImagesPullingTime="3.315401661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:12:10.455068048 +0000 UTC m=+74.931726021" watchObservedRunningTime="2026-07-07 11:12:10.455594609 +0000 UTC m=+74.932252589" Jul 07 11:12:10.475520 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:10.475451 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9dd5cd8dd-flsv5" podStartSLOduration=4.378377953 podStartE2EDuration="7.475428435s" totalImagesPullingTime="3.097050482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:12:10.474540659 +0000 UTC m=+74.951198621" watchObservedRunningTime="2026-07-07 11:12:10.475428435 +0000 UTC m=+74.952086400" Jul 07 11:12:10.499410 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:10.499335 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fpp8s" podStartSLOduration=1.413558039 podStartE2EDuration="3.499314055s" totalImagesPullingTime="2.085756016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:12:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:12:10.497340791 +0000 UTC m=+74.973998751" watchObservedRunningTime="2026-07-07 11:12:10.499314055 +0000 UTC m=+74.975972017" Jul 07 11:12:13.450418 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:13.450368 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" event={"ID":"dd22e1e0-ce7c-460e-8094-b1a1fcf6a538","Type":"ContainerStarted","Data":"28967ec299b36d3fd3c1afdeabb8048a3012e3cb612e33128337d5491e7470ed"} Jul 07 11:12:13.450865 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:13.450576 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" Jul 07 11:12:13.452297 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:13.452279 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" Jul 07 11:12:13.467684 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:13.467644 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d88d8d947-5jk8p" podStartSLOduration=4.348879229 podStartE2EDuration="10.467631608s" totalImagesPullingTime="6.118752379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:12:13.466689713 +0000 UTC m=+77.943347700" watchObservedRunningTime="2026-07-07 11:12:13.467631608 +0000 UTC m=+77.944289569" Jul 07 11:12:18.772270 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.772149 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cz8b2"] Jul 07 11:12:18.778620 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.778591 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.782763 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.782736 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 11:12:18.783033 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.783006 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 11:12:18.783155 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.783137 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 11:12:18.783931 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.783909 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 11:12:18.784057 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.784008 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-666wg\"" Jul 07 11:12:18.784270 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.784254 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 11:12:18.784427 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.784254 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 11:12:18.892738 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.892690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac1c0d5f-479c-4324-96e3-adc87401fe4b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.892934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.892751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac1c0d5f-479c-4324-96e3-adc87401fe4b-sys\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.892934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.892779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac1c0d5f-479c-4324-96e3-adc87401fe4b-root\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.892934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.892809 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac1c0d5f-479c-4324-96e3-adc87401fe4b-node-exporter-textfile\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.892934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.892837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac1c0d5f-479c-4324-96e3-adc87401fe4b-node-exporter-accelerators-collector-config\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.892934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.892886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac1c0d5f-479c-4324-96e3-adc87401fe4b-node-exporter-wtmp\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.892934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.892909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac1c0d5f-479c-4324-96e3-adc87401fe4b-node-exporter-tls\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.892934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.892934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcfd2\" (UniqueName: \"kubernetes.io/projected/ac1c0d5f-479c-4324-96e3-adc87401fe4b-kube-api-access-mcfd2\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.893280 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.892967 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac1c0d5f-479c-4324-96e3-adc87401fe4b-metrics-client-ca\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.994073 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.994037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac1c0d5f-479c-4324-96e3-adc87401fe4b-sys\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.994263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.994086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac1c0d5f-479c-4324-96e3-adc87401fe4b-root\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.994263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.994121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac1c0d5f-479c-4324-96e3-adc87401fe4b-node-exporter-textfile\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.994263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.994148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac1c0d5f-479c-4324-96e3-adc87401fe4b-node-exporter-accelerators-collector-config\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.994263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.994155 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac1c0d5f-479c-4324-96e3-adc87401fe4b-sys\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.994263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.994245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac1c0d5f-479c-4324-96e3-adc87401fe4b-node-exporter-wtmp\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.994533 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.994273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac1c0d5f-479c-4324-96e3-adc87401fe4b-node-exporter-tls\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.994533 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.994320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcfd2\" (UniqueName: \"kubernetes.io/projected/ac1c0d5f-479c-4324-96e3-adc87401fe4b-kube-api-access-mcfd2\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.994533 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.994364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac1c0d5f-479c-4324-96e3-adc87401fe4b-metrics-client-ca\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.994533 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.994447 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac1c0d5f-479c-4324-96e3-adc87401fe4b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.994891 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.994862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac1c0d5f-479c-4324-96e3-adc87401fe4b-root\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.994977 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.994961 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac1c0d5f-479c-4324-96e3-adc87401fe4b-node-exporter-accelerators-collector-config\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.996006 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.995090 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac1c0d5f-479c-4324-96e3-adc87401fe4b-node-exporter-textfile\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.996006 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.995218 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac1c0d5f-479c-4324-96e3-adc87401fe4b-node-exporter-wtmp\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.996006 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.995967 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac1c0d5f-479c-4324-96e3-adc87401fe4b-metrics-client-ca\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.998776 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.998753 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac1c0d5f-479c-4324-96e3-adc87401fe4b-node-exporter-tls\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:18.999144 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:18.999122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac1c0d5f-479c-4324-96e3-adc87401fe4b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:19.004216 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:19.003976 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcfd2\" (UniqueName: \"kubernetes.io/projected/ac1c0d5f-479c-4324-96e3-adc87401fe4b-kube-api-access-mcfd2\") pod \"node-exporter-cz8b2\" (UID: \"ac1c0d5f-479c-4324-96e3-adc87401fe4b\") " pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:19.090386 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:19.090295 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cz8b2" Jul 07 11:12:19.103744 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:12:19.103717 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac1c0d5f_479c_4324_96e3_adc87401fe4b.slice/crio-097c8e98d56b9a08f639e85fb039d24a68e33a330e6005b0154dcb235dd16928 WatchSource:0}: Error finding container 097c8e98d56b9a08f639e85fb039d24a68e33a330e6005b0154dcb235dd16928: Status 404 returned error can't find the container with id 097c8e98d56b9a08f639e85fb039d24a68e33a330e6005b0154dcb235dd16928 Jul 07 11:12:19.473136 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:19.473102 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cz8b2" event={"ID":"ac1c0d5f-479c-4324-96e3-adc87401fe4b","Type":"ContainerStarted","Data":"097c8e98d56b9a08f639e85fb039d24a68e33a330e6005b0154dcb235dd16928"} Jul 07 11:12:20.443862 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:20.443835 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5h9rt" Jul 07 11:12:20.479095 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:20.479058 2576 generic.go:356] "Generic (PLEG): container finished" podID="ac1c0d5f-479c-4324-96e3-adc87401fe4b" containerID="85d63c514585a667c36755281b23430a5a83d2932c7fa0fe907ad1be69f68a06" exitCode=0 Jul 07 11:12:20.479259 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:20.479127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cz8b2" event={"ID":"ac1c0d5f-479c-4324-96e3-adc87401fe4b","Type":"ContainerDied","Data":"85d63c514585a667c36755281b23430a5a83d2932c7fa0fe907ad1be69f68a06"} Jul 07 11:12:21.485041 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:21.485002 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cz8b2" event={"ID":"ac1c0d5f-479c-4324-96e3-adc87401fe4b","Type":"ContainerStarted","Data":"9bc1d4945d0026772b74c9520a8478ceaa729bbd08b2aa5bc7d3a90ed2d7f2bc"} Jul 07 11:12:21.485437 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:21.485060 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cz8b2" event={"ID":"ac1c0d5f-479c-4324-96e3-adc87401fe4b","Type":"ContainerStarted","Data":"956c12a051bb855b896e39d6eaea1e9dd5f10157572b0c30f60b0c35c9180ab0"} Jul 07 11:12:27.423623 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:27.423588 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:12:27.458723 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:27.458674 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cz8b2" podStartSLOduration=8.494183059 podStartE2EDuration="9.458658019s" totalImagesPullingTime="889.251517ms" totalInitContainerRuntime="75.223443ms" isStatefulPod=true podCreationTimestamp="2026-07-07 11:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:12:21.507895699 +0000 UTC m=+85.984553659" watchObservedRunningTime="2026-07-07 11:12:27.458658019 +0000 UTC m=+91.935315979" Jul 07 11:12:28.429274 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:28.429236 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-568b5bc9b4-n8hcv" Jul 07 11:12:32.442105 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.442038 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" podUID="83c82870-97ad-4c67-9d7e-16305d9f8d61" containerName="registry" containerID="cri-o://e4310783b95d50194dd96e7b8b9c17d5c6e4a197a890bca843a951bc766bffc7" gracePeriod=30 Jul 07 11:12:32.679904 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.679881 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:12:32.797071 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.797009 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-certificates\") pod \"83c82870-97ad-4c67-9d7e-16305d9f8d61\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " Jul 07 11:12:32.797071 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.797049 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83c82870-97ad-4c67-9d7e-16305d9f8d61-ca-trust-extracted\") pod \"83c82870-97ad-4c67-9d7e-16305d9f8d61\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " Jul 07 11:12:32.797227 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.797093 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83c82870-97ad-4c67-9d7e-16305d9f8d61-trusted-ca\") pod \"83c82870-97ad-4c67-9d7e-16305d9f8d61\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " Jul 07 11:12:32.797227 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.797129 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnnzg\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-kube-api-access-gnnzg\") pod \"83c82870-97ad-4c67-9d7e-16305d9f8d61\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " Jul 07 11:12:32.797227 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.797158 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-bound-sa-token\") pod \"83c82870-97ad-4c67-9d7e-16305d9f8d61\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " Jul 07 11:12:32.797227 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.797182 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls\") pod \"83c82870-97ad-4c67-9d7e-16305d9f8d61\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " Jul 07 11:12:32.797227 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.797209 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83c82870-97ad-4c67-9d7e-16305d9f8d61-installation-pull-secrets\") pod \"83c82870-97ad-4c67-9d7e-16305d9f8d61\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " Jul 07 11:12:32.797482 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.797241 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83c82870-97ad-4c67-9d7e-16305d9f8d61-image-registry-private-configuration\") pod \"83c82870-97ad-4c67-9d7e-16305d9f8d61\" (UID: \"83c82870-97ad-4c67-9d7e-16305d9f8d61\") " Jul 07 11:12:32.797482 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.797446 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "83c82870-97ad-4c67-9d7e-16305d9f8d61" (UID: "83c82870-97ad-4c67-9d7e-16305d9f8d61"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:12:32.797603 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.797553 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83c82870-97ad-4c67-9d7e-16305d9f8d61-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "83c82870-97ad-4c67-9d7e-16305d9f8d61" (UID: "83c82870-97ad-4c67-9d7e-16305d9f8d61"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:12:32.800127 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.800093 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "83c82870-97ad-4c67-9d7e-16305d9f8d61" (UID: "83c82870-97ad-4c67-9d7e-16305d9f8d61"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:12:32.800246 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.800134 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83c82870-97ad-4c67-9d7e-16305d9f8d61-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "83c82870-97ad-4c67-9d7e-16305d9f8d61" (UID: "83c82870-97ad-4c67-9d7e-16305d9f8d61"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 11:12:32.800246 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.800192 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-kube-api-access-gnnzg" (OuterVolumeSpecName: "kube-api-access-gnnzg") pod "83c82870-97ad-4c67-9d7e-16305d9f8d61" (UID: "83c82870-97ad-4c67-9d7e-16305d9f8d61"). InnerVolumeSpecName "kube-api-access-gnnzg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:12:32.800374 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.800347 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "83c82870-97ad-4c67-9d7e-16305d9f8d61" (UID: "83c82870-97ad-4c67-9d7e-16305d9f8d61"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:12:32.800464 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.800438 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83c82870-97ad-4c67-9d7e-16305d9f8d61-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "83c82870-97ad-4c67-9d7e-16305d9f8d61" (UID: "83c82870-97ad-4c67-9d7e-16305d9f8d61"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 11:12:32.805704 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.805681 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83c82870-97ad-4c67-9d7e-16305d9f8d61-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "83c82870-97ad-4c67-9d7e-16305d9f8d61" (UID: "83c82870-97ad-4c67-9d7e-16305d9f8d61"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:12:32.898299 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.898268 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83c82870-97ad-4c67-9d7e-16305d9f8d61-trusted-ca\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:12:32.898299 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.898298 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnnzg\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-kube-api-access-gnnzg\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:12:32.898299 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.898308 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-bound-sa-token\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:12:32.898461 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.898317 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-tls\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:12:32.898461 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.898325 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83c82870-97ad-4c67-9d7e-16305d9f8d61-installation-pull-secrets\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:12:32.898461 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.898334 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83c82870-97ad-4c67-9d7e-16305d9f8d61-image-registry-private-configuration\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:12:32.898461 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.898343 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83c82870-97ad-4c67-9d7e-16305d9f8d61-registry-certificates\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:12:32.898461 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:32.898351 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83c82870-97ad-4c67-9d7e-16305d9f8d61-ca-trust-extracted\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:12:33.526449 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:33.526390 2576 generic.go:356] "Generic (PLEG): container finished" podID="83c82870-97ad-4c67-9d7e-16305d9f8d61" containerID="e4310783b95d50194dd96e7b8b9c17d5c6e4a197a890bca843a951bc766bffc7" exitCode=0 Jul 07 11:12:33.526834 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:33.526454 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" Jul 07 11:12:33.526834 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:33.526456 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" event={"ID":"83c82870-97ad-4c67-9d7e-16305d9f8d61","Type":"ContainerDied","Data":"e4310783b95d50194dd96e7b8b9c17d5c6e4a197a890bca843a951bc766bffc7"} Jul 07 11:12:33.526834 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:33.526583 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f74bdc6b8-4vpdz" event={"ID":"83c82870-97ad-4c67-9d7e-16305d9f8d61","Type":"ContainerDied","Data":"6dd589ff90d416f15e213523091240437bed1798a21980bd1017067314d2db97"} Jul 07 11:12:33.526834 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:33.526607 2576 scope.go:117] "RemoveContainer" containerID="e4310783b95d50194dd96e7b8b9c17d5c6e4a197a890bca843a951bc766bffc7" Jul 07 11:12:33.535706 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:33.535689 2576 scope.go:117] "RemoveContainer" containerID="e4310783b95d50194dd96e7b8b9c17d5c6e4a197a890bca843a951bc766bffc7" Jul 07 11:12:33.535943 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:12:33.535923 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4310783b95d50194dd96e7b8b9c17d5c6e4a197a890bca843a951bc766bffc7\": container with ID starting with e4310783b95d50194dd96e7b8b9c17d5c6e4a197a890bca843a951bc766bffc7 not found: ID does not exist" containerID="e4310783b95d50194dd96e7b8b9c17d5c6e4a197a890bca843a951bc766bffc7" Jul 07 11:12:33.535999 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:33.535950 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4310783b95d50194dd96e7b8b9c17d5c6e4a197a890bca843a951bc766bffc7"} err="failed to get container status \"e4310783b95d50194dd96e7b8b9c17d5c6e4a197a890bca843a951bc766bffc7\": rpc error: code = NotFound desc = could not find container \"e4310783b95d50194dd96e7b8b9c17d5c6e4a197a890bca843a951bc766bffc7\": container with ID starting with e4310783b95d50194dd96e7b8b9c17d5c6e4a197a890bca843a951bc766bffc7 not found: ID does not exist" Jul 07 11:12:33.548837 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:33.548814 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f74bdc6b8-4vpdz"] Jul 07 11:12:33.552875 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:33.552846 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f74bdc6b8-4vpdz"] Jul 07 11:12:34.056575 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:34.054341 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83c82870-97ad-4c67-9d7e-16305d9f8d61" path="/var/lib/kubelet/pods/83c82870-97ad-4c67-9d7e-16305d9f8d61/volumes" Jul 07 11:12:36.368100 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.368066 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6df489f5c8-mwscl"] Jul 07 11:12:36.368470 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.368306 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83c82870-97ad-4c67-9d7e-16305d9f8d61" containerName="registry" Jul 07 11:12:36.368470 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.368318 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="83c82870-97ad-4c67-9d7e-16305d9f8d61" containerName="registry" Jul 07 11:12:36.368470 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.368360 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="83c82870-97ad-4c67-9d7e-16305d9f8d61" containerName="registry" Jul 07 11:12:36.445710 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.445677 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df489f5c8-mwscl"] Jul 07 11:12:36.445851 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.445766 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.449072 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.449044 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 11:12:36.449200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.449137 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 11:12:36.449418 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.449390 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 11:12:36.450067 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.450053 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5g7fn\"" Jul 07 11:12:36.450526 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.450508 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 11:12:36.450602 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.450542 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 11:12:36.450602 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.450558 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 11:12:36.450707 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.450633 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 11:12:36.523334 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.523309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-config\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.523476 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.523347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-service-ca\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.523476 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.523369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-oauth-config\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.523596 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.523480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-serving-cert\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.523596 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.523522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb24m\" (UniqueName: \"kubernetes.io/projected/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-kube-api-access-cb24m\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.523596 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.523577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-oauth-serving-cert\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.624538 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.624468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-service-ca\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.624538 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.624502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-oauth-config\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.624538 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.624525 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-serving-cert\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.624762 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.624546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb24m\" (UniqueName: \"kubernetes.io/projected/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-kube-api-access-cb24m\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.624762 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.624590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-oauth-serving-cert\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.624762 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.624649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-config\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.625351 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.625245 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-oauth-serving-cert\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.625351 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.625424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-service-ca\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.625603 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.625424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-config\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.627073 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.627054 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-oauth-config\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.627154 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.627120 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-serving-cert\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.635637 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.635617 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb24m\" (UniqueName: \"kubernetes.io/projected/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-kube-api-access-cb24m\") pod \"console-6df489f5c8-mwscl\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.755437 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.755383 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:36.913988 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:36.913959 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df489f5c8-mwscl"] Jul 07 11:12:36.916837 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:12:36.916811 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b5c3d09_c2e2_4abc_b606_dcf70e11907c.slice/crio-b7749b9d284de524dede5c5ada9be791f019f77ab35be3c14f5caabb2e03f706 WatchSource:0}: Error finding container b7749b9d284de524dede5c5ada9be791f019f77ab35be3c14f5caabb2e03f706: Status 404 returned error can't find the container with id b7749b9d284de524dede5c5ada9be791f019f77ab35be3c14f5caabb2e03f706 Jul 07 11:12:37.543676 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:37.543640 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df489f5c8-mwscl" event={"ID":"2b5c3d09-c2e2-4abc-b606-dcf70e11907c","Type":"ContainerStarted","Data":"b7749b9d284de524dede5c5ada9be791f019f77ab35be3c14f5caabb2e03f706"} Jul 07 11:12:38.427226 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:38.427202 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s4jm7" Jul 07 11:12:41.560905 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:41.560865 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df489f5c8-mwscl" event={"ID":"2b5c3d09-c2e2-4abc-b606-dcf70e11907c","Type":"ContainerStarted","Data":"accf2f68d94e2738cbb8c6a2bf83cd666b8e3f910e484249886a2166cf45eb1e"} Jul 07 11:12:41.581465 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:41.581417 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6df489f5c8-mwscl" podStartSLOduration=1.829800852 podStartE2EDuration="5.581356228s" totalImagesPullingTime="3.751555376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:12:41.58049519 +0000 UTC m=+106.057153150" watchObservedRunningTime="2026-07-07 11:12:41.581356228 +0000 UTC m=+106.058014189" Jul 07 11:12:45.688409 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.688360 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55f55dfd6c-rlcrq"] Jul 07 11:12:45.690149 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.690133 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.702890 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.702824 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 11:12:45.704332 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.704306 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f55dfd6c-rlcrq"] Jul 07 11:12:45.791197 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.791170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-config\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.791310 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.791201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c52j\" (UniqueName: \"kubernetes.io/projected/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-kube-api-access-9c52j\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.791310 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.791226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-oauth-config\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.791310 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.791240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-service-ca\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.791474 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.791324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-oauth-serving-cert\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.791474 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.791352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-trusted-ca-bundle\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.791474 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.791374 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-serving-cert\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.891790 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.891751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-config\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.891926 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.891793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c52j\" (UniqueName: \"kubernetes.io/projected/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-kube-api-access-9c52j\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.891926 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.891871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-oauth-config\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.891926 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.891899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-service-ca\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.891926 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.891922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-oauth-serving-cert\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.892126 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.891964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-trusted-ca-bundle\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.892126 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.891995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-serving-cert\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.892679 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.892655 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-config\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.892795 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.892771 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-oauth-serving-cert\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.892919 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.892897 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-service-ca\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.893026 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.893008 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-trusted-ca-bundle\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.894481 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.894456 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-oauth-config\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.894561 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.894538 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-serving-cert\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.900909 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.900891 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c52j\" (UniqueName: \"kubernetes.io/projected/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-kube-api-access-9c52j\") pod \"console-55f55dfd6c-rlcrq\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:45.999045 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:45.998979 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:46.126847 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:46.126814 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f55dfd6c-rlcrq"] Jul 07 11:12:46.129628 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:12:46.129600 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3818950c_2b67_4b4e_8de7_0ec26ab5d5eb.slice/crio-45dfabcd04329f567b66f31127a9aaf7dc2df7ecad155df2c7b0eb5d4a00bff2 WatchSource:0}: Error finding container 45dfabcd04329f567b66f31127a9aaf7dc2df7ecad155df2c7b0eb5d4a00bff2: Status 404 returned error can't find the container with id 45dfabcd04329f567b66f31127a9aaf7dc2df7ecad155df2c7b0eb5d4a00bff2 Jul 07 11:12:46.580404 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:46.580356 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f55dfd6c-rlcrq" event={"ID":"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb","Type":"ContainerStarted","Data":"e22ad28ebac305f9da2dbcabb75eb51fe98fe2cc1970494c83a235cb500e9c1e"} Jul 07 11:12:46.580563 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:46.580423 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f55dfd6c-rlcrq" event={"ID":"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb","Type":"ContainerStarted","Data":"45dfabcd04329f567b66f31127a9aaf7dc2df7ecad155df2c7b0eb5d4a00bff2"} Jul 07 11:12:46.598732 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:46.598654 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55f55dfd6c-rlcrq" podStartSLOduration=1.598635848 podStartE2EDuration="1.598635848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:12:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:12:46.598327264 +0000 UTC m=+111.074985250" watchObservedRunningTime="2026-07-07 11:12:46.598635848 +0000 UTC m=+111.075293810" Jul 07 11:12:46.756247 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:46.756209 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:46.756627 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:46.756268 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:46.760729 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:46.760707 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:47.588019 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:47.587989 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:12:55.999585 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:55.999551 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:55.999931 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:55.999645 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:56.004522 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:56.004502 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:56.620438 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:56.620413 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:12:56.668934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:12:56.668895 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df489f5c8-mwscl"] Jul 07 11:13:21.690578 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:21.690537 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6df489f5c8-mwscl" podUID="2b5c3d09-c2e2-4abc-b606-dcf70e11907c" containerName="console" containerID="cri-o://accf2f68d94e2738cbb8c6a2bf83cd666b8e3f910e484249886a2166cf45eb1e" gracePeriod=15 Jul 07 11:13:21.931149 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:21.931121 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:13:21.958889 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:21.958814 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-config\") pod \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " Jul 07 11:13:21.958889 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:21.958864 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-serving-cert\") pod \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " Jul 07 11:13:21.959100 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:21.959008 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb24m\" (UniqueName: \"kubernetes.io/projected/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-kube-api-access-cb24m\") pod \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " Jul 07 11:13:21.959100 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:21.959070 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-oauth-config\") pod \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " Jul 07 11:13:21.959208 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:21.959102 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-service-ca\") pod \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " Jul 07 11:13:21.959208 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:21.959128 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-oauth-serving-cert\") pod \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\" (UID: \"2b5c3d09-c2e2-4abc-b606-dcf70e11907c\") " Jul 07 11:13:21.959310 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:21.959264 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-config" (OuterVolumeSpecName: "console-config") pod "2b5c3d09-c2e2-4abc-b606-dcf70e11907c" (UID: "2b5c3d09-c2e2-4abc-b606-dcf70e11907c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:13:21.959381 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:21.959354 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-config\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:13:21.959706 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:21.959654 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2b5c3d09-c2e2-4abc-b606-dcf70e11907c" (UID: "2b5c3d09-c2e2-4abc-b606-dcf70e11907c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:13:21.959706 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:21.959697 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-service-ca" (OuterVolumeSpecName: "service-ca") pod "2b5c3d09-c2e2-4abc-b606-dcf70e11907c" (UID: "2b5c3d09-c2e2-4abc-b606-dcf70e11907c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:13:21.961570 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:21.961546 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2b5c3d09-c2e2-4abc-b606-dcf70e11907c" (UID: "2b5c3d09-c2e2-4abc-b606-dcf70e11907c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 11:13:21.961659 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:21.961632 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2b5c3d09-c2e2-4abc-b606-dcf70e11907c" (UID: "2b5c3d09-c2e2-4abc-b606-dcf70e11907c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 11:13:21.961659 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:21.961637 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-kube-api-access-cb24m" (OuterVolumeSpecName: "kube-api-access-cb24m") pod "2b5c3d09-c2e2-4abc-b606-dcf70e11907c" (UID: "2b5c3d09-c2e2-4abc-b606-dcf70e11907c"). InnerVolumeSpecName "kube-api-access-cb24m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:13:22.060359 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:22.060331 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-serving-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:13:22.060359 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:22.060359 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb24m\" (UniqueName: \"kubernetes.io/projected/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-kube-api-access-cb24m\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:13:22.060548 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:22.060372 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-console-oauth-config\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:13:22.060548 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:22.060384 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-service-ca\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:13:22.060548 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:22.060413 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b5c3d09-c2e2-4abc-b606-dcf70e11907c-oauth-serving-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:13:22.704827 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:22.704794 2576 generic.go:356] "Generic (PLEG): container finished" podID="2b5c3d09-c2e2-4abc-b606-dcf70e11907c" containerID="accf2f68d94e2738cbb8c6a2bf83cd666b8e3f910e484249886a2166cf45eb1e" exitCode=0 Jul 07 11:13:22.705222 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:22.704835 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df489f5c8-mwscl" Jul 07 11:13:22.705222 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:22.704871 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df489f5c8-mwscl" event={"ID":"2b5c3d09-c2e2-4abc-b606-dcf70e11907c","Type":"ContainerDied","Data":"accf2f68d94e2738cbb8c6a2bf83cd666b8e3f910e484249886a2166cf45eb1e"} Jul 07 11:13:22.705222 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:22.704918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df489f5c8-mwscl" event={"ID":"2b5c3d09-c2e2-4abc-b606-dcf70e11907c","Type":"ContainerDied","Data":"b7749b9d284de524dede5c5ada9be791f019f77ab35be3c14f5caabb2e03f706"} Jul 07 11:13:22.705222 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:22.704937 2576 scope.go:117] "RemoveContainer" containerID="accf2f68d94e2738cbb8c6a2bf83cd666b8e3f910e484249886a2166cf45eb1e" Jul 07 11:13:22.712755 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:22.712736 2576 scope.go:117] "RemoveContainer" containerID="accf2f68d94e2738cbb8c6a2bf83cd666b8e3f910e484249886a2166cf45eb1e" Jul 07 11:13:22.713049 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:13:22.713031 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"accf2f68d94e2738cbb8c6a2bf83cd666b8e3f910e484249886a2166cf45eb1e\": container with ID starting with accf2f68d94e2738cbb8c6a2bf83cd666b8e3f910e484249886a2166cf45eb1e not found: ID does not exist" containerID="accf2f68d94e2738cbb8c6a2bf83cd666b8e3f910e484249886a2166cf45eb1e" Jul 07 11:13:22.713120 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:22.713055 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"accf2f68d94e2738cbb8c6a2bf83cd666b8e3f910e484249886a2166cf45eb1e"} err="failed to get container status \"accf2f68d94e2738cbb8c6a2bf83cd666b8e3f910e484249886a2166cf45eb1e\": rpc error: code = NotFound desc = could not find container \"accf2f68d94e2738cbb8c6a2bf83cd666b8e3f910e484249886a2166cf45eb1e\": container with ID starting with accf2f68d94e2738cbb8c6a2bf83cd666b8e3f910e484249886a2166cf45eb1e not found: ID does not exist" Jul 07 11:13:22.722187 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:22.722162 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df489f5c8-mwscl"] Jul 07 11:13:22.728424 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:22.728387 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6df489f5c8-mwscl"] Jul 07 11:13:24.053900 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:24.053865 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b5c3d09-c2e2-4abc-b606-dcf70e11907c" path="/var/lib/kubelet/pods/2b5c3d09-c2e2-4abc-b606-dcf70e11907c/volumes" Jul 07 11:13:44.596355 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.594373 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-789c65bb86-pc5fp"] Jul 07 11:13:44.596355 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.594957 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b5c3d09-c2e2-4abc-b606-dcf70e11907c" containerName="console" Jul 07 11:13:44.596355 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.594975 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b5c3d09-c2e2-4abc-b606-dcf70e11907c" containerName="console" Jul 07 11:13:44.596355 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.595116 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b5c3d09-c2e2-4abc-b606-dcf70e11907c" containerName="console" Jul 07 11:13:44.599182 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.599155 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.610322 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.610299 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789c65bb86-pc5fp"] Jul 07 11:13:44.712729 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.712691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-trusted-ca-bundle\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.712914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.712744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce559182-1025-415f-81ed-66e7ab11fb4f-console-serving-cert\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.712914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.712771 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-oauth-serving-cert\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.712914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.712826 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce559182-1025-415f-81ed-66e7ab11fb4f-console-oauth-config\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.712914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.712847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-service-ca\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.712914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.712871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-console-config\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.712914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.712891 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4hl8\" (UniqueName: \"kubernetes.io/projected/ce559182-1025-415f-81ed-66e7ab11fb4f-kube-api-access-n4hl8\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.814207 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.814166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce559182-1025-415f-81ed-66e7ab11fb4f-console-oauth-config\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.814207 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.814208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-service-ca\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.814500 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.814233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-console-config\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.814500 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.814258 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4hl8\" (UniqueName: \"kubernetes.io/projected/ce559182-1025-415f-81ed-66e7ab11fb4f-kube-api-access-n4hl8\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.814500 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.814294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-trusted-ca-bundle\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.814500 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.814339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce559182-1025-415f-81ed-66e7ab11fb4f-console-serving-cert\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.814500 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.814368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-oauth-serving-cert\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.815198 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.815162 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-oauth-serving-cert\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.815198 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.815190 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-console-config\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.815360 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.815289 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-service-ca\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.815513 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.815489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-trusted-ca-bundle\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.816972 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.816951 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce559182-1025-415f-81ed-66e7ab11fb4f-console-serving-cert\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.817051 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.816981 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce559182-1025-415f-81ed-66e7ab11fb4f-console-oauth-config\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.825667 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.825642 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4hl8\" (UniqueName: \"kubernetes.io/projected/ce559182-1025-415f-81ed-66e7ab11fb4f-kube-api-access-n4hl8\") pod \"console-789c65bb86-pc5fp\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:44.907952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:44.907858 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:45.037422 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:45.037369 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789c65bb86-pc5fp"] Jul 07 11:13:45.041944 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:13:45.041914 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce559182_1025_415f_81ed_66e7ab11fb4f.slice/crio-9604cd1904a3912763aa3c5e11642f5c7830285507a46a2528848efea4c73137 WatchSource:0}: Error finding container 9604cd1904a3912763aa3c5e11642f5c7830285507a46a2528848efea4c73137: Status 404 returned error can't find the container with id 9604cd1904a3912763aa3c5e11642f5c7830285507a46a2528848efea4c73137 Jul 07 11:13:45.782890 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:45.782858 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789c65bb86-pc5fp" event={"ID":"ce559182-1025-415f-81ed-66e7ab11fb4f","Type":"ContainerStarted","Data":"215ddcd87bfc241da701b4a391a35a95d8ca26b0cf14322d1e8a1b918a3b0eed"} Jul 07 11:13:45.783361 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:45.782918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789c65bb86-pc5fp" event={"ID":"ce559182-1025-415f-81ed-66e7ab11fb4f","Type":"ContainerStarted","Data":"9604cd1904a3912763aa3c5e11642f5c7830285507a46a2528848efea4c73137"} Jul 07 11:13:45.807526 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:45.807482 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-789c65bb86-pc5fp" podStartSLOduration=1.807469003 podStartE2EDuration="1.807469003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:13:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:13:45.802339574 +0000 UTC m=+170.278997537" watchObservedRunningTime="2026-07-07 11:13:45.807469003 +0000 UTC m=+170.284126966" Jul 07 11:13:54.908875 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:54.908762 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:54.908875 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:54.908851 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:54.913595 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:54.913571 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:55.819250 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:55.819217 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:13:55.902069 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:13:55.897684 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f55dfd6c-rlcrq"] Jul 07 11:14:20.928515 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:20.928465 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55f55dfd6c-rlcrq" podUID="3818950c-2b67-4b4e-8de7-0ec26ab5d5eb" containerName="console" containerID="cri-o://e22ad28ebac305f9da2dbcabb75eb51fe98fe2cc1970494c83a235cb500e9c1e" gracePeriod=15 Jul 07 11:14:21.166571 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.166547 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:14:21.273718 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.273648 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-service-ca\") pod \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " Jul 07 11:14:21.273718 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.273698 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-oauth-config\") pod \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " Jul 07 11:14:21.273876 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.273842 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-config\") pod \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " Jul 07 11:14:21.273931 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.273876 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-serving-cert\") pod \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " Jul 07 11:14:21.273931 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.273915 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-oauth-serving-cert\") pod \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " Jul 07 11:14:21.274037 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.273958 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c52j\" (UniqueName: \"kubernetes.io/projected/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-kube-api-access-9c52j\") pod \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " Jul 07 11:14:21.274037 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.273971 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-service-ca" (OuterVolumeSpecName: "service-ca") pod "3818950c-2b67-4b4e-8de7-0ec26ab5d5eb" (UID: "3818950c-2b67-4b4e-8de7-0ec26ab5d5eb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:14:21.274037 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.273987 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-trusted-ca-bundle\") pod \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\" (UID: \"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb\") " Jul 07 11:14:21.274232 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.274200 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-service-ca\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:14:21.274232 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.274207 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-config" (OuterVolumeSpecName: "console-config") pod "3818950c-2b67-4b4e-8de7-0ec26ab5d5eb" (UID: "3818950c-2b67-4b4e-8de7-0ec26ab5d5eb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:14:21.274616 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.274269 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3818950c-2b67-4b4e-8de7-0ec26ab5d5eb" (UID: "3818950c-2b67-4b4e-8de7-0ec26ab5d5eb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:14:21.274616 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.274442 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3818950c-2b67-4b4e-8de7-0ec26ab5d5eb" (UID: "3818950c-2b67-4b4e-8de7-0ec26ab5d5eb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:14:21.275950 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.275931 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3818950c-2b67-4b4e-8de7-0ec26ab5d5eb" (UID: "3818950c-2b67-4b4e-8de7-0ec26ab5d5eb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 11:14:21.276104 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.276083 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3818950c-2b67-4b4e-8de7-0ec26ab5d5eb" (UID: "3818950c-2b67-4b4e-8de7-0ec26ab5d5eb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 11:14:21.276168 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.276155 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-kube-api-access-9c52j" (OuterVolumeSpecName: "kube-api-access-9c52j") pod "3818950c-2b67-4b4e-8de7-0ec26ab5d5eb" (UID: "3818950c-2b67-4b4e-8de7-0ec26ab5d5eb"). InnerVolumeSpecName "kube-api-access-9c52j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:14:21.374785 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.374754 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-oauth-config\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:14:21.374785 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.374784 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-config\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:14:21.374785 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.374793 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-console-serving-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:14:21.374930 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.374802 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-oauth-serving-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:14:21.374930 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.374811 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c52j\" (UniqueName: \"kubernetes.io/projected/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-kube-api-access-9c52j\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:14:21.374930 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.374820 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb-trusted-ca-bundle\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:14:21.906624 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.906592 2576 generic.go:356] "Generic (PLEG): container finished" podID="3818950c-2b67-4b4e-8de7-0ec26ab5d5eb" containerID="e22ad28ebac305f9da2dbcabb75eb51fe98fe2cc1970494c83a235cb500e9c1e" exitCode=0 Jul 07 11:14:21.906787 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.906636 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f55dfd6c-rlcrq" Jul 07 11:14:21.906787 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.906655 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f55dfd6c-rlcrq" event={"ID":"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb","Type":"ContainerDied","Data":"e22ad28ebac305f9da2dbcabb75eb51fe98fe2cc1970494c83a235cb500e9c1e"} Jul 07 11:14:21.906787 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.906695 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f55dfd6c-rlcrq" event={"ID":"3818950c-2b67-4b4e-8de7-0ec26ab5d5eb","Type":"ContainerDied","Data":"45dfabcd04329f567b66f31127a9aaf7dc2df7ecad155df2c7b0eb5d4a00bff2"} Jul 07 11:14:21.906787 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.906714 2576 scope.go:117] "RemoveContainer" containerID="e22ad28ebac305f9da2dbcabb75eb51fe98fe2cc1970494c83a235cb500e9c1e" Jul 07 11:14:21.914802 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.914785 2576 scope.go:117] "RemoveContainer" containerID="e22ad28ebac305f9da2dbcabb75eb51fe98fe2cc1970494c83a235cb500e9c1e" Jul 07 11:14:21.915035 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:14:21.915019 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e22ad28ebac305f9da2dbcabb75eb51fe98fe2cc1970494c83a235cb500e9c1e\": container with ID starting with e22ad28ebac305f9da2dbcabb75eb51fe98fe2cc1970494c83a235cb500e9c1e not found: ID does not exist" containerID="e22ad28ebac305f9da2dbcabb75eb51fe98fe2cc1970494c83a235cb500e9c1e" Jul 07 11:14:21.915105 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.915041 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e22ad28ebac305f9da2dbcabb75eb51fe98fe2cc1970494c83a235cb500e9c1e"} err="failed to get container status \"e22ad28ebac305f9da2dbcabb75eb51fe98fe2cc1970494c83a235cb500e9c1e\": rpc error: code = NotFound desc = could not find container \"e22ad28ebac305f9da2dbcabb75eb51fe98fe2cc1970494c83a235cb500e9c1e\": container with ID starting with e22ad28ebac305f9da2dbcabb75eb51fe98fe2cc1970494c83a235cb500e9c1e not found: ID does not exist" Jul 07 11:14:21.927551 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.927528 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f55dfd6c-rlcrq"] Jul 07 11:14:21.932838 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:21.932819 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55f55dfd6c-rlcrq"] Jul 07 11:14:22.053801 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:22.053776 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3818950c-2b67-4b4e-8de7-0ec26ab5d5eb" path="/var/lib/kubelet/pods/3818950c-2b67-4b4e-8de7-0ec26ab5d5eb/volumes" Jul 07 11:14:35.339492 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.339459 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd"] Jul 07 11:14:35.340041 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.339811 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3818950c-2b67-4b4e-8de7-0ec26ab5d5eb" containerName="console" Jul 07 11:14:35.340041 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.339826 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3818950c-2b67-4b4e-8de7-0ec26ab5d5eb" containerName="console" Jul 07 11:14:35.340041 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.339919 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3818950c-2b67-4b4e-8de7-0ec26ab5d5eb" containerName="console" Jul 07 11:14:35.344321 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.344300 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" Jul 07 11:14:35.347274 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.347249 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 11:14:35.347385 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.347290 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5wltf\"" Jul 07 11:14:35.348431 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.348412 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 11:14:35.355221 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.355201 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd"] Jul 07 11:14:35.461927 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.461901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t89cp\" (UniqueName: \"kubernetes.io/projected/582d04b1-de27-4d1a-b687-c42a8d08f50b-kube-api-access-t89cp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd\" (UID: \"582d04b1-de27-4d1a-b687-c42a8d08f50b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" Jul 07 11:14:35.462062 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.461955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/582d04b1-de27-4d1a-b687-c42a8d08f50b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd\" (UID: \"582d04b1-de27-4d1a-b687-c42a8d08f50b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" Jul 07 11:14:35.462062 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.461976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/582d04b1-de27-4d1a-b687-c42a8d08f50b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd\" (UID: \"582d04b1-de27-4d1a-b687-c42a8d08f50b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" Jul 07 11:14:35.563208 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.563170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t89cp\" (UniqueName: \"kubernetes.io/projected/582d04b1-de27-4d1a-b687-c42a8d08f50b-kube-api-access-t89cp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd\" (UID: \"582d04b1-de27-4d1a-b687-c42a8d08f50b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" Jul 07 11:14:35.563323 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.563259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/582d04b1-de27-4d1a-b687-c42a8d08f50b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd\" (UID: \"582d04b1-de27-4d1a-b687-c42a8d08f50b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" Jul 07 11:14:35.563323 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.563291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/582d04b1-de27-4d1a-b687-c42a8d08f50b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd\" (UID: \"582d04b1-de27-4d1a-b687-c42a8d08f50b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" Jul 07 11:14:35.563654 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.563635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/582d04b1-de27-4d1a-b687-c42a8d08f50b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd\" (UID: \"582d04b1-de27-4d1a-b687-c42a8d08f50b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" Jul 07 11:14:35.563726 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.563670 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/582d04b1-de27-4d1a-b687-c42a8d08f50b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd\" (UID: \"582d04b1-de27-4d1a-b687-c42a8d08f50b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" Jul 07 11:14:35.574192 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.574161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t89cp\" (UniqueName: \"kubernetes.io/projected/582d04b1-de27-4d1a-b687-c42a8d08f50b-kube-api-access-t89cp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd\" (UID: \"582d04b1-de27-4d1a-b687-c42a8d08f50b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" Jul 07 11:14:35.652804 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.652750 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" Jul 07 11:14:35.788031 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.788003 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd"] Jul 07 11:14:35.790154 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:14:35.790125 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582d04b1_de27_4d1a_b687_c42a8d08f50b.slice/crio-1a29a056c722d0c107a5483caaccb94495dbf3ff8a643533f37a1f88c7f160af WatchSource:0}: Error finding container 1a29a056c722d0c107a5483caaccb94495dbf3ff8a643533f37a1f88c7f160af: Status 404 returned error can't find the container with id 1a29a056c722d0c107a5483caaccb94495dbf3ff8a643533f37a1f88c7f160af Jul 07 11:14:35.956402 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:35.956376 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" event={"ID":"582d04b1-de27-4d1a-b687-c42a8d08f50b","Type":"ContainerStarted","Data":"1a29a056c722d0c107a5483caaccb94495dbf3ff8a643533f37a1f88c7f160af"} Jul 07 11:14:43.992100 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:43.992062 2576 generic.go:356] "Generic (PLEG): container finished" podID="582d04b1-de27-4d1a-b687-c42a8d08f50b" containerID="557f18db2f13b54c49af946422acc00533e1d36a6e25cf734763e6c53d323c46" exitCode=0 Jul 07 11:14:43.992100 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:43.992103 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" event={"ID":"582d04b1-de27-4d1a-b687-c42a8d08f50b","Type":"ContainerDied","Data":"557f18db2f13b54c49af946422acc00533e1d36a6e25cf734763e6c53d323c46"} Jul 07 11:14:47.004635 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:47.004591 2576 generic.go:356] "Generic (PLEG): container finished" podID="582d04b1-de27-4d1a-b687-c42a8d08f50b" containerID="a9e379cf80fb74e1dfc7322c0ccc8d525308db0a79517eb1b94b44942efaf5a2" exitCode=0 Jul 07 11:14:47.005026 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:47.004682 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" event={"ID":"582d04b1-de27-4d1a-b687-c42a8d08f50b","Type":"ContainerDied","Data":"a9e379cf80fb74e1dfc7322c0ccc8d525308db0a79517eb1b94b44942efaf5a2"} Jul 07 11:14:54.034826 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:54.034793 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" event={"ID":"582d04b1-de27-4d1a-b687-c42a8d08f50b","Type":"ContainerStarted","Data":"950343458d6e79d70fcd4172f17cb77da7db112f521203eb5dd60f5acd6c78ba"} Jul 07 11:14:54.067876 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:54.067828 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" podStartSLOduration=2.906121751 podStartE2EDuration="19.067812951s" totalImagesPullingTime="16.1616912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:14:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:14:54.0656055 +0000 UTC m=+238.542263464" watchObservedRunningTime="2026-07-07 11:14:54.067812951 +0000 UTC m=+238.544470911" Jul 07 11:14:55.040704 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:55.040673 2576 generic.go:356] "Generic (PLEG): container finished" podID="582d04b1-de27-4d1a-b687-c42a8d08f50b" containerID="950343458d6e79d70fcd4172f17cb77da7db112f521203eb5dd60f5acd6c78ba" exitCode=0 Jul 07 11:14:55.041031 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:55.040711 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" event={"ID":"582d04b1-de27-4d1a-b687-c42a8d08f50b","Type":"ContainerDied","Data":"950343458d6e79d70fcd4172f17cb77da7db112f521203eb5dd60f5acd6c78ba"} Jul 07 11:14:56.185781 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:56.185758 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" Jul 07 11:14:56.331069 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:56.331012 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/582d04b1-de27-4d1a-b687-c42a8d08f50b-util\") pod \"582d04b1-de27-4d1a-b687-c42a8d08f50b\" (UID: \"582d04b1-de27-4d1a-b687-c42a8d08f50b\") " Jul 07 11:14:56.331069 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:56.331056 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t89cp\" (UniqueName: \"kubernetes.io/projected/582d04b1-de27-4d1a-b687-c42a8d08f50b-kube-api-access-t89cp\") pod \"582d04b1-de27-4d1a-b687-c42a8d08f50b\" (UID: \"582d04b1-de27-4d1a-b687-c42a8d08f50b\") " Jul 07 11:14:56.331254 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:56.331085 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/582d04b1-de27-4d1a-b687-c42a8d08f50b-bundle\") pod \"582d04b1-de27-4d1a-b687-c42a8d08f50b\" (UID: \"582d04b1-de27-4d1a-b687-c42a8d08f50b\") " Jul 07 11:14:56.331696 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:56.331672 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/582d04b1-de27-4d1a-b687-c42a8d08f50b-bundle" (OuterVolumeSpecName: "bundle") pod "582d04b1-de27-4d1a-b687-c42a8d08f50b" (UID: "582d04b1-de27-4d1a-b687-c42a8d08f50b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:14:56.333238 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:56.333218 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/582d04b1-de27-4d1a-b687-c42a8d08f50b-kube-api-access-t89cp" (OuterVolumeSpecName: "kube-api-access-t89cp") pod "582d04b1-de27-4d1a-b687-c42a8d08f50b" (UID: "582d04b1-de27-4d1a-b687-c42a8d08f50b"). InnerVolumeSpecName "kube-api-access-t89cp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:14:56.335864 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:56.335840 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/582d04b1-de27-4d1a-b687-c42a8d08f50b-util" (OuterVolumeSpecName: "util") pod "582d04b1-de27-4d1a-b687-c42a8d08f50b" (UID: "582d04b1-de27-4d1a-b687-c42a8d08f50b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:14:56.432029 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:56.432003 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t89cp\" (UniqueName: \"kubernetes.io/projected/582d04b1-de27-4d1a-b687-c42a8d08f50b-kube-api-access-t89cp\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:14:56.432029 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:56.432026 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/582d04b1-de27-4d1a-b687-c42a8d08f50b-bundle\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:14:56.432151 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:56.432039 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/582d04b1-de27-4d1a-b687-c42a8d08f50b-util\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:14:57.049441 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:57.049417 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" Jul 07 11:14:57.049441 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:57.049427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nx5jd" event={"ID":"582d04b1-de27-4d1a-b687-c42a8d08f50b","Type":"ContainerDied","Data":"1a29a056c722d0c107a5483caaccb94495dbf3ff8a643533f37a1f88c7f160af"} Jul 07 11:14:57.049625 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:14:57.049466 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a29a056c722d0c107a5483caaccb94495dbf3ff8a643533f37a1f88c7f160af" Jul 07 11:15:04.082755 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.082726 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n6fpf"] Jul 07 11:15:04.083164 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.082942 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="582d04b1-de27-4d1a-b687-c42a8d08f50b" containerName="pull" Jul 07 11:15:04.083164 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.082953 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="582d04b1-de27-4d1a-b687-c42a8d08f50b" containerName="pull" Jul 07 11:15:04.083164 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.082963 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="582d04b1-de27-4d1a-b687-c42a8d08f50b" containerName="util" Jul 07 11:15:04.083164 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.082969 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="582d04b1-de27-4d1a-b687-c42a8d08f50b" containerName="util" Jul 07 11:15:04.083164 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.082984 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="582d04b1-de27-4d1a-b687-c42a8d08f50b" containerName="extract" Jul 07 11:15:04.083164 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.082990 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="582d04b1-de27-4d1a-b687-c42a8d08f50b" containerName="extract" Jul 07 11:15:04.083164 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.083031 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="582d04b1-de27-4d1a-b687-c42a8d08f50b" containerName="extract" Jul 07 11:15:04.087148 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.087126 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n6fpf" Jul 07 11:15:04.090060 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.090039 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-c56x9\"" Jul 07 11:15:04.091174 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.091158 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 11:15:04.091728 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.091712 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 11:15:04.112467 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.112444 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n6fpf"] Jul 07 11:15:04.283886 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.283858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18fdf241-34ec-45ba-b507-4a5a05a1a36c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-n6fpf\" (UID: \"18fdf241-34ec-45ba-b507-4a5a05a1a36c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n6fpf" Jul 07 11:15:04.284037 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.283898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7q6q\" (UniqueName: \"kubernetes.io/projected/18fdf241-34ec-45ba-b507-4a5a05a1a36c-kube-api-access-d7q6q\") pod \"cert-manager-operator-controller-manager-55c444bf86-n6fpf\" (UID: \"18fdf241-34ec-45ba-b507-4a5a05a1a36c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n6fpf" Jul 07 11:15:04.384503 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.384423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18fdf241-34ec-45ba-b507-4a5a05a1a36c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-n6fpf\" (UID: \"18fdf241-34ec-45ba-b507-4a5a05a1a36c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n6fpf" Jul 07 11:15:04.384503 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.384473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7q6q\" (UniqueName: \"kubernetes.io/projected/18fdf241-34ec-45ba-b507-4a5a05a1a36c-kube-api-access-d7q6q\") pod \"cert-manager-operator-controller-manager-55c444bf86-n6fpf\" (UID: \"18fdf241-34ec-45ba-b507-4a5a05a1a36c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n6fpf" Jul 07 11:15:04.384817 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.384792 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18fdf241-34ec-45ba-b507-4a5a05a1a36c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-n6fpf\" (UID: \"18fdf241-34ec-45ba-b507-4a5a05a1a36c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n6fpf" Jul 07 11:15:04.401714 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.401687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7q6q\" (UniqueName: \"kubernetes.io/projected/18fdf241-34ec-45ba-b507-4a5a05a1a36c-kube-api-access-d7q6q\") pod \"cert-manager-operator-controller-manager-55c444bf86-n6fpf\" (UID: \"18fdf241-34ec-45ba-b507-4a5a05a1a36c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n6fpf" Jul 07 11:15:04.695784 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.695757 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n6fpf" Jul 07 11:15:04.859085 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:04.858926 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n6fpf"] Jul 07 11:15:04.862068 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:15:04.862030 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18fdf241_34ec_45ba_b507_4a5a05a1a36c.slice/crio-59eb684b59f74553df4bbaf972f558736bfdf69ed9a1e8e2fe80abc24a048266 WatchSource:0}: Error finding container 59eb684b59f74553df4bbaf972f558736bfdf69ed9a1e8e2fe80abc24a048266: Status 404 returned error can't find the container with id 59eb684b59f74553df4bbaf972f558736bfdf69ed9a1e8e2fe80abc24a048266 Jul 07 11:15:05.079854 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:05.079787 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n6fpf" event={"ID":"18fdf241-34ec-45ba-b507-4a5a05a1a36c","Type":"ContainerStarted","Data":"59eb684b59f74553df4bbaf972f558736bfdf69ed9a1e8e2fe80abc24a048266"} Jul 07 11:15:07.089472 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:07.089435 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n6fpf" event={"ID":"18fdf241-34ec-45ba-b507-4a5a05a1a36c","Type":"ContainerStarted","Data":"05735efabf9c98096a85c8118d38cbd6147feaf9ddc1c99023cff8321667a4a3"} Jul 07 11:15:07.189380 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:07.189331 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n6fpf" podStartSLOduration=1.783422908 podStartE2EDuration="3.189315138s" totalImagesPullingTime="1.40589223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:15:07.186860718 +0000 UTC m=+251.663518696" watchObservedRunningTime="2026-07-07 11:15:07.189315138 +0000 UTC m=+251.665973099" Jul 07 11:15:08.216216 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.216181 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz"] Jul 07 11:15:08.218543 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.218524 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" Jul 07 11:15:08.222548 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.222530 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 11:15:08.222842 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.222826 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5wltf\"" Jul 07 11:15:08.246027 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.246004 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 11:15:08.263263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.263243 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz"] Jul 07 11:15:08.310684 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.310663 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd5hg\" (UniqueName: \"kubernetes.io/projected/2cddd157-1811-4131-9a65-2e751fe3abc7-kube-api-access-dd5hg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz\" (UID: \"2cddd157-1811-4131-9a65-2e751fe3abc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" Jul 07 11:15:08.310790 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.310703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cddd157-1811-4131-9a65-2e751fe3abc7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz\" (UID: \"2cddd157-1811-4131-9a65-2e751fe3abc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" Jul 07 11:15:08.310790 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.310770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cddd157-1811-4131-9a65-2e751fe3abc7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz\" (UID: \"2cddd157-1811-4131-9a65-2e751fe3abc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" Jul 07 11:15:08.411213 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.411188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd5hg\" (UniqueName: \"kubernetes.io/projected/2cddd157-1811-4131-9a65-2e751fe3abc7-kube-api-access-dd5hg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz\" (UID: \"2cddd157-1811-4131-9a65-2e751fe3abc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" Jul 07 11:15:08.411309 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.411231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cddd157-1811-4131-9a65-2e751fe3abc7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz\" (UID: \"2cddd157-1811-4131-9a65-2e751fe3abc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" Jul 07 11:15:08.411309 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.411294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cddd157-1811-4131-9a65-2e751fe3abc7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz\" (UID: \"2cddd157-1811-4131-9a65-2e751fe3abc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" Jul 07 11:15:08.411718 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.411680 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cddd157-1811-4131-9a65-2e751fe3abc7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz\" (UID: \"2cddd157-1811-4131-9a65-2e751fe3abc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" Jul 07 11:15:08.411770 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.411714 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cddd157-1811-4131-9a65-2e751fe3abc7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz\" (UID: \"2cddd157-1811-4131-9a65-2e751fe3abc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" Jul 07 11:15:08.471489 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.471435 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd5hg\" (UniqueName: \"kubernetes.io/projected/2cddd157-1811-4131-9a65-2e751fe3abc7-kube-api-access-dd5hg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz\" (UID: \"2cddd157-1811-4131-9a65-2e751fe3abc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" Jul 07 11:15:08.527076 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.527056 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" Jul 07 11:15:08.720261 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:08.720229 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz"] Jul 07 11:15:08.724068 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:15:08.724042 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cddd157_1811_4131_9a65_2e751fe3abc7.slice/crio-a371bb0066e9d6a77ac24667cb0f9e4d626a5118cebd6668ff0e2f5e011fbdc5 WatchSource:0}: Error finding container a371bb0066e9d6a77ac24667cb0f9e4d626a5118cebd6668ff0e2f5e011fbdc5: Status 404 returned error can't find the container with id a371bb0066e9d6a77ac24667cb0f9e4d626a5118cebd6668ff0e2f5e011fbdc5 Jul 07 11:15:09.098664 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:09.098582 2576 generic.go:356] "Generic (PLEG): container finished" podID="2cddd157-1811-4131-9a65-2e751fe3abc7" containerID="9ab0f965f31acb482570e27b8d546b0bf30dcb24f7a1233d1fc1637dba5e3892" exitCode=0 Jul 07 11:15:09.098664 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:09.098644 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" event={"ID":"2cddd157-1811-4131-9a65-2e751fe3abc7","Type":"ContainerDied","Data":"9ab0f965f31acb482570e27b8d546b0bf30dcb24f7a1233d1fc1637dba5e3892"} Jul 07 11:15:09.098820 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:09.098688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" event={"ID":"2cddd157-1811-4131-9a65-2e751fe3abc7","Type":"ContainerStarted","Data":"a371bb0066e9d6a77ac24667cb0f9e4d626a5118cebd6668ff0e2f5e011fbdc5"} Jul 07 11:15:11.109653 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:11.109614 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" event={"ID":"2cddd157-1811-4131-9a65-2e751fe3abc7","Type":"ContainerStarted","Data":"ca90493101bd37abc86386fe1d1f551532b9cf6c4698e3d30499fa2fac5bb1e3"} Jul 07 11:15:12.114967 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:12.114929 2576 generic.go:356] "Generic (PLEG): container finished" podID="2cddd157-1811-4131-9a65-2e751fe3abc7" containerID="ca90493101bd37abc86386fe1d1f551532b9cf6c4698e3d30499fa2fac5bb1e3" exitCode=0 Jul 07 11:15:12.115366 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:12.115009 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" event={"ID":"2cddd157-1811-4131-9a65-2e751fe3abc7","Type":"ContainerDied","Data":"ca90493101bd37abc86386fe1d1f551532b9cf6c4698e3d30499fa2fac5bb1e3"} Jul 07 11:15:13.120522 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:13.120485 2576 generic.go:356] "Generic (PLEG): container finished" podID="2cddd157-1811-4131-9a65-2e751fe3abc7" containerID="b982d1c1bb12973a8c5dbc40a86bb8730352239ce13aaab60ae684cb5e802ab8" exitCode=0 Jul 07 11:15:13.120887 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:13.120522 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" event={"ID":"2cddd157-1811-4131-9a65-2e751fe3abc7","Type":"ContainerDied","Data":"b982d1c1bb12973a8c5dbc40a86bb8730352239ce13aaab60ae684cb5e802ab8"} Jul 07 11:15:14.253533 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:14.253510 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" Jul 07 11:15:14.358101 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:14.358072 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cddd157-1811-4131-9a65-2e751fe3abc7-util\") pod \"2cddd157-1811-4131-9a65-2e751fe3abc7\" (UID: \"2cddd157-1811-4131-9a65-2e751fe3abc7\") " Jul 07 11:15:14.358261 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:14.358127 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cddd157-1811-4131-9a65-2e751fe3abc7-bundle\") pod \"2cddd157-1811-4131-9a65-2e751fe3abc7\" (UID: \"2cddd157-1811-4131-9a65-2e751fe3abc7\") " Jul 07 11:15:14.358261 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:14.358178 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd5hg\" (UniqueName: \"kubernetes.io/projected/2cddd157-1811-4131-9a65-2e751fe3abc7-kube-api-access-dd5hg\") pod \"2cddd157-1811-4131-9a65-2e751fe3abc7\" (UID: \"2cddd157-1811-4131-9a65-2e751fe3abc7\") " Jul 07 11:15:14.358934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:14.358880 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cddd157-1811-4131-9a65-2e751fe3abc7-bundle" (OuterVolumeSpecName: "bundle") pod "2cddd157-1811-4131-9a65-2e751fe3abc7" (UID: "2cddd157-1811-4131-9a65-2e751fe3abc7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:15:14.364132 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:14.361185 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cddd157-1811-4131-9a65-2e751fe3abc7-kube-api-access-dd5hg" (OuterVolumeSpecName: "kube-api-access-dd5hg") pod "2cddd157-1811-4131-9a65-2e751fe3abc7" (UID: "2cddd157-1811-4131-9a65-2e751fe3abc7"). InnerVolumeSpecName "kube-api-access-dd5hg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:15:14.365126 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:14.365102 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cddd157-1811-4131-9a65-2e751fe3abc7-util" (OuterVolumeSpecName: "util") pod "2cddd157-1811-4131-9a65-2e751fe3abc7" (UID: "2cddd157-1811-4131-9a65-2e751fe3abc7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:15:14.459201 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:14.459179 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cddd157-1811-4131-9a65-2e751fe3abc7-util\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:15:14.459304 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:14.459218 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cddd157-1811-4131-9a65-2e751fe3abc7-bundle\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:15:14.459304 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:14.459228 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd5hg\" (UniqueName: \"kubernetes.io/projected/2cddd157-1811-4131-9a65-2e751fe3abc7-kube-api-access-dd5hg\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:15:15.130232 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:15.130198 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" event={"ID":"2cddd157-1811-4131-9a65-2e751fe3abc7","Type":"ContainerDied","Data":"a371bb0066e9d6a77ac24667cb0f9e4d626a5118cebd6668ff0e2f5e011fbdc5"} Jul 07 11:15:15.130385 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:15.130249 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxlhhz" Jul 07 11:15:15.130385 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:15.130253 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a371bb0066e9d6a77ac24667cb0f9e4d626a5118cebd6668ff0e2f5e011fbdc5" Jul 07 11:15:17.825125 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.825053 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b59gt"] Jul 07 11:15:17.825486 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.825344 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cddd157-1811-4131-9a65-2e751fe3abc7" containerName="pull" Jul 07 11:15:17.825486 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.825359 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cddd157-1811-4131-9a65-2e751fe3abc7" containerName="pull" Jul 07 11:15:17.825486 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.825379 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cddd157-1811-4131-9a65-2e751fe3abc7" containerName="util" Jul 07 11:15:17.825486 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.825384 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cddd157-1811-4131-9a65-2e751fe3abc7" containerName="util" Jul 07 11:15:17.825486 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.825408 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cddd157-1811-4131-9a65-2e751fe3abc7" containerName="extract" Jul 07 11:15:17.825486 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.825414 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cddd157-1811-4131-9a65-2e751fe3abc7" containerName="extract" Jul 07 11:15:17.825486 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.825463 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cddd157-1811-4131-9a65-2e751fe3abc7" containerName="extract" Jul 07 11:15:17.828207 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.828192 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-b59gt" Jul 07 11:15:17.831361 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.831342 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6bkcw\"" Jul 07 11:15:17.831505 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.831490 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 11:15:17.832374 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.832356 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 11:15:17.837968 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.837948 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b59gt"] Jul 07 11:15:17.881455 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.881428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34bb7b71-21a6-4c19-8654-5717d6fc5070-bound-sa-token\") pod \"cert-manager-55b4d954d5-b59gt\" (UID: \"34bb7b71-21a6-4c19-8654-5717d6fc5070\") " pod="cert-manager/cert-manager-55b4d954d5-b59gt" Jul 07 11:15:17.881584 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.881476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r68d\" (UniqueName: \"kubernetes.io/projected/34bb7b71-21a6-4c19-8654-5717d6fc5070-kube-api-access-8r68d\") pod \"cert-manager-55b4d954d5-b59gt\" (UID: \"34bb7b71-21a6-4c19-8654-5717d6fc5070\") " pod="cert-manager/cert-manager-55b4d954d5-b59gt" Jul 07 11:15:17.981830 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.981797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34bb7b71-21a6-4c19-8654-5717d6fc5070-bound-sa-token\") pod \"cert-manager-55b4d954d5-b59gt\" (UID: \"34bb7b71-21a6-4c19-8654-5717d6fc5070\") " pod="cert-manager/cert-manager-55b4d954d5-b59gt" Jul 07 11:15:17.981977 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.981845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r68d\" (UniqueName: \"kubernetes.io/projected/34bb7b71-21a6-4c19-8654-5717d6fc5070-kube-api-access-8r68d\") pod \"cert-manager-55b4d954d5-b59gt\" (UID: \"34bb7b71-21a6-4c19-8654-5717d6fc5070\") " pod="cert-manager/cert-manager-55b4d954d5-b59gt" Jul 07 11:15:17.991597 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.991565 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34bb7b71-21a6-4c19-8654-5717d6fc5070-bound-sa-token\") pod \"cert-manager-55b4d954d5-b59gt\" (UID: \"34bb7b71-21a6-4c19-8654-5717d6fc5070\") " pod="cert-manager/cert-manager-55b4d954d5-b59gt" Jul 07 11:15:17.991597 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:17.991582 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r68d\" (UniqueName: \"kubernetes.io/projected/34bb7b71-21a6-4c19-8654-5717d6fc5070-kube-api-access-8r68d\") pod \"cert-manager-55b4d954d5-b59gt\" (UID: \"34bb7b71-21a6-4c19-8654-5717d6fc5070\") " pod="cert-manager/cert-manager-55b4d954d5-b59gt" Jul 07 11:15:18.136941 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:18.136887 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-b59gt" Jul 07 11:15:18.267953 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:18.267932 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b59gt"] Jul 07 11:15:18.270183 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:15:18.270154 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34bb7b71_21a6_4c19_8654_5717d6fc5070.slice/crio-ec1a4e8e60516cc25dc9c1058e6cbf028d42fc141e0d495597060772da140c2b WatchSource:0}: Error finding container ec1a4e8e60516cc25dc9c1058e6cbf028d42fc141e0d495597060772da140c2b: Status 404 returned error can't find the container with id ec1a4e8e60516cc25dc9c1058e6cbf028d42fc141e0d495597060772da140c2b Jul 07 11:15:19.147245 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:19.147208 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-b59gt" event={"ID":"34bb7b71-21a6-4c19-8654-5717d6fc5070","Type":"ContainerStarted","Data":"ec1a4e8e60516cc25dc9c1058e6cbf028d42fc141e0d495597060772da140c2b"} Jul 07 11:15:20.974123 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:20.974094 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p2tf7"] Jul 07 11:15:20.987381 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:20.987356 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p2tf7" Jul 07 11:15:20.988124 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:20.988097 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p2tf7"] Jul 07 11:15:20.990584 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:20.990563 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 11:15:20.991889 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:20.991867 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 11:15:20.991989 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:20.991970 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-lwjfp\"" Jul 07 11:15:21.004600 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:21.004573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54wm8\" (UniqueName: \"kubernetes.io/projected/34ce3f60-f4ff-45e2-b92a-ce13c3f0e2ed-kube-api-access-54wm8\") pod \"openshift-lws-operator-fd8ccff4c-p2tf7\" (UID: \"34ce3f60-f4ff-45e2-b92a-ce13c3f0e2ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p2tf7" Jul 07 11:15:21.004705 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:21.004641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34ce3f60-f4ff-45e2-b92a-ce13c3f0e2ed-tmp\") pod \"openshift-lws-operator-fd8ccff4c-p2tf7\" (UID: \"34ce3f60-f4ff-45e2-b92a-ce13c3f0e2ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p2tf7" Jul 07 11:15:21.105931 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:21.105907 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34ce3f60-f4ff-45e2-b92a-ce13c3f0e2ed-tmp\") pod \"openshift-lws-operator-fd8ccff4c-p2tf7\" (UID: \"34ce3f60-f4ff-45e2-b92a-ce13c3f0e2ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p2tf7" Jul 07 11:15:21.106036 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:21.105979 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54wm8\" (UniqueName: \"kubernetes.io/projected/34ce3f60-f4ff-45e2-b92a-ce13c3f0e2ed-kube-api-access-54wm8\") pod \"openshift-lws-operator-fd8ccff4c-p2tf7\" (UID: \"34ce3f60-f4ff-45e2-b92a-ce13c3f0e2ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p2tf7" Jul 07 11:15:21.106222 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:21.106202 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34ce3f60-f4ff-45e2-b92a-ce13c3f0e2ed-tmp\") pod \"openshift-lws-operator-fd8ccff4c-p2tf7\" (UID: \"34ce3f60-f4ff-45e2-b92a-ce13c3f0e2ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p2tf7" Jul 07 11:15:21.115158 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:21.115139 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54wm8\" (UniqueName: \"kubernetes.io/projected/34ce3f60-f4ff-45e2-b92a-ce13c3f0e2ed-kube-api-access-54wm8\") pod \"openshift-lws-operator-fd8ccff4c-p2tf7\" (UID: \"34ce3f60-f4ff-45e2-b92a-ce13c3f0e2ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p2tf7" Jul 07 11:15:21.296918 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:21.296858 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p2tf7" Jul 07 11:15:21.524305 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:21.524273 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p2tf7"] Jul 07 11:15:21.528579 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:15:21.528550 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34ce3f60_f4ff_45e2_b92a_ce13c3f0e2ed.slice/crio-ea0f7b44d499c89783ba6c1d26e68593019a5bf8f162e57553ffa3c426e8ba3e WatchSource:0}: Error finding container ea0f7b44d499c89783ba6c1d26e68593019a5bf8f162e57553ffa3c426e8ba3e: Status 404 returned error can't find the container with id ea0f7b44d499c89783ba6c1d26e68593019a5bf8f162e57553ffa3c426e8ba3e Jul 07 11:15:22.161833 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:22.161794 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-b59gt" event={"ID":"34bb7b71-21a6-4c19-8654-5717d6fc5070","Type":"ContainerStarted","Data":"906fbfe0f2469cf3087c4b6b25c88cd55d4befee5e3357073975e861e667ee34"} Jul 07 11:15:22.163239 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:22.163212 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p2tf7" event={"ID":"34ce3f60-f4ff-45e2-b92a-ce13c3f0e2ed","Type":"ContainerStarted","Data":"ea0f7b44d499c89783ba6c1d26e68593019a5bf8f162e57553ffa3c426e8ba3e"} Jul 07 11:15:24.172631 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:24.172596 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p2tf7" event={"ID":"34ce3f60-f4ff-45e2-b92a-ce13c3f0e2ed","Type":"ContainerStarted","Data":"fde41aebcc08daaa87cba9f17d0b54f4efa6846f2068c0f4bbbaf015fa0ed7e8"} Jul 07 11:15:24.194026 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:24.193973 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-b59gt" podStartSLOduration=4.075362076 podStartE2EDuration="7.193952633s" totalImagesPullingTime="3.118590557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:15:22.204993273 +0000 UTC m=+266.681651235" watchObservedRunningTime="2026-07-07 11:15:24.193952633 +0000 UTC m=+268.670610597" Jul 07 11:15:24.194440 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:24.194412 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p2tf7" podStartSLOduration=2.318850064 podStartE2EDuration="4.194389056s" totalImagesPullingTime="1.875538992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:15:24.191479806 +0000 UTC m=+268.668137787" watchObservedRunningTime="2026-07-07 11:15:24.194389056 +0000 UTC m=+268.671047021" Jul 07 11:15:26.726436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:26.726406 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr"] Jul 07 11:15:26.728719 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:26.728699 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" Jul 07 11:15:26.731768 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:26.731738 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 11:15:26.732485 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:26.732468 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5wltf\"" Jul 07 11:15:26.732778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:26.732763 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 11:15:26.745437 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:26.745413 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr"] Jul 07 11:15:26.748325 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:26.748300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adb7392c-7a6c-4ad9-82c3-96001ee6db95-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr\" (UID: \"adb7392c-7a6c-4ad9-82c3-96001ee6db95\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" Jul 07 11:15:26.748432 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:26.748352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adb7392c-7a6c-4ad9-82c3-96001ee6db95-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr\" (UID: \"adb7392c-7a6c-4ad9-82c3-96001ee6db95\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" Jul 07 11:15:26.748499 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:26.748481 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkndt\" (UniqueName: \"kubernetes.io/projected/adb7392c-7a6c-4ad9-82c3-96001ee6db95-kube-api-access-vkndt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr\" (UID: \"adb7392c-7a6c-4ad9-82c3-96001ee6db95\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" Jul 07 11:15:26.848967 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:26.848938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adb7392c-7a6c-4ad9-82c3-96001ee6db95-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr\" (UID: \"adb7392c-7a6c-4ad9-82c3-96001ee6db95\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" Jul 07 11:15:26.849072 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:26.849022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkndt\" (UniqueName: \"kubernetes.io/projected/adb7392c-7a6c-4ad9-82c3-96001ee6db95-kube-api-access-vkndt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr\" (UID: \"adb7392c-7a6c-4ad9-82c3-96001ee6db95\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" Jul 07 11:15:26.849132 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:26.849071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adb7392c-7a6c-4ad9-82c3-96001ee6db95-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr\" (UID: \"adb7392c-7a6c-4ad9-82c3-96001ee6db95\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" Jul 07 11:15:26.849258 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:26.849239 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adb7392c-7a6c-4ad9-82c3-96001ee6db95-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr\" (UID: \"adb7392c-7a6c-4ad9-82c3-96001ee6db95\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" Jul 07 11:15:26.849375 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:26.849358 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adb7392c-7a6c-4ad9-82c3-96001ee6db95-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr\" (UID: \"adb7392c-7a6c-4ad9-82c3-96001ee6db95\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" Jul 07 11:15:26.860503 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:26.860470 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkndt\" (UniqueName: \"kubernetes.io/projected/adb7392c-7a6c-4ad9-82c3-96001ee6db95-kube-api-access-vkndt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr\" (UID: \"adb7392c-7a6c-4ad9-82c3-96001ee6db95\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" Jul 07 11:15:27.037312 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:27.037244 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" Jul 07 11:15:27.184158 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:27.184072 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr"] Jul 07 11:15:27.185433 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:15:27.185388 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb7392c_7a6c_4ad9_82c3_96001ee6db95.slice/crio-f727348d0b2facc65834793de8a45c027bc4788e31373e0bcb6c5c7fc006e1b1 WatchSource:0}: Error finding container f727348d0b2facc65834793de8a45c027bc4788e31373e0bcb6c5c7fc006e1b1: Status 404 returned error can't find the container with id f727348d0b2facc65834793de8a45c027bc4788e31373e0bcb6c5c7fc006e1b1 Jul 07 11:15:28.190182 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:28.190149 2576 generic.go:356] "Generic (PLEG): container finished" podID="adb7392c-7a6c-4ad9-82c3-96001ee6db95" containerID="348adfe082e8b12f0bf506eb9d1c8c45a03b8b63bdbadb2bf17ec12cd1020c69" exitCode=0 Jul 07 11:15:28.190650 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:28.190217 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" event={"ID":"adb7392c-7a6c-4ad9-82c3-96001ee6db95","Type":"ContainerDied","Data":"348adfe082e8b12f0bf506eb9d1c8c45a03b8b63bdbadb2bf17ec12cd1020c69"} Jul 07 11:15:28.190650 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:28.190261 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" event={"ID":"adb7392c-7a6c-4ad9-82c3-96001ee6db95","Type":"ContainerStarted","Data":"f727348d0b2facc65834793de8a45c027bc4788e31373e0bcb6c5c7fc006e1b1"} Jul 07 11:15:29.195632 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:29.195564 2576 generic.go:356] "Generic (PLEG): container finished" podID="adb7392c-7a6c-4ad9-82c3-96001ee6db95" containerID="d112ae53995006f9094f7702d991ed0b26a44b6845b4c36d8bc237e9c0ed6b5b" exitCode=0 Jul 07 11:15:29.196003 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:29.195651 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" event={"ID":"adb7392c-7a6c-4ad9-82c3-96001ee6db95","Type":"ContainerDied","Data":"d112ae53995006f9094f7702d991ed0b26a44b6845b4c36d8bc237e9c0ed6b5b"} Jul 07 11:15:30.201606 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:30.201573 2576 generic.go:356] "Generic (PLEG): container finished" podID="adb7392c-7a6c-4ad9-82c3-96001ee6db95" containerID="8823de2902aae4b590d121dd9445215c9e0a8b6928bb660eaa888f3d88d9b6b8" exitCode=0 Jul 07 11:15:30.201965 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:30.201660 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" event={"ID":"adb7392c-7a6c-4ad9-82c3-96001ee6db95","Type":"ContainerDied","Data":"8823de2902aae4b590d121dd9445215c9e0a8b6928bb660eaa888f3d88d9b6b8"} Jul 07 11:15:31.330665 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:31.330639 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" Jul 07 11:15:31.376109 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:31.376083 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkndt\" (UniqueName: \"kubernetes.io/projected/adb7392c-7a6c-4ad9-82c3-96001ee6db95-kube-api-access-vkndt\") pod \"adb7392c-7a6c-4ad9-82c3-96001ee6db95\" (UID: \"adb7392c-7a6c-4ad9-82c3-96001ee6db95\") " Jul 07 11:15:31.376228 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:31.376145 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adb7392c-7a6c-4ad9-82c3-96001ee6db95-bundle\") pod \"adb7392c-7a6c-4ad9-82c3-96001ee6db95\" (UID: \"adb7392c-7a6c-4ad9-82c3-96001ee6db95\") " Jul 07 11:15:31.376228 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:31.376171 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adb7392c-7a6c-4ad9-82c3-96001ee6db95-util\") pod \"adb7392c-7a6c-4ad9-82c3-96001ee6db95\" (UID: \"adb7392c-7a6c-4ad9-82c3-96001ee6db95\") " Jul 07 11:15:31.376875 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:31.376851 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adb7392c-7a6c-4ad9-82c3-96001ee6db95-bundle" (OuterVolumeSpecName: "bundle") pod "adb7392c-7a6c-4ad9-82c3-96001ee6db95" (UID: "adb7392c-7a6c-4ad9-82c3-96001ee6db95"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:15:31.378340 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:31.378311 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adb7392c-7a6c-4ad9-82c3-96001ee6db95-kube-api-access-vkndt" (OuterVolumeSpecName: "kube-api-access-vkndt") pod "adb7392c-7a6c-4ad9-82c3-96001ee6db95" (UID: "adb7392c-7a6c-4ad9-82c3-96001ee6db95"). InnerVolumeSpecName "kube-api-access-vkndt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:15:31.381578 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:31.381551 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adb7392c-7a6c-4ad9-82c3-96001ee6db95-util" (OuterVolumeSpecName: "util") pod "adb7392c-7a6c-4ad9-82c3-96001ee6db95" (UID: "adb7392c-7a6c-4ad9-82c3-96001ee6db95"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:15:31.477367 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:31.477312 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adb7392c-7a6c-4ad9-82c3-96001ee6db95-bundle\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:15:31.477367 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:31.477334 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adb7392c-7a6c-4ad9-82c3-96001ee6db95-util\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:15:31.477367 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:31.477343 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkndt\" (UniqueName: \"kubernetes.io/projected/adb7392c-7a6c-4ad9-82c3-96001ee6db95-kube-api-access-vkndt\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:15:32.212520 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:32.212493 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" event={"ID":"adb7392c-7a6c-4ad9-82c3-96001ee6db95","Type":"ContainerDied","Data":"f727348d0b2facc65834793de8a45c027bc4788e31373e0bcb6c5c7fc006e1b1"} Jul 07 11:15:32.212520 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:32.212518 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afldlkr" Jul 07 11:15:32.212724 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:32.212539 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f727348d0b2facc65834793de8a45c027bc4788e31373e0bcb6c5c7fc006e1b1" Jul 07 11:15:40.114387 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.114358 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm"] Jul 07 11:15:40.114772 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.114614 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb7392c-7a6c-4ad9-82c3-96001ee6db95" containerName="pull" Jul 07 11:15:40.114772 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.114625 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb7392c-7a6c-4ad9-82c3-96001ee6db95" containerName="pull" Jul 07 11:15:40.114772 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.114639 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb7392c-7a6c-4ad9-82c3-96001ee6db95" containerName="util" Jul 07 11:15:40.114772 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.114644 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb7392c-7a6c-4ad9-82c3-96001ee6db95" containerName="util" Jul 07 11:15:40.114772 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.114652 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb7392c-7a6c-4ad9-82c3-96001ee6db95" containerName="extract" Jul 07 11:15:40.114772 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.114657 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb7392c-7a6c-4ad9-82c3-96001ee6db95" containerName="extract" Jul 07 11:15:40.114772 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.114707 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="adb7392c-7a6c-4ad9-82c3-96001ee6db95" containerName="extract" Jul 07 11:15:40.116681 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.116665 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.120688 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.120665 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 11:15:40.120831 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.120734 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 11:15:40.121356 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.121332 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 11:15:40.121356 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.121342 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 11:15:40.121532 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.121460 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6xcdv\"" Jul 07 11:15:40.158491 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.158465 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm"] Jul 07 11:15:40.240210 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.240186 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/296d6f28-dc03-4019-a541-cca4f0ca91ab-manifests\") pod \"opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm\" (UID: \"296d6f28-dc03-4019-a541-cca4f0ca91ab\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.240312 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.240232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/296d6f28-dc03-4019-a541-cca4f0ca91ab-tmp\") pod \"opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm\" (UID: \"296d6f28-dc03-4019-a541-cca4f0ca91ab\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.240312 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.240256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsqzq\" (UniqueName: \"kubernetes.io/projected/296d6f28-dc03-4019-a541-cca4f0ca91ab-kube-api-access-bsqzq\") pod \"opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm\" (UID: \"296d6f28-dc03-4019-a541-cca4f0ca91ab\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.240312 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.240292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/296d6f28-dc03-4019-a541-cca4f0ca91ab-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm\" (UID: \"296d6f28-dc03-4019-a541-cca4f0ca91ab\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.240312 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.240308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/296d6f28-dc03-4019-a541-cca4f0ca91ab-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm\" (UID: \"296d6f28-dc03-4019-a541-cca4f0ca91ab\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.341336 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.341304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/296d6f28-dc03-4019-a541-cca4f0ca91ab-tmp\") pod \"opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm\" (UID: \"296d6f28-dc03-4019-a541-cca4f0ca91ab\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.341504 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.341345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsqzq\" (UniqueName: \"kubernetes.io/projected/296d6f28-dc03-4019-a541-cca4f0ca91ab-kube-api-access-bsqzq\") pod \"opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm\" (UID: \"296d6f28-dc03-4019-a541-cca4f0ca91ab\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.341504 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.341370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/296d6f28-dc03-4019-a541-cca4f0ca91ab-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm\" (UID: \"296d6f28-dc03-4019-a541-cca4f0ca91ab\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.341504 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.341415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/296d6f28-dc03-4019-a541-cca4f0ca91ab-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm\" (UID: \"296d6f28-dc03-4019-a541-cca4f0ca91ab\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.341504 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.341464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/296d6f28-dc03-4019-a541-cca4f0ca91ab-manifests\") pod \"opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm\" (UID: \"296d6f28-dc03-4019-a541-cca4f0ca91ab\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.341863 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.341839 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/296d6f28-dc03-4019-a541-cca4f0ca91ab-manifests\") pod \"opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm\" (UID: \"296d6f28-dc03-4019-a541-cca4f0ca91ab\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.343898 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.343877 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/296d6f28-dc03-4019-a541-cca4f0ca91ab-tmp\") pod \"opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm\" (UID: \"296d6f28-dc03-4019-a541-cca4f0ca91ab\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.343991 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.343971 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/296d6f28-dc03-4019-a541-cca4f0ca91ab-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm\" (UID: \"296d6f28-dc03-4019-a541-cca4f0ca91ab\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.344144 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.344128 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/296d6f28-dc03-4019-a541-cca4f0ca91ab-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm\" (UID: \"296d6f28-dc03-4019-a541-cca4f0ca91ab\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.372968 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.372912 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsqzq\" (UniqueName: \"kubernetes.io/projected/296d6f28-dc03-4019-a541-cca4f0ca91ab-kube-api-access-bsqzq\") pod \"opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm\" (UID: \"296d6f28-dc03-4019-a541-cca4f0ca91ab\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.426094 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.426070 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:40.595209 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:40.595178 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm"] Jul 07 11:15:40.599316 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:15:40.599288 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod296d6f28_dc03_4019_a541_cca4f0ca91ab.slice/crio-c33332b04155bc381a10194df66edc547f1191702962996b180a96ae360c2986 WatchSource:0}: Error finding container c33332b04155bc381a10194df66edc547f1191702962996b180a96ae360c2986: Status 404 returned error can't find the container with id c33332b04155bc381a10194df66edc547f1191702962996b180a96ae360c2986 Jul 07 11:15:41.256415 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:41.256359 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" event={"ID":"296d6f28-dc03-4019-a541-cca4f0ca91ab","Type":"ContainerStarted","Data":"c33332b04155bc381a10194df66edc547f1191702962996b180a96ae360c2986"} Jul 07 11:15:44.272527 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:44.272484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" event={"ID":"296d6f28-dc03-4019-a541-cca4f0ca91ab","Type":"ContainerStarted","Data":"020a41be6697e4a425a49028109047371de464756fee519cfe763cc7c44721cd"} Jul 07 11:15:45.277573 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:45.277484 2576 generic.go:356] "Generic (PLEG): container finished" podID="296d6f28-dc03-4019-a541-cca4f0ca91ab" containerID="020a41be6697e4a425a49028109047371de464756fee519cfe763cc7c44721cd" exitCode=0 Jul 07 11:15:45.277917 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:45.277565 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" event={"ID":"296d6f28-dc03-4019-a541-cca4f0ca91ab","Type":"ContainerDied","Data":"020a41be6697e4a425a49028109047371de464756fee519cfe763cc7c44721cd"} Jul 07 11:15:46.283865 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:46.283830 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" event={"ID":"296d6f28-dc03-4019-a541-cca4f0ca91ab","Type":"ContainerStarted","Data":"8e1ba99593fa0042d264b4da61fea057b6eb0e85fee3fd0168797f9fcaceaae1"} Jul 07 11:15:46.284246 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:46.283954 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:15:46.311800 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:46.311753 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" podStartSLOduration=1.658948128 podStartE2EDuration="6.311738436s" totalImagesPullingTime="3.569888261s" totalInitContainerRuntime="1.082902047s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:15:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:15:46.309931094 +0000 UTC m=+290.786589055" watchObservedRunningTime="2026-07-07 11:15:46.311738436 +0000 UTC m=+290.788396397" Jul 07 11:15:55.957498 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:55.957462 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 11:15:57.290526 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:15:57.290494 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm" Jul 07 11:16:00.761306 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:00.761267 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tdpw6"] Jul 07 11:16:00.763328 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:00.763311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tdpw6" Jul 07 11:16:00.766160 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:00.766141 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 07 11:16:00.779665 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:00.779638 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tdpw6"] Jul 07 11:16:00.913134 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:00.913098 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl2vt\" (UniqueName: \"kubernetes.io/projected/93317f79-bc39-4dda-aa71-de6124939709-kube-api-access-tl2vt\") pod \"model-serving-api-54d89bd5fc-tdpw6\" (UID: \"93317f79-bc39-4dda-aa71-de6124939709\") " pod="opendatahub/model-serving-api-54d89bd5fc-tdpw6" Jul 07 11:16:00.913306 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:00.913169 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93317f79-bc39-4dda-aa71-de6124939709-tls-certs\") pod \"model-serving-api-54d89bd5fc-tdpw6\" (UID: \"93317f79-bc39-4dda-aa71-de6124939709\") " pod="opendatahub/model-serving-api-54d89bd5fc-tdpw6" Jul 07 11:16:01.013661 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:01.013567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93317f79-bc39-4dda-aa71-de6124939709-tls-certs\") pod \"model-serving-api-54d89bd5fc-tdpw6\" (UID: \"93317f79-bc39-4dda-aa71-de6124939709\") " pod="opendatahub/model-serving-api-54d89bd5fc-tdpw6" Jul 07 11:16:01.013661 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:01.013621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl2vt\" (UniqueName: \"kubernetes.io/projected/93317f79-bc39-4dda-aa71-de6124939709-kube-api-access-tl2vt\") pod \"model-serving-api-54d89bd5fc-tdpw6\" (UID: \"93317f79-bc39-4dda-aa71-de6124939709\") " pod="opendatahub/model-serving-api-54d89bd5fc-tdpw6" Jul 07 11:16:01.016216 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:01.016189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93317f79-bc39-4dda-aa71-de6124939709-tls-certs\") pod \"model-serving-api-54d89bd5fc-tdpw6\" (UID: \"93317f79-bc39-4dda-aa71-de6124939709\") " pod="opendatahub/model-serving-api-54d89bd5fc-tdpw6" Jul 07 11:16:01.022138 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:01.022111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl2vt\" (UniqueName: \"kubernetes.io/projected/93317f79-bc39-4dda-aa71-de6124939709-kube-api-access-tl2vt\") pod \"model-serving-api-54d89bd5fc-tdpw6\" (UID: \"93317f79-bc39-4dda-aa71-de6124939709\") " pod="opendatahub/model-serving-api-54d89bd5fc-tdpw6" Jul 07 11:16:01.073657 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:01.073632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tdpw6" Jul 07 11:16:01.210121 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:01.210093 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tdpw6"] Jul 07 11:16:01.213546 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:16:01.213519 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93317f79_bc39_4dda_aa71_de6124939709.slice/crio-af3e140b841766198fe6c135148befd16776044d1b3c4a4f45a74a222faf035a WatchSource:0}: Error finding container af3e140b841766198fe6c135148befd16776044d1b3c4a4f45a74a222faf035a: Status 404 returned error can't find the container with id af3e140b841766198fe6c135148befd16776044d1b3c4a4f45a74a222faf035a Jul 07 11:16:01.215387 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:01.215368 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 11:16:01.348157 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:01.348075 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tdpw6" event={"ID":"93317f79-bc39-4dda-aa71-de6124939709","Type":"ContainerStarted","Data":"af3e140b841766198fe6c135148befd16776044d1b3c4a4f45a74a222faf035a"} Jul 07 11:16:03.358726 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:03.358681 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tdpw6" event={"ID":"93317f79-bc39-4dda-aa71-de6124939709","Type":"ContainerStarted","Data":"419a0e1a9b388fe2205acb1d1a4b5466957bc82c5c0374c8e7509b4809a7ad87"} Jul 07 11:16:03.359181 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:03.358755 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tdpw6" Jul 07 11:16:03.393971 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:03.393910 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tdpw6" podStartSLOduration=1.428741158 podStartE2EDuration="3.393893151s" totalImagesPullingTime="1.965151993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:16:03.391658579 +0000 UTC m=+307.868316539" watchObservedRunningTime="2026-07-07 11:16:03.393893151 +0000 UTC m=+307.870551111" Jul 07 11:16:05.401952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:05.401907 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx"] Jul 07 11:16:05.404477 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:05.404454 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx" Jul 07 11:16:05.409043 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:05.409020 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 11:16:05.409293 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:05.409278 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 11:16:05.409617 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:05.409596 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 11:16:05.414005 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:05.413986 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 11:16:05.497490 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:05.497455 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx"] Jul 07 11:16:05.557011 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:05.556971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7nm4\" (UniqueName: \"kubernetes.io/projected/6e87dafe-49d0-426a-9c58-6220a6cb9ec7-kube-api-access-j7nm4\") pod \"kube-auth-proxy-5df5f4cc47-vbxbx\" (UID: \"6e87dafe-49d0-426a-9c58-6220a6cb9ec7\") " pod="openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx" Jul 07 11:16:05.557011 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:05.557008 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e87dafe-49d0-426a-9c58-6220a6cb9ec7-tmp\") pod \"kube-auth-proxy-5df5f4cc47-vbxbx\" (UID: \"6e87dafe-49d0-426a-9c58-6220a6cb9ec7\") " pod="openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx" Jul 07 11:16:05.557265 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:05.557052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e87dafe-49d0-426a-9c58-6220a6cb9ec7-tls-certs\") pod \"kube-auth-proxy-5df5f4cc47-vbxbx\" (UID: \"6e87dafe-49d0-426a-9c58-6220a6cb9ec7\") " pod="openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx" Jul 07 11:16:05.658380 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:05.658283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e87dafe-49d0-426a-9c58-6220a6cb9ec7-tls-certs\") pod \"kube-auth-proxy-5df5f4cc47-vbxbx\" (UID: \"6e87dafe-49d0-426a-9c58-6220a6cb9ec7\") " pod="openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx" Jul 07 11:16:05.658380 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:05.658348 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7nm4\" (UniqueName: \"kubernetes.io/projected/6e87dafe-49d0-426a-9c58-6220a6cb9ec7-kube-api-access-j7nm4\") pod \"kube-auth-proxy-5df5f4cc47-vbxbx\" (UID: \"6e87dafe-49d0-426a-9c58-6220a6cb9ec7\") " pod="openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx" Jul 07 11:16:05.658380 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:05.658375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e87dafe-49d0-426a-9c58-6220a6cb9ec7-tmp\") pod \"kube-auth-proxy-5df5f4cc47-vbxbx\" (UID: \"6e87dafe-49d0-426a-9c58-6220a6cb9ec7\") " pod="openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx" Jul 07 11:16:05.658668 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:16:05.658463 2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 07 11:16:05.658668 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:16:05.658532 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e87dafe-49d0-426a-9c58-6220a6cb9ec7-tls-certs podName:6e87dafe-49d0-426a-9c58-6220a6cb9ec7 nodeName:}" failed. No retries permitted until 2026-07-07 11:16:06.158514954 +0000 UTC m=+310.635172897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6e87dafe-49d0-426a-9c58-6220a6cb9ec7-tls-certs") pod "kube-auth-proxy-5df5f4cc47-vbxbx" (UID: "6e87dafe-49d0-426a-9c58-6220a6cb9ec7") : secret "kube-auth-proxy-tls" not found Jul 07 11:16:05.660911 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:05.660879 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e87dafe-49d0-426a-9c58-6220a6cb9ec7-tmp\") pod \"kube-auth-proxy-5df5f4cc47-vbxbx\" (UID: \"6e87dafe-49d0-426a-9c58-6220a6cb9ec7\") " pod="openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx" Jul 07 11:16:05.678234 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:05.678203 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7nm4\" (UniqueName: \"kubernetes.io/projected/6e87dafe-49d0-426a-9c58-6220a6cb9ec7-kube-api-access-j7nm4\") pod \"kube-auth-proxy-5df5f4cc47-vbxbx\" (UID: \"6e87dafe-49d0-426a-9c58-6220a6cb9ec7\") " pod="openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx" Jul 07 11:16:06.162723 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:06.162680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e87dafe-49d0-426a-9c58-6220a6cb9ec7-tls-certs\") pod \"kube-auth-proxy-5df5f4cc47-vbxbx\" (UID: \"6e87dafe-49d0-426a-9c58-6220a6cb9ec7\") " pod="openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx" Jul 07 11:16:06.165337 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:06.165307 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e87dafe-49d0-426a-9c58-6220a6cb9ec7-tls-certs\") pod \"kube-auth-proxy-5df5f4cc47-vbxbx\" (UID: \"6e87dafe-49d0-426a-9c58-6220a6cb9ec7\") " pod="openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx" Jul 07 11:16:06.313998 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:06.313961 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx" Jul 07 11:16:06.463204 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:06.463114 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx"] Jul 07 11:16:06.468458 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:16:06.468429 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e87dafe_49d0_426a_9c58_6220a6cb9ec7.slice/crio-b51497f538a6daec5717085bfce5992b9bc0a4dfd8167d87e778c7688ec90dbb WatchSource:0}: Error finding container b51497f538a6daec5717085bfce5992b9bc0a4dfd8167d87e778c7688ec90dbb: Status 404 returned error can't find the container with id b51497f538a6daec5717085bfce5992b9bc0a4dfd8167d87e778c7688ec90dbb Jul 07 11:16:07.379070 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.379033 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx" event={"ID":"6e87dafe-49d0-426a-9c58-6220a6cb9ec7","Type":"ContainerStarted","Data":"b51497f538a6daec5717085bfce5992b9bc0a4dfd8167d87e778c7688ec90dbb"} Jul 07 11:16:07.783667 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.783633 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9"] Jul 07 11:16:07.788516 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.788487 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.791190 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.791165 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 11:16:07.791632 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.791511 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 11:16:07.791833 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.791810 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zstth\"" Jul 07 11:16:07.792185 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.792166 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 11:16:07.792185 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.792176 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 11:16:07.805907 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.805885 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9"] Jul 07 11:16:07.878156 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.878121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/387bde3b-2aa7-4e0b-9714-f40f1500c301-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.878156 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.878159 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zmg6\" (UniqueName: \"kubernetes.io/projected/387bde3b-2aa7-4e0b-9714-f40f1500c301-kube-api-access-8zmg6\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.878454 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.878181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/387bde3b-2aa7-4e0b-9714-f40f1500c301-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.878454 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.878206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/387bde3b-2aa7-4e0b-9714-f40f1500c301-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.878454 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.878247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/387bde3b-2aa7-4e0b-9714-f40f1500c301-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.878454 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.878271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/387bde3b-2aa7-4e0b-9714-f40f1500c301-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.878454 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.878344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/387bde3b-2aa7-4e0b-9714-f40f1500c301-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.979186 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.979153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/387bde3b-2aa7-4e0b-9714-f40f1500c301-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.979186 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.979189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zmg6\" (UniqueName: \"kubernetes.io/projected/387bde3b-2aa7-4e0b-9714-f40f1500c301-kube-api-access-8zmg6\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.979421 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.979208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/387bde3b-2aa7-4e0b-9714-f40f1500c301-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.979421 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.979259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/387bde3b-2aa7-4e0b-9714-f40f1500c301-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.979421 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.979290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/387bde3b-2aa7-4e0b-9714-f40f1500c301-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.979421 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.979333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/387bde3b-2aa7-4e0b-9714-f40f1500c301-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.979616 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.979475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/387bde3b-2aa7-4e0b-9714-f40f1500c301-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.979886 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.979857 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/387bde3b-2aa7-4e0b-9714-f40f1500c301-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.981848 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.981819 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/387bde3b-2aa7-4e0b-9714-f40f1500c301-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.981946 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.981900 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/387bde3b-2aa7-4e0b-9714-f40f1500c301-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.982105 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.982086 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/387bde3b-2aa7-4e0b-9714-f40f1500c301-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.982294 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.982271 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/387bde3b-2aa7-4e0b-9714-f40f1500c301-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.989509 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.989483 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zmg6\" (UniqueName: \"kubernetes.io/projected/387bde3b-2aa7-4e0b-9714-f40f1500c301-kube-api-access-8zmg6\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:07.989655 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:07.989628 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/387bde3b-2aa7-4e0b-9714-f40f1500c301-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kb4t9\" (UID: \"387bde3b-2aa7-4e0b-9714-f40f1500c301\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:08.100507 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:08.100420 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:08.286456 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:08.285991 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9"] Jul 07 11:16:08.385413 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:08.385327 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" event={"ID":"387bde3b-2aa7-4e0b-9714-f40f1500c301","Type":"ContainerStarted","Data":"1bd3cb8f0ab4387cb017766b8feab09e33c09846851f024ae5e0e98eae3b1eec"} Jul 07 11:16:10.396775 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:10.396731 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx" event={"ID":"6e87dafe-49d0-426a-9c58-6220a6cb9ec7","Type":"ContainerStarted","Data":"8eef649f57a875f0039e4d781b760c056eb5f7d80822d88e2bb4d3ebb0fb6a01"} Jul 07 11:16:10.423194 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:10.423145 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5df5f4cc47-vbxbx" podStartSLOduration=2.086178897 podStartE2EDuration="5.423123743s" totalImagesPullingTime="3.336944846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:16:10.422079082 +0000 UTC m=+314.898737044" watchObservedRunningTime="2026-07-07 11:16:10.423123743 +0000 UTC m=+314.899781704" Jul 07 11:16:11.603642 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:11.603594 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:16:11.603924 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:11.603671 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:16:12.408496 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:12.408460 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" event={"ID":"387bde3b-2aa7-4e0b-9714-f40f1500c301","Type":"ContainerStarted","Data":"ddda19bad81d02d89749c81c3f845db15b755f3b0bea02723f9ed97242000c9f"} Jul 07 11:16:12.408678 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:12.408657 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:12.410296 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:12.410268 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-kb4t9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 11:16:12.410371 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:12.410323 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" podUID="387bde3b-2aa7-4e0b-9714-f40f1500c301" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 11:16:12.437019 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:12.436972 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" podStartSLOduration=2.14360057 podStartE2EDuration="5.436956689s" totalImagesPullingTime="3.293356119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:16:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:16:12.436510636 +0000 UTC m=+316.913168597" watchObservedRunningTime="2026-07-07 11:16:12.436956689 +0000 UTC m=+316.913614649" Jul 07 11:16:13.373028 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.372988 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz"] Jul 07 11:16:13.375247 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.375225 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.379611 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.379588 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-85drz\"" Jul 07 11:16:13.394716 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.394689 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz"] Jul 07 11:16:13.413512 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.413493 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kb4t9" Jul 07 11:16:13.522947 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.522919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.523076 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.522953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.523076 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.523009 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.523076 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.523034 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.523076 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.523051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.523260 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.523075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.523260 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.523095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.523260 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.523244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjxzz\" (UniqueName: \"kubernetes.io/projected/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-kube-api-access-cjxzz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.523448 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.523421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.624652 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.624554 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjxzz\" (UniqueName: \"kubernetes.io/projected/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-kube-api-access-cjxzz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.624652 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.624614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.624874 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.624663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.624874 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.624683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.624874 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.624705 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.624874 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.624724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.624874 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.624749 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.624874 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.624772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.624874 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.624797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.625251 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.625045 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.625251 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.625093 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.625251 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.625128 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.625389 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.625294 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.625634 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.625574 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.627145 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.627121 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.627292 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.627268 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.647642 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.647621 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjxzz\" (UniqueName: \"kubernetes.io/projected/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-kube-api-access-cjxzz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.648504 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.648489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c7a195e-3e93-46f5-b22d-a9bd05fa460e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42p6hz\" (UID: \"0c7a195e-3e93-46f5-b22d-a9bd05fa460e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.686658 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.686622 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:13.854101 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:13.854076 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz"] Jul 07 11:16:13.856308 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:16:13.856263 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7a195e_3e93_46f5_b22d_a9bd05fa460e.slice/crio-69d98971e3796fe484419852bfe4c35c5cd595224cb54da14f6e118ce8dc704f WatchSource:0}: Error finding container 69d98971e3796fe484419852bfe4c35c5cd595224cb54da14f6e118ce8dc704f: Status 404 returned error can't find the container with id 69d98971e3796fe484419852bfe4c35c5cd595224cb54da14f6e118ce8dc704f Jul 07 11:16:14.367329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:14.367295 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tdpw6" Jul 07 11:16:14.418625 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:14.418586 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" event={"ID":"0c7a195e-3e93-46f5-b22d-a9bd05fa460e","Type":"ContainerStarted","Data":"69d98971e3796fe484419852bfe4c35c5cd595224cb54da14f6e118ce8dc704f"} Jul 07 11:16:16.414041 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:16.413995 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:16:16.414323 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:16.414087 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:16:16.414323 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:16.414120 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:16:17.435460 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:17.435423 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" event={"ID":"0c7a195e-3e93-46f5-b22d-a9bd05fa460e","Type":"ContainerStarted","Data":"389cc4cfe0a7d57b8348d5a1213750aecba17a2b8c328a0880d44de95aac38dd"} Jul 07 11:16:17.479670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:17.479603 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" podStartSLOduration=1.924402953 podStartE2EDuration="4.479582384s" totalImagesPullingTime="2.555179431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:16:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:16:17.478208555 +0000 UTC m=+321.954866542" watchObservedRunningTime="2026-07-07 11:16:17.479582384 +0000 UTC m=+321.956240346" Jul 07 11:16:17.687753 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:17.687675 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:17.692066 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:17.692042 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:18.439756 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:18.439721 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:16:18.440516 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:16:18.440496 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42p6hz" Jul 07 11:17:15.270025 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.269955 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc"] Jul 07 11:17:15.272567 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.272551 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" Jul 07 11:17:15.275573 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.275552 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 11:17:15.275704 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.275620 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wwlh8\"" Jul 07 11:17:15.276643 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.276628 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 11:17:15.282092 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.282073 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc"] Jul 07 11:17:15.392728 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.392703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9srx7\" (UniqueName: \"kubernetes.io/projected/9caa147b-1a48-4d79-b10f-311e40b7b291-kube-api-access-9srx7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc\" (UID: \"9caa147b-1a48-4d79-b10f-311e40b7b291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" Jul 07 11:17:15.392878 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.392759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9caa147b-1a48-4d79-b10f-311e40b7b291-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc\" (UID: \"9caa147b-1a48-4d79-b10f-311e40b7b291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" Jul 07 11:17:15.392878 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.392829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9caa147b-1a48-4d79-b10f-311e40b7b291-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc\" (UID: \"9caa147b-1a48-4d79-b10f-311e40b7b291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" Jul 07 11:17:15.494144 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.494119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9srx7\" (UniqueName: \"kubernetes.io/projected/9caa147b-1a48-4d79-b10f-311e40b7b291-kube-api-access-9srx7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc\" (UID: \"9caa147b-1a48-4d79-b10f-311e40b7b291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" Jul 07 11:17:15.494247 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.494174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9caa147b-1a48-4d79-b10f-311e40b7b291-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc\" (UID: \"9caa147b-1a48-4d79-b10f-311e40b7b291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" Jul 07 11:17:15.494247 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.494202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9caa147b-1a48-4d79-b10f-311e40b7b291-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc\" (UID: \"9caa147b-1a48-4d79-b10f-311e40b7b291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" Jul 07 11:17:15.494546 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.494531 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9caa147b-1a48-4d79-b10f-311e40b7b291-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc\" (UID: \"9caa147b-1a48-4d79-b10f-311e40b7b291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" Jul 07 11:17:15.494587 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.494566 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9caa147b-1a48-4d79-b10f-311e40b7b291-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc\" (UID: \"9caa147b-1a48-4d79-b10f-311e40b7b291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" Jul 07 11:17:15.504955 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.504932 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9srx7\" (UniqueName: \"kubernetes.io/projected/9caa147b-1a48-4d79-b10f-311e40b7b291-kube-api-access-9srx7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc\" (UID: \"9caa147b-1a48-4d79-b10f-311e40b7b291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" Jul 07 11:17:15.582921 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.582861 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" Jul 07 11:17:15.665595 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.665567 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm"] Jul 07 11:17:15.668743 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.668718 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" Jul 07 11:17:15.679271 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.679248 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm"] Jul 07 11:17:15.724132 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.724097 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc"] Jul 07 11:17:15.726304 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:17:15.726280 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9caa147b_1a48_4d79_b10f_311e40b7b291.slice/crio-9e8ac609054f99965d9ab151e4b3d196f420adff8262657920269e5564f59f93 WatchSource:0}: Error finding container 9e8ac609054f99965d9ab151e4b3d196f420adff8262657920269e5564f59f93: Status 404 returned error can't find the container with id 9e8ac609054f99965d9ab151e4b3d196f420adff8262657920269e5564f59f93 Jul 07 11:17:15.797161 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.797136 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73dce630-9f3e-425f-9e36-595127c39459-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm\" (UID: \"73dce630-9f3e-425f-9e36-595127c39459\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" Jul 07 11:17:15.797268 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.797180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lplsf\" (UniqueName: \"kubernetes.io/projected/73dce630-9f3e-425f-9e36-595127c39459-kube-api-access-lplsf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm\" (UID: \"73dce630-9f3e-425f-9e36-595127c39459\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" Jul 07 11:17:15.797268 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.797217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73dce630-9f3e-425f-9e36-595127c39459-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm\" (UID: \"73dce630-9f3e-425f-9e36-595127c39459\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" Jul 07 11:17:15.898447 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.898362 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lplsf\" (UniqueName: \"kubernetes.io/projected/73dce630-9f3e-425f-9e36-595127c39459-kube-api-access-lplsf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm\" (UID: \"73dce630-9f3e-425f-9e36-595127c39459\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" Jul 07 11:17:15.898447 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.898421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73dce630-9f3e-425f-9e36-595127c39459-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm\" (UID: \"73dce630-9f3e-425f-9e36-595127c39459\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" Jul 07 11:17:15.898623 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.898487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73dce630-9f3e-425f-9e36-595127c39459-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm\" (UID: \"73dce630-9f3e-425f-9e36-595127c39459\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" Jul 07 11:17:15.898815 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.898794 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73dce630-9f3e-425f-9e36-595127c39459-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm\" (UID: \"73dce630-9f3e-425f-9e36-595127c39459\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" Jul 07 11:17:15.898868 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.898809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73dce630-9f3e-425f-9e36-595127c39459-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm\" (UID: \"73dce630-9f3e-425f-9e36-595127c39459\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" Jul 07 11:17:15.907997 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.907976 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lplsf\" (UniqueName: \"kubernetes.io/projected/73dce630-9f3e-425f-9e36-595127c39459-kube-api-access-lplsf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm\" (UID: \"73dce630-9f3e-425f-9e36-595127c39459\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" Jul 07 11:17:15.981470 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:15.981450 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" Jul 07 11:17:16.057415 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.057359 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd"] Jul 07 11:17:16.059713 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.059692 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" Jul 07 11:17:16.071429 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.070956 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd"] Jul 07 11:17:16.116790 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.116769 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm"] Jul 07 11:17:16.118862 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:17:16.118840 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73dce630_9f3e_425f_9e36_595127c39459.slice/crio-2167cae2c3070ffce1092f48bea4afc888be5640df104df584f8061094fc2d69 WatchSource:0}: Error finding container 2167cae2c3070ffce1092f48bea4afc888be5640df104df584f8061094fc2d69: Status 404 returned error can't find the container with id 2167cae2c3070ffce1092f48bea4afc888be5640df104df584f8061094fc2d69 Jul 07 11:17:16.200864 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.200762 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml5c6\" (UniqueName: \"kubernetes.io/projected/46dbb5de-ff69-4a3b-8b57-48733d0848f1-kube-api-access-ml5c6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd\" (UID: \"46dbb5de-ff69-4a3b-8b57-48733d0848f1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" Jul 07 11:17:16.200864 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.200809 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46dbb5de-ff69-4a3b-8b57-48733d0848f1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd\" (UID: \"46dbb5de-ff69-4a3b-8b57-48733d0848f1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" Jul 07 11:17:16.201044 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.200934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46dbb5de-ff69-4a3b-8b57-48733d0848f1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd\" (UID: \"46dbb5de-ff69-4a3b-8b57-48733d0848f1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" Jul 07 11:17:16.302251 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.302218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml5c6\" (UniqueName: \"kubernetes.io/projected/46dbb5de-ff69-4a3b-8b57-48733d0848f1-kube-api-access-ml5c6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd\" (UID: \"46dbb5de-ff69-4a3b-8b57-48733d0848f1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" Jul 07 11:17:16.302598 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.302274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46dbb5de-ff69-4a3b-8b57-48733d0848f1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd\" (UID: \"46dbb5de-ff69-4a3b-8b57-48733d0848f1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" Jul 07 11:17:16.302598 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.302336 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46dbb5de-ff69-4a3b-8b57-48733d0848f1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd\" (UID: \"46dbb5de-ff69-4a3b-8b57-48733d0848f1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" Jul 07 11:17:16.302671 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.302612 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46dbb5de-ff69-4a3b-8b57-48733d0848f1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd\" (UID: \"46dbb5de-ff69-4a3b-8b57-48733d0848f1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" Jul 07 11:17:16.302671 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.302646 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46dbb5de-ff69-4a3b-8b57-48733d0848f1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd\" (UID: \"46dbb5de-ff69-4a3b-8b57-48733d0848f1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" Jul 07 11:17:16.311035 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.311009 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml5c6\" (UniqueName: \"kubernetes.io/projected/46dbb5de-ff69-4a3b-8b57-48733d0848f1-kube-api-access-ml5c6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd\" (UID: \"46dbb5de-ff69-4a3b-8b57-48733d0848f1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" Jul 07 11:17:16.374151 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.374131 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" Jul 07 11:17:16.460474 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.460433 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp"] Jul 07 11:17:16.464063 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.464039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" Jul 07 11:17:16.473126 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.473102 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp"] Jul 07 11:17:16.511483 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.511413 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd"] Jul 07 11:17:16.513450 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:17:16.513421 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46dbb5de_ff69_4a3b_8b57_48733d0848f1.slice/crio-3f486a7e57007d30cd745f15246495bad834b51140fc0cbdda58c9d6bdaa17ac WatchSource:0}: Error finding container 3f486a7e57007d30cd745f15246495bad834b51140fc0cbdda58c9d6bdaa17ac: Status 404 returned error can't find the container with id 3f486a7e57007d30cd745f15246495bad834b51140fc0cbdda58c9d6bdaa17ac Jul 07 11:17:16.604476 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.604444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp\" (UID: \"f15cec8a-6444-4864-b5da-5ea9dd0fa56e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" Jul 07 11:17:16.604629 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.604496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp\" (UID: \"f15cec8a-6444-4864-b5da-5ea9dd0fa56e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" Jul 07 11:17:16.604674 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.604640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhzzj\" (UniqueName: \"kubernetes.io/projected/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-kube-api-access-lhzzj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp\" (UID: \"f15cec8a-6444-4864-b5da-5ea9dd0fa56e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" Jul 07 11:17:16.705050 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.704982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp\" (UID: \"f15cec8a-6444-4864-b5da-5ea9dd0fa56e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" Jul 07 11:17:16.705050 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.705032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp\" (UID: \"f15cec8a-6444-4864-b5da-5ea9dd0fa56e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" Jul 07 11:17:16.705243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.705099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhzzj\" (UniqueName: \"kubernetes.io/projected/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-kube-api-access-lhzzj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp\" (UID: \"f15cec8a-6444-4864-b5da-5ea9dd0fa56e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" Jul 07 11:17:16.705445 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.705392 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp\" (UID: \"f15cec8a-6444-4864-b5da-5ea9dd0fa56e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" Jul 07 11:17:16.705543 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.705480 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp\" (UID: \"f15cec8a-6444-4864-b5da-5ea9dd0fa56e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" Jul 07 11:17:16.705960 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.705935 2576 generic.go:356] "Generic (PLEG): container finished" podID="73dce630-9f3e-425f-9e36-595127c39459" containerID="a599c7812a4d57ccaea55c17145c030667cbf46096bcea69503290ad1fb13904" exitCode=0 Jul 07 11:17:16.706054 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.706016 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" event={"ID":"73dce630-9f3e-425f-9e36-595127c39459","Type":"ContainerDied","Data":"a599c7812a4d57ccaea55c17145c030667cbf46096bcea69503290ad1fb13904"} Jul 07 11:17:16.706110 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.706100 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" event={"ID":"73dce630-9f3e-425f-9e36-595127c39459","Type":"ContainerStarted","Data":"2167cae2c3070ffce1092f48bea4afc888be5640df104df584f8061094fc2d69"} Jul 07 11:17:16.707624 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.707603 2576 generic.go:356] "Generic (PLEG): container finished" podID="9caa147b-1a48-4d79-b10f-311e40b7b291" containerID="11e5bd2b33eb8f5714506c9f9af5bdeb38c5075af618c83f156207bd3cb51c06" exitCode=0 Jul 07 11:17:16.707770 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.707667 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" event={"ID":"9caa147b-1a48-4d79-b10f-311e40b7b291","Type":"ContainerDied","Data":"11e5bd2b33eb8f5714506c9f9af5bdeb38c5075af618c83f156207bd3cb51c06"} Jul 07 11:17:16.707770 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.707708 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" event={"ID":"9caa147b-1a48-4d79-b10f-311e40b7b291","Type":"ContainerStarted","Data":"9e8ac609054f99965d9ab151e4b3d196f420adff8262657920269e5564f59f93"} Jul 07 11:17:16.709336 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.709315 2576 generic.go:356] "Generic (PLEG): container finished" podID="46dbb5de-ff69-4a3b-8b57-48733d0848f1" containerID="3d3ad3bc8d5cd20a694cf7dcfe75a1c9ac7edef96d72a3f382b9ffa268c15bbb" exitCode=0 Jul 07 11:17:16.709470 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.709338 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" event={"ID":"46dbb5de-ff69-4a3b-8b57-48733d0848f1","Type":"ContainerDied","Data":"3d3ad3bc8d5cd20a694cf7dcfe75a1c9ac7edef96d72a3f382b9ffa268c15bbb"} Jul 07 11:17:16.709470 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.709387 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" event={"ID":"46dbb5de-ff69-4a3b-8b57-48733d0848f1","Type":"ContainerStarted","Data":"3f486a7e57007d30cd745f15246495bad834b51140fc0cbdda58c9d6bdaa17ac"} Jul 07 11:17:16.715824 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.715806 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhzzj\" (UniqueName: \"kubernetes.io/projected/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-kube-api-access-lhzzj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp\" (UID: \"f15cec8a-6444-4864-b5da-5ea9dd0fa56e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" Jul 07 11:17:16.774818 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.774793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" Jul 07 11:17:16.906860 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:16.906824 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp"] Jul 07 11:17:16.908309 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:17:16.908278 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf15cec8a_6444_4864_b5da_5ea9dd0fa56e.slice/crio-4ca763ca0d0a1dc45cef8eb430b01cb93f8ee2834e015d9f61c6feb30f8df7d8 WatchSource:0}: Error finding container 4ca763ca0d0a1dc45cef8eb430b01cb93f8ee2834e015d9f61c6feb30f8df7d8: Status 404 returned error can't find the container with id 4ca763ca0d0a1dc45cef8eb430b01cb93f8ee2834e015d9f61c6feb30f8df7d8 Jul 07 11:17:17.715415 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:17.715370 2576 generic.go:356] "Generic (PLEG): container finished" podID="f15cec8a-6444-4864-b5da-5ea9dd0fa56e" containerID="dd784e796ef99275e451d4ab2f1dec056b9a15e86905a6de1cdae9b99bd36dc6" exitCode=0 Jul 07 11:17:17.715696 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:17.715442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" event={"ID":"f15cec8a-6444-4864-b5da-5ea9dd0fa56e","Type":"ContainerDied","Data":"dd784e796ef99275e451d4ab2f1dec056b9a15e86905a6de1cdae9b99bd36dc6"} Jul 07 11:17:17.715696 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:17.715491 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" event={"ID":"f15cec8a-6444-4864-b5da-5ea9dd0fa56e","Type":"ContainerStarted","Data":"4ca763ca0d0a1dc45cef8eb430b01cb93f8ee2834e015d9f61c6feb30f8df7d8"} Jul 07 11:17:18.721677 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:18.721648 2576 generic.go:356] "Generic (PLEG): container finished" podID="73dce630-9f3e-425f-9e36-595127c39459" containerID="f12b03069156f6bf6cf250df8836abe59cdd8995b0250bedb6c0e3e105f92fe5" exitCode=0 Jul 07 11:17:18.722112 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:18.721710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" event={"ID":"73dce630-9f3e-425f-9e36-595127c39459","Type":"ContainerDied","Data":"f12b03069156f6bf6cf250df8836abe59cdd8995b0250bedb6c0e3e105f92fe5"} Jul 07 11:17:18.723607 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:18.723585 2576 generic.go:356] "Generic (PLEG): container finished" podID="9caa147b-1a48-4d79-b10f-311e40b7b291" containerID="db05eecda23536bfa7f422d5ae11003f65122c197208ee5a273f8795a73aa17a" exitCode=0 Jul 07 11:17:18.723727 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:18.723683 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" event={"ID":"9caa147b-1a48-4d79-b10f-311e40b7b291","Type":"ContainerDied","Data":"db05eecda23536bfa7f422d5ae11003f65122c197208ee5a273f8795a73aa17a"} Jul 07 11:17:18.725519 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:18.725497 2576 generic.go:356] "Generic (PLEG): container finished" podID="46dbb5de-ff69-4a3b-8b57-48733d0848f1" containerID="5aaccae19aea57f6a07cb6f3ef92ed3dc39a0db8cc6d1f3213eeb53b549c1092" exitCode=0 Jul 07 11:17:18.725611 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:18.725579 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" event={"ID":"46dbb5de-ff69-4a3b-8b57-48733d0848f1","Type":"ContainerDied","Data":"5aaccae19aea57f6a07cb6f3ef92ed3dc39a0db8cc6d1f3213eeb53b549c1092"} Jul 07 11:17:18.727450 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:18.727429 2576 generic.go:356] "Generic (PLEG): container finished" podID="f15cec8a-6444-4864-b5da-5ea9dd0fa56e" containerID="505d7a6516ca849384b445092adcee075bea6157b41faf71d15e4a48acacdf42" exitCode=0 Jul 07 11:17:18.727549 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:18.727455 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" event={"ID":"f15cec8a-6444-4864-b5da-5ea9dd0fa56e","Type":"ContainerDied","Data":"505d7a6516ca849384b445092adcee075bea6157b41faf71d15e4a48acacdf42"} Jul 07 11:17:19.733891 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:19.733850 2576 generic.go:356] "Generic (PLEG): container finished" podID="73dce630-9f3e-425f-9e36-595127c39459" containerID="9b0207824cf795f33ac71ae414b588a256a9491d9639a94ef5aa1e2efc161ea5" exitCode=0 Jul 07 11:17:19.734270 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:19.733933 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" event={"ID":"73dce630-9f3e-425f-9e36-595127c39459","Type":"ContainerDied","Data":"9b0207824cf795f33ac71ae414b588a256a9491d9639a94ef5aa1e2efc161ea5"} Jul 07 11:17:19.735924 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:19.735903 2576 generic.go:356] "Generic (PLEG): container finished" podID="9caa147b-1a48-4d79-b10f-311e40b7b291" containerID="81b2ee9e2cb7ef3951dfcb94f0cab254a7f2ef98ab124713d76bc8a3082c0c5e" exitCode=0 Jul 07 11:17:19.736054 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:19.735989 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" event={"ID":"9caa147b-1a48-4d79-b10f-311e40b7b291","Type":"ContainerDied","Data":"81b2ee9e2cb7ef3951dfcb94f0cab254a7f2ef98ab124713d76bc8a3082c0c5e"} Jul 07 11:17:19.737853 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:19.737835 2576 generic.go:356] "Generic (PLEG): container finished" podID="46dbb5de-ff69-4a3b-8b57-48733d0848f1" containerID="fb23b0846eb34cf2e8b6eccc41f7e8ef352450d6de69b8354d1be91d5f0d27ad" exitCode=0 Jul 07 11:17:19.737940 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:19.737861 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" event={"ID":"46dbb5de-ff69-4a3b-8b57-48733d0848f1","Type":"ContainerDied","Data":"fb23b0846eb34cf2e8b6eccc41f7e8ef352450d6de69b8354d1be91d5f0d27ad"} Jul 07 11:17:19.739858 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:19.739836 2576 generic.go:356] "Generic (PLEG): container finished" podID="f15cec8a-6444-4864-b5da-5ea9dd0fa56e" containerID="d261225eba90fe65ae35998437a01d878fa5a412feabe1383f54260bb23ec3d7" exitCode=0 Jul 07 11:17:19.739926 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:19.739907 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" event={"ID":"f15cec8a-6444-4864-b5da-5ea9dd0fa56e","Type":"ContainerDied","Data":"d261225eba90fe65ae35998437a01d878fa5a412feabe1383f54260bb23ec3d7"} Jul 07 11:17:20.901249 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:20.901097 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" Jul 07 11:17:20.934902 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:20.934875 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" Jul 07 11:17:20.944963 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:20.944944 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" Jul 07 11:17:20.952301 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:20.952284 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" Jul 07 11:17:21.042180 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.042107 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-bundle\") pod \"f15cec8a-6444-4864-b5da-5ea9dd0fa56e\" (UID: \"f15cec8a-6444-4864-b5da-5ea9dd0fa56e\") " Jul 07 11:17:21.042180 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.042159 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46dbb5de-ff69-4a3b-8b57-48733d0848f1-util\") pod \"46dbb5de-ff69-4a3b-8b57-48733d0848f1\" (UID: \"46dbb5de-ff69-4a3b-8b57-48733d0848f1\") " Jul 07 11:17:21.042180 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.042177 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9srx7\" (UniqueName: \"kubernetes.io/projected/9caa147b-1a48-4d79-b10f-311e40b7b291-kube-api-access-9srx7\") pod \"9caa147b-1a48-4d79-b10f-311e40b7b291\" (UID: \"9caa147b-1a48-4d79-b10f-311e40b7b291\") " Jul 07 11:17:21.042436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.042201 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73dce630-9f3e-425f-9e36-595127c39459-util\") pod \"73dce630-9f3e-425f-9e36-595127c39459\" (UID: \"73dce630-9f3e-425f-9e36-595127c39459\") " Jul 07 11:17:21.042436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.042225 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73dce630-9f3e-425f-9e36-595127c39459-bundle\") pod \"73dce630-9f3e-425f-9e36-595127c39459\" (UID: \"73dce630-9f3e-425f-9e36-595127c39459\") " Jul 07 11:17:21.042436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.042265 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml5c6\" (UniqueName: \"kubernetes.io/projected/46dbb5de-ff69-4a3b-8b57-48733d0848f1-kube-api-access-ml5c6\") pod \"46dbb5de-ff69-4a3b-8b57-48733d0848f1\" (UID: \"46dbb5de-ff69-4a3b-8b57-48733d0848f1\") " Jul 07 11:17:21.042436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.042318 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lplsf\" (UniqueName: \"kubernetes.io/projected/73dce630-9f3e-425f-9e36-595127c39459-kube-api-access-lplsf\") pod \"73dce630-9f3e-425f-9e36-595127c39459\" (UID: \"73dce630-9f3e-425f-9e36-595127c39459\") " Jul 07 11:17:21.042436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.042341 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-util\") pod \"f15cec8a-6444-4864-b5da-5ea9dd0fa56e\" (UID: \"f15cec8a-6444-4864-b5da-5ea9dd0fa56e\") " Jul 07 11:17:21.042713 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.042693 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46dbb5de-ff69-4a3b-8b57-48733d0848f1-bundle\") pod \"46dbb5de-ff69-4a3b-8b57-48733d0848f1\" (UID: \"46dbb5de-ff69-4a3b-8b57-48733d0848f1\") " Jul 07 11:17:21.042770 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.042744 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhzzj\" (UniqueName: \"kubernetes.io/projected/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-kube-api-access-lhzzj\") pod \"f15cec8a-6444-4864-b5da-5ea9dd0fa56e\" (UID: \"f15cec8a-6444-4864-b5da-5ea9dd0fa56e\") " Jul 07 11:17:21.042821 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.042760 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73dce630-9f3e-425f-9e36-595127c39459-bundle" (OuterVolumeSpecName: "bundle") pod "73dce630-9f3e-425f-9e36-595127c39459" (UID: "73dce630-9f3e-425f-9e36-595127c39459"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:17:21.042821 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.042771 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9caa147b-1a48-4d79-b10f-311e40b7b291-util\") pod \"9caa147b-1a48-4d79-b10f-311e40b7b291\" (UID: \"9caa147b-1a48-4d79-b10f-311e40b7b291\") " Jul 07 11:17:21.042914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.042890 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-bundle" (OuterVolumeSpecName: "bundle") pod "f15cec8a-6444-4864-b5da-5ea9dd0fa56e" (UID: "f15cec8a-6444-4864-b5da-5ea9dd0fa56e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:17:21.043137 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.043111 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9caa147b-1a48-4d79-b10f-311e40b7b291-bundle\") pod \"9caa147b-1a48-4d79-b10f-311e40b7b291\" (UID: \"9caa147b-1a48-4d79-b10f-311e40b7b291\") " Jul 07 11:17:21.044920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.043434 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-bundle\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:17:21.044920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.043459 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73dce630-9f3e-425f-9e36-595127c39459-bundle\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:17:21.044920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.044320 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46dbb5de-ff69-4a3b-8b57-48733d0848f1-bundle" (OuterVolumeSpecName: "bundle") pod "46dbb5de-ff69-4a3b-8b57-48733d0848f1" (UID: "46dbb5de-ff69-4a3b-8b57-48733d0848f1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:17:21.044920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.044869 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9caa147b-1a48-4d79-b10f-311e40b7b291-bundle" (OuterVolumeSpecName: "bundle") pod "9caa147b-1a48-4d79-b10f-311e40b7b291" (UID: "9caa147b-1a48-4d79-b10f-311e40b7b291"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:17:21.045234 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.045005 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9caa147b-1a48-4d79-b10f-311e40b7b291-kube-api-access-9srx7" (OuterVolumeSpecName: "kube-api-access-9srx7") pod "9caa147b-1a48-4d79-b10f-311e40b7b291" (UID: "9caa147b-1a48-4d79-b10f-311e40b7b291"). InnerVolumeSpecName "kube-api-access-9srx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:17:21.045451 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.045426 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46dbb5de-ff69-4a3b-8b57-48733d0848f1-kube-api-access-ml5c6" (OuterVolumeSpecName: "kube-api-access-ml5c6") pod "46dbb5de-ff69-4a3b-8b57-48733d0848f1" (UID: "46dbb5de-ff69-4a3b-8b57-48733d0848f1"). InnerVolumeSpecName "kube-api-access-ml5c6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:17:21.045559 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.045538 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-kube-api-access-lhzzj" (OuterVolumeSpecName: "kube-api-access-lhzzj") pod "f15cec8a-6444-4864-b5da-5ea9dd0fa56e" (UID: "f15cec8a-6444-4864-b5da-5ea9dd0fa56e"). InnerVolumeSpecName "kube-api-access-lhzzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:17:21.046854 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.046828 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73dce630-9f3e-425f-9e36-595127c39459-kube-api-access-lplsf" (OuterVolumeSpecName: "kube-api-access-lplsf") pod "73dce630-9f3e-425f-9e36-595127c39459" (UID: "73dce630-9f3e-425f-9e36-595127c39459"). InnerVolumeSpecName "kube-api-access-lplsf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:17:21.048896 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.048854 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9caa147b-1a48-4d79-b10f-311e40b7b291-util" (OuterVolumeSpecName: "util") pod "9caa147b-1a48-4d79-b10f-311e40b7b291" (UID: "9caa147b-1a48-4d79-b10f-311e40b7b291"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:17:21.049551 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.049532 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46dbb5de-ff69-4a3b-8b57-48733d0848f1-util" (OuterVolumeSpecName: "util") pod "46dbb5de-ff69-4a3b-8b57-48733d0848f1" (UID: "46dbb5de-ff69-4a3b-8b57-48733d0848f1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:17:21.051462 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.051430 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73dce630-9f3e-425f-9e36-595127c39459-util" (OuterVolumeSpecName: "util") pod "73dce630-9f3e-425f-9e36-595127c39459" (UID: "73dce630-9f3e-425f-9e36-595127c39459"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:17:21.052088 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.052073 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-util" (OuterVolumeSpecName: "util") pod "f15cec8a-6444-4864-b5da-5ea9dd0fa56e" (UID: "f15cec8a-6444-4864-b5da-5ea9dd0fa56e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:17:21.143805 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.143783 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46dbb5de-ff69-4a3b-8b57-48733d0848f1-util\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:17:21.143805 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.143804 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9srx7\" (UniqueName: \"kubernetes.io/projected/9caa147b-1a48-4d79-b10f-311e40b7b291-kube-api-access-9srx7\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:17:21.143916 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.143814 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73dce630-9f3e-425f-9e36-595127c39459-util\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:17:21.143916 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.143823 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml5c6\" (UniqueName: \"kubernetes.io/projected/46dbb5de-ff69-4a3b-8b57-48733d0848f1-kube-api-access-ml5c6\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:17:21.143916 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.143831 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lplsf\" (UniqueName: \"kubernetes.io/projected/73dce630-9f3e-425f-9e36-595127c39459-kube-api-access-lplsf\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:17:21.143916 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.143839 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-util\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:17:21.143916 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.143847 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46dbb5de-ff69-4a3b-8b57-48733d0848f1-bundle\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:17:21.143916 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.143855 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhzzj\" (UniqueName: \"kubernetes.io/projected/f15cec8a-6444-4864-b5da-5ea9dd0fa56e-kube-api-access-lhzzj\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:17:21.143916 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.143862 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9caa147b-1a48-4d79-b10f-311e40b7b291-util\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:17:21.143916 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.143870 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9caa147b-1a48-4d79-b10f-311e40b7b291-bundle\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:17:21.750845 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.750816 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" Jul 07 11:17:21.751025 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.750812 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm" event={"ID":"73dce630-9f3e-425f-9e36-595127c39459","Type":"ContainerDied","Data":"2167cae2c3070ffce1092f48bea4afc888be5640df104df584f8061094fc2d69"} Jul 07 11:17:21.751025 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.750937 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2167cae2c3070ffce1092f48bea4afc888be5640df104df584f8061094fc2d69" Jul 07 11:17:21.752795 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.752773 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" Jul 07 11:17:21.752915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.752795 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc" event={"ID":"9caa147b-1a48-4d79-b10f-311e40b7b291","Type":"ContainerDied","Data":"9e8ac609054f99965d9ab151e4b3d196f420adff8262657920269e5564f59f93"} Jul 07 11:17:21.752915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.752833 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e8ac609054f99965d9ab151e4b3d196f420adff8262657920269e5564f59f93" Jul 07 11:17:21.754881 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.754863 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" Jul 07 11:17:21.755007 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.754864 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd" event={"ID":"46dbb5de-ff69-4a3b-8b57-48733d0848f1","Type":"ContainerDied","Data":"3f486a7e57007d30cd745f15246495bad834b51140fc0cbdda58c9d6bdaa17ac"} Jul 07 11:17:21.755075 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.755046 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f486a7e57007d30cd745f15246495bad834b51140fc0cbdda58c9d6bdaa17ac" Jul 07 11:17:21.756967 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.756946 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" event={"ID":"f15cec8a-6444-4864-b5da-5ea9dd0fa56e","Type":"ContainerDied","Data":"4ca763ca0d0a1dc45cef8eb430b01cb93f8ee2834e015d9f61c6feb30f8df7d8"} Jul 07 11:17:21.757063 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.756983 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ca763ca0d0a1dc45cef8eb430b01cb93f8ee2834e015d9f61c6feb30f8df7d8" Jul 07 11:17:21.757063 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:21.756998 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp" Jul 07 11:17:31.697957 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.697926 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx"] Jul 07 11:17:31.698317 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698225 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9caa147b-1a48-4d79-b10f-311e40b7b291" containerName="util" Jul 07 11:17:31.698317 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698237 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9caa147b-1a48-4d79-b10f-311e40b7b291" containerName="util" Jul 07 11:17:31.698317 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698250 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f15cec8a-6444-4864-b5da-5ea9dd0fa56e" containerName="pull" Jul 07 11:17:31.698317 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698259 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f15cec8a-6444-4864-b5da-5ea9dd0fa56e" containerName="pull" Jul 07 11:17:31.698317 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698269 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73dce630-9f3e-425f-9e36-595127c39459" containerName="pull" Jul 07 11:17:31.698317 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698277 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="73dce630-9f3e-425f-9e36-595127c39459" containerName="pull" Jul 07 11:17:31.698317 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698287 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46dbb5de-ff69-4a3b-8b57-48733d0848f1" containerName="util" Jul 07 11:17:31.698317 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698295 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="46dbb5de-ff69-4a3b-8b57-48733d0848f1" containerName="util" Jul 07 11:17:31.698317 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698303 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46dbb5de-ff69-4a3b-8b57-48733d0848f1" containerName="extract" Jul 07 11:17:31.698317 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698310 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="46dbb5de-ff69-4a3b-8b57-48733d0848f1" containerName="extract" Jul 07 11:17:31.698317 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698317 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73dce630-9f3e-425f-9e36-595127c39459" containerName="extract" Jul 07 11:17:31.698317 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698322 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="73dce630-9f3e-425f-9e36-595127c39459" containerName="extract" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698333 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f15cec8a-6444-4864-b5da-5ea9dd0fa56e" containerName="extract" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698339 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f15cec8a-6444-4864-b5da-5ea9dd0fa56e" containerName="extract" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698346 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73dce630-9f3e-425f-9e36-595127c39459" containerName="util" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698351 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="73dce630-9f3e-425f-9e36-595127c39459" containerName="util" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698355 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f15cec8a-6444-4864-b5da-5ea9dd0fa56e" containerName="util" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698361 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f15cec8a-6444-4864-b5da-5ea9dd0fa56e" containerName="util" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698371 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46dbb5de-ff69-4a3b-8b57-48733d0848f1" containerName="pull" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698379 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="46dbb5de-ff69-4a3b-8b57-48733d0848f1" containerName="pull" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698389 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9caa147b-1a48-4d79-b10f-311e40b7b291" containerName="extract" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698415 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9caa147b-1a48-4d79-b10f-311e40b7b291" containerName="extract" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698425 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9caa147b-1a48-4d79-b10f-311e40b7b291" containerName="pull" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698432 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9caa147b-1a48-4d79-b10f-311e40b7b291" containerName="pull" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698497 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="73dce630-9f3e-425f-9e36-595127c39459" containerName="extract" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698505 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f15cec8a-6444-4864-b5da-5ea9dd0fa56e" containerName="extract" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698513 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="46dbb5de-ff69-4a3b-8b57-48733d0848f1" containerName="extract" Jul 07 11:17:31.698670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.698520 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9caa147b-1a48-4d79-b10f-311e40b7b291" containerName="extract" Jul 07 11:17:31.701290 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.701271 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" Jul 07 11:17:31.705310 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.705285 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 11:17:31.706460 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.706436 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6tc45\"" Jul 07 11:17:31.706637 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.706614 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 11:17:31.723514 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.723486 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx"] Jul 07 11:17:31.823596 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.823572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9c94\" (UniqueName: \"kubernetes.io/projected/85282452-1470-4197-8170-fdff3d0892c1-kube-api-access-b9c94\") pod \"limitador-operator-controller-manager-859d7b78bd-2t2tx\" (UID: \"85282452-1470-4197-8170-fdff3d0892c1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" Jul 07 11:17:31.924544 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.924518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9c94\" (UniqueName: \"kubernetes.io/projected/85282452-1470-4197-8170-fdff3d0892c1-kube-api-access-b9c94\") pod \"limitador-operator-controller-manager-859d7b78bd-2t2tx\" (UID: \"85282452-1470-4197-8170-fdff3d0892c1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" Jul 07 11:17:31.940109 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:31.940083 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9c94\" (UniqueName: \"kubernetes.io/projected/85282452-1470-4197-8170-fdff3d0892c1-kube-api-access-b9c94\") pod \"limitador-operator-controller-manager-859d7b78bd-2t2tx\" (UID: \"85282452-1470-4197-8170-fdff3d0892c1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" Jul 07 11:17:32.011282 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:32.011220 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" Jul 07 11:17:32.157292 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:32.157267 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx"] Jul 07 11:17:32.159136 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:17:32.159109 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85282452_1470_4197_8170_fdff3d0892c1.slice/crio-988a4c59b82b0f2b6b7ed7e78b98fded3ea3d2adf3d2ea8a2e24d09ad6b33bcc WatchSource:0}: Error finding container 988a4c59b82b0f2b6b7ed7e78b98fded3ea3d2adf3d2ea8a2e24d09ad6b33bcc: Status 404 returned error can't find the container with id 988a4c59b82b0f2b6b7ed7e78b98fded3ea3d2adf3d2ea8a2e24d09ad6b33bcc Jul 07 11:17:32.810907 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:32.810873 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" event={"ID":"85282452-1470-4197-8170-fdff3d0892c1","Type":"ContainerStarted","Data":"988a4c59b82b0f2b6b7ed7e78b98fded3ea3d2adf3d2ea8a2e24d09ad6b33bcc"} Jul 07 11:17:34.822604 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:34.822518 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" event={"ID":"85282452-1470-4197-8170-fdff3d0892c1","Type":"ContainerStarted","Data":"8135edda62598b7f8f44a7061759101e15dd1946f1f50521a32ff4b305657391"} Jul 07 11:17:34.822944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:34.822645 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" Jul 07 11:17:39.163589 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:39.163539 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" podStartSLOduration=5.772357149 podStartE2EDuration="8.163522656s" totalImagesPullingTime="2.391165507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:17:34.861921613 +0000 UTC m=+399.338579574" watchObservedRunningTime="2026-07-07 11:17:39.163522656 +0000 UTC m=+403.640180616" Jul 07 11:17:39.163960 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:39.163843 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvfth"] Jul 07 11:17:39.167252 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:39.167235 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvfth" Jul 07 11:17:39.170351 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:39.170329 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-dtw6h\"" Jul 07 11:17:39.170675 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:39.170655 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 07 11:17:39.201063 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:39.201039 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvfth"] Jul 07 11:17:39.284870 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:39.284849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6spkz\" (UniqueName: \"kubernetes.io/projected/723d6471-97a3-401c-a32a-4ef075bb8e54-kube-api-access-6spkz\") pod \"dns-operator-controller-manager-864dd78c4c-qvfth\" (UID: \"723d6471-97a3-401c-a32a-4ef075bb8e54\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvfth" Jul 07 11:17:39.385686 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:39.385645 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6spkz\" (UniqueName: \"kubernetes.io/projected/723d6471-97a3-401c-a32a-4ef075bb8e54-kube-api-access-6spkz\") pod \"dns-operator-controller-manager-864dd78c4c-qvfth\" (UID: \"723d6471-97a3-401c-a32a-4ef075bb8e54\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvfth" Jul 07 11:17:39.401153 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:39.401135 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6spkz\" (UniqueName: \"kubernetes.io/projected/723d6471-97a3-401c-a32a-4ef075bb8e54-kube-api-access-6spkz\") pod \"dns-operator-controller-manager-864dd78c4c-qvfth\" (UID: \"723d6471-97a3-401c-a32a-4ef075bb8e54\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvfth" Jul 07 11:17:39.476657 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:39.476601 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvfth" Jul 07 11:17:39.622287 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:39.622264 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvfth"] Jul 07 11:17:39.624482 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:17:39.624457 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod723d6471_97a3_401c_a32a_4ef075bb8e54.slice/crio-5f94baa41e0f50b4b20161b446effa2d6507216be5dcba7043c74e3e5fa1c803 WatchSource:0}: Error finding container 5f94baa41e0f50b4b20161b446effa2d6507216be5dcba7043c74e3e5fa1c803: Status 404 returned error can't find the container with id 5f94baa41e0f50b4b20161b446effa2d6507216be5dcba7043c74e3e5fa1c803 Jul 07 11:17:39.849273 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:39.849196 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvfth" event={"ID":"723d6471-97a3-401c-a32a-4ef075bb8e54","Type":"ContainerStarted","Data":"5f94baa41e0f50b4b20161b446effa2d6507216be5dcba7043c74e3e5fa1c803"} Jul 07 11:17:42.867424 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:42.867379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvfth" event={"ID":"723d6471-97a3-401c-a32a-4ef075bb8e54","Type":"ContainerStarted","Data":"912fe074306f15e1f0b1b8dac370bc1cfc2ed59fcf8f7139bae57f74687e6210"} Jul 07 11:17:42.867810 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:42.867562 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvfth" Jul 07 11:17:42.887618 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:42.887565 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvfth" podStartSLOduration=1.368645097 podStartE2EDuration="3.887550908s" totalImagesPullingTime="2.518905811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:17:42.885758157 +0000 UTC m=+407.362416119" watchObservedRunningTime="2026-07-07 11:17:42.887550908 +0000 UTC m=+407.364208869" Jul 07 11:17:44.661653 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:44.661622 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5"] Jul 07 11:17:44.665129 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:44.665112 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" Jul 07 11:17:44.669423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:44.669387 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xn55g\"" Jul 07 11:17:44.683316 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:44.683295 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5"] Jul 07 11:17:44.830839 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:44.830811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/430cbbe3-3b95-41bc-9bd2-884ccc35937e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5lgk5\" (UID: \"430cbbe3-3b95-41bc-9bd2-884ccc35937e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" Jul 07 11:17:44.830940 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:44.830882 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsd54\" (UniqueName: \"kubernetes.io/projected/430cbbe3-3b95-41bc-9bd2-884ccc35937e-kube-api-access-zsd54\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5lgk5\" (UID: \"430cbbe3-3b95-41bc-9bd2-884ccc35937e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" Jul 07 11:17:44.931985 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:44.931927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/430cbbe3-3b95-41bc-9bd2-884ccc35937e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5lgk5\" (UID: \"430cbbe3-3b95-41bc-9bd2-884ccc35937e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" Jul 07 11:17:44.932075 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:44.931988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsd54\" (UniqueName: \"kubernetes.io/projected/430cbbe3-3b95-41bc-9bd2-884ccc35937e-kube-api-access-zsd54\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5lgk5\" (UID: \"430cbbe3-3b95-41bc-9bd2-884ccc35937e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" Jul 07 11:17:44.932273 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:44.932254 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/430cbbe3-3b95-41bc-9bd2-884ccc35937e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5lgk5\" (UID: \"430cbbe3-3b95-41bc-9bd2-884ccc35937e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" Jul 07 11:17:44.956943 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:44.956924 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsd54\" (UniqueName: \"kubernetes.io/projected/430cbbe3-3b95-41bc-9bd2-884ccc35937e-kube-api-access-zsd54\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5lgk5\" (UID: \"430cbbe3-3b95-41bc-9bd2-884ccc35937e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" Jul 07 11:17:44.975351 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:44.975330 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" Jul 07 11:17:45.126038 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:17:45.126000 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod430cbbe3_3b95_41bc_9bd2_884ccc35937e.slice/crio-850f910426658949f0cae9303871f7d1daa8165d94ca40989e326592fa0ec268 WatchSource:0}: Error finding container 850f910426658949f0cae9303871f7d1daa8165d94ca40989e326592fa0ec268: Status 404 returned error can't find the container with id 850f910426658949f0cae9303871f7d1daa8165d94ca40989e326592fa0ec268 Jul 07 11:17:45.129287 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:45.129262 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5"] Jul 07 11:17:45.831084 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:45.831057 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" Jul 07 11:17:45.886390 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:45.886339 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" event={"ID":"430cbbe3-3b95-41bc-9bd2-884ccc35937e","Type":"ContainerStarted","Data":"850f910426658949f0cae9303871f7d1daa8165d94ca40989e326592fa0ec268"} Jul 07 11:17:49.438045 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.438014 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-766f56dff9-slnct"] Jul 07 11:17:49.442354 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.442329 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.460090 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.460063 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766f56dff9-slnct"] Jul 07 11:17:49.464539 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.464512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2z2b\" (UniqueName: \"kubernetes.io/projected/9879d388-7022-49db-92b9-867f88254cf3-kube-api-access-j2z2b\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.464654 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.464556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9879d388-7022-49db-92b9-867f88254cf3-console-serving-cert\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.464654 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.464626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9879d388-7022-49db-92b9-867f88254cf3-oauth-serving-cert\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.464781 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.464665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9879d388-7022-49db-92b9-867f88254cf3-console-oauth-config\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.464781 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.464767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9879d388-7022-49db-92b9-867f88254cf3-service-ca\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.464938 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.464816 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9879d388-7022-49db-92b9-867f88254cf3-trusted-ca-bundle\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.464938 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.464843 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9879d388-7022-49db-92b9-867f88254cf3-console-config\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.565606 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.565574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2z2b\" (UniqueName: \"kubernetes.io/projected/9879d388-7022-49db-92b9-867f88254cf3-kube-api-access-j2z2b\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.565771 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.565621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9879d388-7022-49db-92b9-867f88254cf3-console-serving-cert\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.565771 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.565656 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9879d388-7022-49db-92b9-867f88254cf3-oauth-serving-cert\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.565771 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.565678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9879d388-7022-49db-92b9-867f88254cf3-console-oauth-config\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.565771 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.565699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9879d388-7022-49db-92b9-867f88254cf3-service-ca\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.565771 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.565719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9879d388-7022-49db-92b9-867f88254cf3-trusted-ca-bundle\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.566043 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.565832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9879d388-7022-49db-92b9-867f88254cf3-console-config\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.566482 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.566438 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9879d388-7022-49db-92b9-867f88254cf3-service-ca\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.566759 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.566739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9879d388-7022-49db-92b9-867f88254cf3-trusted-ca-bundle\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.566808 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.566769 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9879d388-7022-49db-92b9-867f88254cf3-console-config\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.566844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.566796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9879d388-7022-49db-92b9-867f88254cf3-oauth-serving-cert\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.568315 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.568293 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9879d388-7022-49db-92b9-867f88254cf3-console-serving-cert\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.568469 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.568448 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9879d388-7022-49db-92b9-867f88254cf3-console-oauth-config\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.575239 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.575215 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2z2b\" (UniqueName: \"kubernetes.io/projected/9879d388-7022-49db-92b9-867f88254cf3-kube-api-access-j2z2b\") pod \"console-766f56dff9-slnct\" (UID: \"9879d388-7022-49db-92b9-867f88254cf3\") " pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.753570 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.753495 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:49.907515 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:49.904671 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766f56dff9-slnct"] Jul 07 11:17:49.911558 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:17:49.911510 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9879d388_7022_49db_92b9_867f88254cf3.slice/crio-6f173b4740385c936a808d0a12a40274adec17633e72d6337b065d7ea4a773a9 WatchSource:0}: Error finding container 6f173b4740385c936a808d0a12a40274adec17633e72d6337b065d7ea4a773a9: Status 404 returned error can't find the container with id 6f173b4740385c936a808d0a12a40274adec17633e72d6337b065d7ea4a773a9 Jul 07 11:17:50.919343 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:50.919307 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766f56dff9-slnct" event={"ID":"9879d388-7022-49db-92b9-867f88254cf3","Type":"ContainerStarted","Data":"a091bfae14cd63c2ef91acb18cd83b5b8d9824c56ad613d01ebcfc1d1a0efcd7"} Jul 07 11:17:50.919837 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:50.919363 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766f56dff9-slnct" event={"ID":"9879d388-7022-49db-92b9-867f88254cf3","Type":"ContainerStarted","Data":"6f173b4740385c936a808d0a12a40274adec17633e72d6337b065d7ea4a773a9"} Jul 07 11:17:50.951625 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:50.951579 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-766f56dff9-slnct" podStartSLOduration=1.951565029 podStartE2EDuration="1.951565029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:17:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:17:50.948751735 +0000 UTC m=+415.425409710" watchObservedRunningTime="2026-07-07 11:17:50.951565029 +0000 UTC m=+415.428222991" Jul 07 11:17:52.931939 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:52.931899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" event={"ID":"430cbbe3-3b95-41bc-9bd2-884ccc35937e","Type":"ContainerStarted","Data":"d42ae276f05443866ded4b17c5998567c88654603c8d3689276b7585f892bfd4"} Jul 07 11:17:52.932351 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:52.932018 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" Jul 07 11:17:52.962081 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:52.962038 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" podStartSLOduration=1.770387663 podStartE2EDuration="8.962022642s" totalImagesPullingTime="7.191634979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:17:52.959864696 +0000 UTC m=+417.436522658" watchObservedRunningTime="2026-07-07 11:17:52.962022642 +0000 UTC m=+417.438680604" Jul 07 11:17:53.874380 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:53.874350 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qvfth" Jul 07 11:17:59.754527 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:59.754491 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:59.754868 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:59.754558 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:59.758864 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:59.758842 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:17:59.973032 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:17:59.973001 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-766f56dff9-slnct" Jul 07 11:18:00.034003 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:00.033921 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789c65bb86-pc5fp"] Jul 07 11:18:03.939826 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:03.939789 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" Jul 07 11:18:05.769259 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.769225 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5"] Jul 07 11:18:05.769656 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.769438 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" podUID="430cbbe3-3b95-41bc-9bd2-884ccc35937e" containerName="manager" containerID="cri-o://d42ae276f05443866ded4b17c5998567c88654603c8d3689276b7585f892bfd4" gracePeriod=2 Jul 07 11:18:05.780841 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.780814 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5"] Jul 07 11:18:05.803053 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.803025 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx"] Jul 07 11:18:05.803277 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.803253 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" podUID="85282452-1470-4197-8170-fdff3d0892c1" containerName="manager" containerID="cri-o://8135edda62598b7f8f44a7061759101e15dd1946f1f50521a32ff4b305657391" gracePeriod=2 Jul 07 11:18:05.806623 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:18:05.806579 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5lgk5\" is forbidden: User \"system:node:ip-10-0-137-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-8.ec2.internal' and this object" podUID="430cbbe3-3b95-41bc-9bd2-884ccc35937e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" Jul 07 11:18:05.816110 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.816045 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx"] Jul 07 11:18:05.829110 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.829085 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" podUID="85282452-1470-4197-8170-fdff3d0892c1" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.34:8081/readyz\": dial tcp 10.133.0.34:8081: connect: connection refused" Jul 07 11:18:05.841379 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.841355 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26"] Jul 07 11:18:05.841714 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.841697 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85282452-1470-4197-8170-fdff3d0892c1" containerName="manager" Jul 07 11:18:05.841714 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.841713 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="85282452-1470-4197-8170-fdff3d0892c1" containerName="manager" Jul 07 11:18:05.841881 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.841725 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="430cbbe3-3b95-41bc-9bd2-884ccc35937e" containerName="manager" Jul 07 11:18:05.841881 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.841730 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="430cbbe3-3b95-41bc-9bd2-884ccc35937e" containerName="manager" Jul 07 11:18:05.841881 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.841778 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="85282452-1470-4197-8170-fdff3d0892c1" containerName="manager" Jul 07 11:18:05.841881 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.841787 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="430cbbe3-3b95-41bc-9bd2-884ccc35937e" containerName="manager" Jul 07 11:18:05.844914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.844896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" Jul 07 11:18:05.848111 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:18:05.848082 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5lgk5\" is forbidden: User \"system:node:ip-10-0-137-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-8.ec2.internal' and this object" podUID="430cbbe3-3b95-41bc-9bd2-884ccc35937e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" Jul 07 11:18:05.850484 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:18:05.850454 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2t2tx\" is forbidden: User \"system:node:ip-10-0-137-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-8.ec2.internal' and this object" podUID="85282452-1470-4197-8170-fdff3d0892c1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" Jul 07 11:18:05.873933 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.873912 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26"] Jul 07 11:18:05.895974 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.895949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54zz2\" (UniqueName: \"kubernetes.io/projected/e4a38c0d-a6cc-46d5-b92f-eeee873eebfd-kube-api-access-54zz2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qcw26\" (UID: \"e4a38c0d-a6cc-46d5-b92f-eeee873eebfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" Jul 07 11:18:05.896081 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.896060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4a38c0d-a6cc-46d5-b92f-eeee873eebfd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qcw26\" (UID: \"e4a38c0d-a6cc-46d5-b92f-eeee873eebfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" Jul 07 11:18:05.997490 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.997457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4a38c0d-a6cc-46d5-b92f-eeee873eebfd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qcw26\" (UID: \"e4a38c0d-a6cc-46d5-b92f-eeee873eebfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" Jul 07 11:18:05.997490 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.997510 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54zz2\" (UniqueName: \"kubernetes.io/projected/e4a38c0d-a6cc-46d5-b92f-eeee873eebfd-kube-api-access-54zz2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qcw26\" (UID: \"e4a38c0d-a6cc-46d5-b92f-eeee873eebfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" Jul 07 11:18:05.997885 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:05.997860 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4a38c0d-a6cc-46d5-b92f-eeee873eebfd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qcw26\" (UID: \"e4a38c0d-a6cc-46d5-b92f-eeee873eebfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" Jul 07 11:18:06.000571 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.000537 2576 generic.go:356] "Generic (PLEG): container finished" podID="85282452-1470-4197-8170-fdff3d0892c1" containerID="8135edda62598b7f8f44a7061759101e15dd1946f1f50521a32ff4b305657391" exitCode=0 Jul 07 11:18:06.003070 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.003046 2576 generic.go:356] "Generic (PLEG): container finished" podID="430cbbe3-3b95-41bc-9bd2-884ccc35937e" containerID="d42ae276f05443866ded4b17c5998567c88654603c8d3689276b7585f892bfd4" exitCode=0 Jul 07 11:18:06.009476 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.009453 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54zz2\" (UniqueName: \"kubernetes.io/projected/e4a38c0d-a6cc-46d5-b92f-eeee873eebfd-kube-api-access-54zz2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qcw26\" (UID: \"e4a38c0d-a6cc-46d5-b92f-eeee873eebfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" Jul 07 11:18:06.054931 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:18:06.054900 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5lgk5\" is forbidden: User \"system:node:ip-10-0-137-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-8.ec2.internal' and this object" podUID="430cbbe3-3b95-41bc-9bd2-884ccc35937e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" Jul 07 11:18:06.057178 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:18:06.057149 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2t2tx\" is forbidden: User \"system:node:ip-10-0-137-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-8.ec2.internal' and this object" podUID="85282452-1470-4197-8170-fdff3d0892c1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" Jul 07 11:18:06.057359 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.057342 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" Jul 07 11:18:06.060214 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.060199 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" Jul 07 11:18:06.098624 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.098604 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9c94\" (UniqueName: \"kubernetes.io/projected/85282452-1470-4197-8170-fdff3d0892c1-kube-api-access-b9c94\") pod \"85282452-1470-4197-8170-fdff3d0892c1\" (UID: \"85282452-1470-4197-8170-fdff3d0892c1\") " Jul 07 11:18:06.098716 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.098637 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsd54\" (UniqueName: \"kubernetes.io/projected/430cbbe3-3b95-41bc-9bd2-884ccc35937e-kube-api-access-zsd54\") pod \"430cbbe3-3b95-41bc-9bd2-884ccc35937e\" (UID: \"430cbbe3-3b95-41bc-9bd2-884ccc35937e\") " Jul 07 11:18:06.098716 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.098670 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/430cbbe3-3b95-41bc-9bd2-884ccc35937e-extensions-socket-volume\") pod \"430cbbe3-3b95-41bc-9bd2-884ccc35937e\" (UID: \"430cbbe3-3b95-41bc-9bd2-884ccc35937e\") " Jul 07 11:18:06.099055 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.099033 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/430cbbe3-3b95-41bc-9bd2-884ccc35937e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "430cbbe3-3b95-41bc-9bd2-884ccc35937e" (UID: "430cbbe3-3b95-41bc-9bd2-884ccc35937e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:18:06.100676 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.100650 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85282452-1470-4197-8170-fdff3d0892c1-kube-api-access-b9c94" (OuterVolumeSpecName: "kube-api-access-b9c94") pod "85282452-1470-4197-8170-fdff3d0892c1" (UID: "85282452-1470-4197-8170-fdff3d0892c1"). InnerVolumeSpecName "kube-api-access-b9c94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:18:06.100757 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.100739 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/430cbbe3-3b95-41bc-9bd2-884ccc35937e-kube-api-access-zsd54" (OuterVolumeSpecName: "kube-api-access-zsd54") pod "430cbbe3-3b95-41bc-9bd2-884ccc35937e" (UID: "430cbbe3-3b95-41bc-9bd2-884ccc35937e"). InnerVolumeSpecName "kube-api-access-zsd54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:18:06.199280 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.199256 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/430cbbe3-3b95-41bc-9bd2-884ccc35937e-extensions-socket-volume\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:18:06.199280 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.199280 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9c94\" (UniqueName: \"kubernetes.io/projected/85282452-1470-4197-8170-fdff3d0892c1-kube-api-access-b9c94\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:18:06.199438 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.199290 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsd54\" (UniqueName: \"kubernetes.io/projected/430cbbe3-3b95-41bc-9bd2-884ccc35937e-kube-api-access-zsd54\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:18:06.210216 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.210190 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" Jul 07 11:18:06.354472 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.354440 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26"] Jul 07 11:18:06.357804 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:18:06.357767 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a38c0d_a6cc_46d5_b92f_eeee873eebfd.slice/crio-261308a70978cf318633af1db1f32f95229789054d2b267f964b4d6e8e6882a3 WatchSource:0}: Error finding container 261308a70978cf318633af1db1f32f95229789054d2b267f964b4d6e8e6882a3: Status 404 returned error can't find the container with id 261308a70978cf318633af1db1f32f95229789054d2b267f964b4d6e8e6882a3 Jul 07 11:18:06.936081 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.936051 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5"] Jul 07 11:18:06.942464 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.942436 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" Jul 07 11:18:06.959602 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:06.959578 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5"] Jul 07 11:18:07.005333 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.005305 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwgcd\" (UniqueName: \"kubernetes.io/projected/2a9a71a3-2f78-441b-b04c-cbef99c5ea53-kube-api-access-hwgcd\") pod \"kuadrant-operator-controller-manager-86878c769f-q4kc5\" (UID: \"2a9a71a3-2f78-441b-b04c-cbef99c5ea53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" Jul 07 11:18:07.005511 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.005418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a9a71a3-2f78-441b-b04c-cbef99c5ea53-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q4kc5\" (UID: \"2a9a71a3-2f78-441b-b04c-cbef99c5ea53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" Jul 07 11:18:07.009576 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.009558 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2t2tx" Jul 07 11:18:07.009693 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.009590 2576 scope.go:117] "RemoveContainer" containerID="8135edda62598b7f8f44a7061759101e15dd1946f1f50521a32ff4b305657391" Jul 07 11:18:07.011165 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.011117 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5lgk5" Jul 07 11:18:07.012983 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.012956 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" event={"ID":"e4a38c0d-a6cc-46d5-b92f-eeee873eebfd","Type":"ContainerStarted","Data":"d3e9077d53282ce35686c1f23f3bec432bd4ba04dd7cf4c63db3f619b9bac0e9"} Jul 07 11:18:07.013076 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.013008 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" event={"ID":"e4a38c0d-a6cc-46d5-b92f-eeee873eebfd","Type":"ContainerStarted","Data":"261308a70978cf318633af1db1f32f95229789054d2b267f964b4d6e8e6882a3"} Jul 07 11:18:07.013076 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.013047 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" Jul 07 11:18:07.020115 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.020100 2576 scope.go:117] "RemoveContainer" containerID="d42ae276f05443866ded4b17c5998567c88654603c8d3689276b7585f892bfd4" Jul 07 11:18:07.041049 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.040975 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" podStartSLOduration=2.040960548 podStartE2EDuration="2.040960548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:18:07.033908595 +0000 UTC m=+431.510566569" watchObservedRunningTime="2026-07-07 11:18:07.040960548 +0000 UTC m=+431.517618528" Jul 07 11:18:07.106645 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.106617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a9a71a3-2f78-441b-b04c-cbef99c5ea53-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q4kc5\" (UID: \"2a9a71a3-2f78-441b-b04c-cbef99c5ea53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" Jul 07 11:18:07.106741 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.106663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwgcd\" (UniqueName: \"kubernetes.io/projected/2a9a71a3-2f78-441b-b04c-cbef99c5ea53-kube-api-access-hwgcd\") pod \"kuadrant-operator-controller-manager-86878c769f-q4kc5\" (UID: \"2a9a71a3-2f78-441b-b04c-cbef99c5ea53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" Jul 07 11:18:07.106964 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.106945 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a9a71a3-2f78-441b-b04c-cbef99c5ea53-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q4kc5\" (UID: \"2a9a71a3-2f78-441b-b04c-cbef99c5ea53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" Jul 07 11:18:07.115654 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.115628 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwgcd\" (UniqueName: \"kubernetes.io/projected/2a9a71a3-2f78-441b-b04c-cbef99c5ea53-kube-api-access-hwgcd\") pod \"kuadrant-operator-controller-manager-86878c769f-q4kc5\" (UID: \"2a9a71a3-2f78-441b-b04c-cbef99c5ea53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" Jul 07 11:18:07.252532 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.252503 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" Jul 07 11:18:07.390897 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:07.390869 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5"] Jul 07 11:18:07.392609 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:18:07.392581 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a9a71a3_2f78_441b_b04c_cbef99c5ea53.slice/crio-89d9101564ba7c508bade2a9ff09f5c999619d384dd183864771f5f525ef05d8 WatchSource:0}: Error finding container 89d9101564ba7c508bade2a9ff09f5c999619d384dd183864771f5f525ef05d8: Status 404 returned error can't find the container with id 89d9101564ba7c508bade2a9ff09f5c999619d384dd183864771f5f525ef05d8 Jul 07 11:18:08.019377 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:08.019333 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" event={"ID":"2a9a71a3-2f78-441b-b04c-cbef99c5ea53","Type":"ContainerStarted","Data":"212d741544cbc12abc1315c82fe0016015727e9b840f9f6de6ca679540298e7b"} Jul 07 11:18:08.019823 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:08.019439 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" Jul 07 11:18:08.019823 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:08.019469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" event={"ID":"2a9a71a3-2f78-441b-b04c-cbef99c5ea53","Type":"ContainerStarted","Data":"89d9101564ba7c508bade2a9ff09f5c999619d384dd183864771f5f525ef05d8"} Jul 07 11:18:08.054031 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:08.054002 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="430cbbe3-3b95-41bc-9bd2-884ccc35937e" path="/var/lib/kubelet/pods/430cbbe3-3b95-41bc-9bd2-884ccc35937e/volumes" Jul 07 11:18:08.054380 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:08.054360 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85282452-1470-4197-8170-fdff3d0892c1" path="/var/lib/kubelet/pods/85282452-1470-4197-8170-fdff3d0892c1/volumes" Jul 07 11:18:08.076125 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:08.076075 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" podStartSLOduration=2.076060563 podStartE2EDuration="2.076060563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:18:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:18:08.07393364 +0000 UTC m=+432.550591600" watchObservedRunningTime="2026-07-07 11:18:08.076060563 +0000 UTC m=+432.552718524" Jul 07 11:18:18.023697 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:18.023626 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" Jul 07 11:18:19.028913 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:19.028887 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" Jul 07 11:18:19.094426 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:19.094370 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26"] Jul 07 11:18:19.094601 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:19.094552 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" podUID="e4a38c0d-a6cc-46d5-b92f-eeee873eebfd" containerName="manager" containerID="cri-o://d3e9077d53282ce35686c1f23f3bec432bd4ba04dd7cf4c63db3f619b9bac0e9" gracePeriod=10 Jul 07 11:18:19.344030 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:19.344004 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" Jul 07 11:18:19.403976 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:19.403944 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4a38c0d-a6cc-46d5-b92f-eeee873eebfd-extensions-socket-volume\") pod \"e4a38c0d-a6cc-46d5-b92f-eeee873eebfd\" (UID: \"e4a38c0d-a6cc-46d5-b92f-eeee873eebfd\") " Jul 07 11:18:19.404144 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:19.404072 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54zz2\" (UniqueName: \"kubernetes.io/projected/e4a38c0d-a6cc-46d5-b92f-eeee873eebfd-kube-api-access-54zz2\") pod \"e4a38c0d-a6cc-46d5-b92f-eeee873eebfd\" (UID: \"e4a38c0d-a6cc-46d5-b92f-eeee873eebfd\") " Jul 07 11:18:19.404314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:19.404291 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4a38c0d-a6cc-46d5-b92f-eeee873eebfd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e4a38c0d-a6cc-46d5-b92f-eeee873eebfd" (UID: "e4a38c0d-a6cc-46d5-b92f-eeee873eebfd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:18:19.406224 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:19.406192 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4a38c0d-a6cc-46d5-b92f-eeee873eebfd-kube-api-access-54zz2" (OuterVolumeSpecName: "kube-api-access-54zz2") pod "e4a38c0d-a6cc-46d5-b92f-eeee873eebfd" (UID: "e4a38c0d-a6cc-46d5-b92f-eeee873eebfd"). InnerVolumeSpecName "kube-api-access-54zz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:18:19.505544 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:19.505513 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54zz2\" (UniqueName: \"kubernetes.io/projected/e4a38c0d-a6cc-46d5-b92f-eeee873eebfd-kube-api-access-54zz2\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:18:19.505544 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:19.505538 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4a38c0d-a6cc-46d5-b92f-eeee873eebfd-extensions-socket-volume\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:18:20.084210 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:20.084178 2576 generic.go:356] "Generic (PLEG): container finished" podID="e4a38c0d-a6cc-46d5-b92f-eeee873eebfd" containerID="d3e9077d53282ce35686c1f23f3bec432bd4ba04dd7cf4c63db3f619b9bac0e9" exitCode=0 Jul 07 11:18:20.084667 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:20.084218 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" Jul 07 11:18:20.084667 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:20.084261 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" event={"ID":"e4a38c0d-a6cc-46d5-b92f-eeee873eebfd","Type":"ContainerDied","Data":"d3e9077d53282ce35686c1f23f3bec432bd4ba04dd7cf4c63db3f619b9bac0e9"} Jul 07 11:18:20.084667 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:20.084312 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26" event={"ID":"e4a38c0d-a6cc-46d5-b92f-eeee873eebfd","Type":"ContainerDied","Data":"261308a70978cf318633af1db1f32f95229789054d2b267f964b4d6e8e6882a3"} Jul 07 11:18:20.084667 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:20.084337 2576 scope.go:117] "RemoveContainer" containerID="d3e9077d53282ce35686c1f23f3bec432bd4ba04dd7cf4c63db3f619b9bac0e9" Jul 07 11:18:20.093780 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:20.093760 2576 scope.go:117] "RemoveContainer" containerID="d3e9077d53282ce35686c1f23f3bec432bd4ba04dd7cf4c63db3f619b9bac0e9" Jul 07 11:18:20.094090 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:18:20.094067 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3e9077d53282ce35686c1f23f3bec432bd4ba04dd7cf4c63db3f619b9bac0e9\": container with ID starting with d3e9077d53282ce35686c1f23f3bec432bd4ba04dd7cf4c63db3f619b9bac0e9 not found: ID does not exist" containerID="d3e9077d53282ce35686c1f23f3bec432bd4ba04dd7cf4c63db3f619b9bac0e9" Jul 07 11:18:20.094180 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:20.094103 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e9077d53282ce35686c1f23f3bec432bd4ba04dd7cf4c63db3f619b9bac0e9"} err="failed to get container status \"d3e9077d53282ce35686c1f23f3bec432bd4ba04dd7cf4c63db3f619b9bac0e9\": rpc error: code = NotFound desc = could not find container \"d3e9077d53282ce35686c1f23f3bec432bd4ba04dd7cf4c63db3f619b9bac0e9\": container with ID starting with d3e9077d53282ce35686c1f23f3bec432bd4ba04dd7cf4c63db3f619b9bac0e9 not found: ID does not exist" Jul 07 11:18:20.131795 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:20.131762 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26"] Jul 07 11:18:20.147089 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:20.147065 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qcw26"] Jul 07 11:18:22.055087 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:22.055051 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4a38c0d-a6cc-46d5-b92f-eeee873eebfd" path="/var/lib/kubelet/pods/e4a38c0d-a6cc-46d5-b92f-eeee873eebfd/volumes" Jul 07 11:18:25.055269 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.055228 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-789c65bb86-pc5fp" podUID="ce559182-1025-415f-81ed-66e7ab11fb4f" containerName="console" containerID="cri-o://215ddcd87bfc241da701b4a391a35a95d8ca26b0cf14322d1e8a1b918a3b0eed" gracePeriod=15 Jul 07 11:18:25.295823 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.295795 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:18:25.448598 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.448568 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce559182-1025-415f-81ed-66e7ab11fb4f-console-oauth-config\") pod \"ce559182-1025-415f-81ed-66e7ab11fb4f\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " Jul 07 11:18:25.448598 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.448600 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-service-ca\") pod \"ce559182-1025-415f-81ed-66e7ab11fb4f\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " Jul 07 11:18:25.448834 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.448625 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-oauth-serving-cert\") pod \"ce559182-1025-415f-81ed-66e7ab11fb4f\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " Jul 07 11:18:25.448834 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.448651 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-console-config\") pod \"ce559182-1025-415f-81ed-66e7ab11fb4f\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " Jul 07 11:18:25.448834 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.448707 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-trusted-ca-bundle\") pod \"ce559182-1025-415f-81ed-66e7ab11fb4f\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " Jul 07 11:18:25.448834 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.448734 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce559182-1025-415f-81ed-66e7ab11fb4f-console-serving-cert\") pod \"ce559182-1025-415f-81ed-66e7ab11fb4f\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " Jul 07 11:18:25.448834 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.448780 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4hl8\" (UniqueName: \"kubernetes.io/projected/ce559182-1025-415f-81ed-66e7ab11fb4f-kube-api-access-n4hl8\") pod \"ce559182-1025-415f-81ed-66e7ab11fb4f\" (UID: \"ce559182-1025-415f-81ed-66e7ab11fb4f\") " Jul 07 11:18:25.449106 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.449081 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-service-ca" (OuterVolumeSpecName: "service-ca") pod "ce559182-1025-415f-81ed-66e7ab11fb4f" (UID: "ce559182-1025-415f-81ed-66e7ab11fb4f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:18:25.449171 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.449115 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-console-config" (OuterVolumeSpecName: "console-config") pod "ce559182-1025-415f-81ed-66e7ab11fb4f" (UID: "ce559182-1025-415f-81ed-66e7ab11fb4f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:18:25.449171 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.449123 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ce559182-1025-415f-81ed-66e7ab11fb4f" (UID: "ce559182-1025-415f-81ed-66e7ab11fb4f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:18:25.449171 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.449153 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ce559182-1025-415f-81ed-66e7ab11fb4f" (UID: "ce559182-1025-415f-81ed-66e7ab11fb4f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:18:25.450944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.450915 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce559182-1025-415f-81ed-66e7ab11fb4f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ce559182-1025-415f-81ed-66e7ab11fb4f" (UID: "ce559182-1025-415f-81ed-66e7ab11fb4f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 11:18:25.451044 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.450994 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce559182-1025-415f-81ed-66e7ab11fb4f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ce559182-1025-415f-81ed-66e7ab11fb4f" (UID: "ce559182-1025-415f-81ed-66e7ab11fb4f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 11:18:25.451122 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.451101 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce559182-1025-415f-81ed-66e7ab11fb4f-kube-api-access-n4hl8" (OuterVolumeSpecName: "kube-api-access-n4hl8") pod "ce559182-1025-415f-81ed-66e7ab11fb4f" (UID: "ce559182-1025-415f-81ed-66e7ab11fb4f"). InnerVolumeSpecName "kube-api-access-n4hl8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:18:25.550370 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.550335 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-trusted-ca-bundle\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:18:25.550370 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.550363 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce559182-1025-415f-81ed-66e7ab11fb4f-console-serving-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:18:25.550370 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.550373 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4hl8\" (UniqueName: \"kubernetes.io/projected/ce559182-1025-415f-81ed-66e7ab11fb4f-kube-api-access-n4hl8\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:18:25.550596 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.550381 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce559182-1025-415f-81ed-66e7ab11fb4f-console-oauth-config\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:18:25.550596 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.550390 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-service-ca\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:18:25.550596 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.550421 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-oauth-serving-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:18:25.550596 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:25.550432 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce559182-1025-415f-81ed-66e7ab11fb4f-console-config\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:18:26.115207 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:26.115171 2576 generic.go:356] "Generic (PLEG): container finished" podID="ce559182-1025-415f-81ed-66e7ab11fb4f" containerID="215ddcd87bfc241da701b4a391a35a95d8ca26b0cf14322d1e8a1b918a3b0eed" exitCode=0 Jul 07 11:18:26.115562 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:26.115216 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789c65bb86-pc5fp" Jul 07 11:18:26.115562 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:26.115223 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789c65bb86-pc5fp" event={"ID":"ce559182-1025-415f-81ed-66e7ab11fb4f","Type":"ContainerDied","Data":"215ddcd87bfc241da701b4a391a35a95d8ca26b0cf14322d1e8a1b918a3b0eed"} Jul 07 11:18:26.115562 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:26.115273 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789c65bb86-pc5fp" event={"ID":"ce559182-1025-415f-81ed-66e7ab11fb4f","Type":"ContainerDied","Data":"9604cd1904a3912763aa3c5e11642f5c7830285507a46a2528848efea4c73137"} Jul 07 11:18:26.115562 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:26.115295 2576 scope.go:117] "RemoveContainer" containerID="215ddcd87bfc241da701b4a391a35a95d8ca26b0cf14322d1e8a1b918a3b0eed" Jul 07 11:18:26.124206 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:26.124183 2576 scope.go:117] "RemoveContainer" containerID="215ddcd87bfc241da701b4a391a35a95d8ca26b0cf14322d1e8a1b918a3b0eed" Jul 07 11:18:26.124506 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:18:26.124487 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"215ddcd87bfc241da701b4a391a35a95d8ca26b0cf14322d1e8a1b918a3b0eed\": container with ID starting with 215ddcd87bfc241da701b4a391a35a95d8ca26b0cf14322d1e8a1b918a3b0eed not found: ID does not exist" containerID="215ddcd87bfc241da701b4a391a35a95d8ca26b0cf14322d1e8a1b918a3b0eed" Jul 07 11:18:26.124566 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:26.124515 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"215ddcd87bfc241da701b4a391a35a95d8ca26b0cf14322d1e8a1b918a3b0eed"} err="failed to get container status \"215ddcd87bfc241da701b4a391a35a95d8ca26b0cf14322d1e8a1b918a3b0eed\": rpc error: code = NotFound desc = could not find container \"215ddcd87bfc241da701b4a391a35a95d8ca26b0cf14322d1e8a1b918a3b0eed\": container with ID starting with 215ddcd87bfc241da701b4a391a35a95d8ca26b0cf14322d1e8a1b918a3b0eed not found: ID does not exist" Jul 07 11:18:26.140072 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:26.140043 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789c65bb86-pc5fp"] Jul 07 11:18:26.143411 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:26.143379 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-789c65bb86-pc5fp"] Jul 07 11:18:28.054877 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:28.054844 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce559182-1025-415f-81ed-66e7ab11fb4f" path="/var/lib/kubelet/pods/ce559182-1025-415f-81ed-66e7ab11fb4f/volumes" Jul 07 11:18:35.541779 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.541748 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d"] Jul 07 11:18:35.542216 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.542196 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce559182-1025-415f-81ed-66e7ab11fb4f" containerName="console" Jul 07 11:18:35.542216 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.542215 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce559182-1025-415f-81ed-66e7ab11fb4f" containerName="console" Jul 07 11:18:35.542328 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.542259 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4a38c0d-a6cc-46d5-b92f-eeee873eebfd" containerName="manager" Jul 07 11:18:35.542328 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.542269 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4a38c0d-a6cc-46d5-b92f-eeee873eebfd" containerName="manager" Jul 07 11:18:35.542444 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.542352 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce559182-1025-415f-81ed-66e7ab11fb4f" containerName="console" Jul 07 11:18:35.542444 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.542365 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4a38c0d-a6cc-46d5-b92f-eeee873eebfd" containerName="manager" Jul 07 11:18:35.545050 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.545028 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.548436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.548409 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-b2txd\"" Jul 07 11:18:35.563147 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.563123 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d"] Jul 07 11:18:35.618313 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.618279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c26b065b-9fa4-43b2-8803-e57c245ca099-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.618480 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.618320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26b065b-9fa4-43b2-8803-e57c245ca099-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.618480 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.618346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvrqh\" (UniqueName: \"kubernetes.io/projected/c26b065b-9fa4-43b2-8803-e57c245ca099-kube-api-access-wvrqh\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.618480 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.618421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c26b065b-9fa4-43b2-8803-e57c245ca099-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.618480 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.618449 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c26b065b-9fa4-43b2-8803-e57c245ca099-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.618480 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.618476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c26b065b-9fa4-43b2-8803-e57c245ca099-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.618685 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.618520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26b065b-9fa4-43b2-8803-e57c245ca099-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.618685 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.618536 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c26b065b-9fa4-43b2-8803-e57c245ca099-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.618685 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.618563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c26b065b-9fa4-43b2-8803-e57c245ca099-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.719717 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.719646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c26b065b-9fa4-43b2-8803-e57c245ca099-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.719717 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.719675 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c26b065b-9fa4-43b2-8803-e57c245ca099-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.719717 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.719696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c26b065b-9fa4-43b2-8803-e57c245ca099-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.719967 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.719745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26b065b-9fa4-43b2-8803-e57c245ca099-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.719967 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.719769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c26b065b-9fa4-43b2-8803-e57c245ca099-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.719967 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.719811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c26b065b-9fa4-43b2-8803-e57c245ca099-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.719967 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.719868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c26b065b-9fa4-43b2-8803-e57c245ca099-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.719967 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.719893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26b065b-9fa4-43b2-8803-e57c245ca099-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.719967 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.719918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvrqh\" (UniqueName: \"kubernetes.io/projected/c26b065b-9fa4-43b2-8803-e57c245ca099-kube-api-access-wvrqh\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.720262 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.720170 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c26b065b-9fa4-43b2-8803-e57c245ca099-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.720381 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.720353 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26b065b-9fa4-43b2-8803-e57c245ca099-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.720633 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.720451 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26b065b-9fa4-43b2-8803-e57c245ca099-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.720633 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.720477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c26b065b-9fa4-43b2-8803-e57c245ca099-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.720633 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.720531 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c26b065b-9fa4-43b2-8803-e57c245ca099-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.722103 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.722082 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c26b065b-9fa4-43b2-8803-e57c245ca099-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.722666 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.722643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c26b065b-9fa4-43b2-8803-e57c245ca099-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.728742 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.728681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c26b065b-9fa4-43b2-8803-e57c245ca099-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.729744 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.729721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvrqh\" (UniqueName: \"kubernetes.io/projected/c26b065b-9fa4-43b2-8803-e57c245ca099-kube-api-access-wvrqh\") pod \"maas-default-gateway-openshift-default-56654dcf7-vd55d\" (UID: \"c26b065b-9fa4-43b2-8803-e57c245ca099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:35.854967 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:35.854929 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:36.002584 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:36.002507 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d"] Jul 07 11:18:36.005644 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:18:36.005604 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26b065b_9fa4_43b2_8803_e57c245ca099.slice/crio-5ee7d376e670c51aacae07e3121a2cce5891d8bc250e22912a86453c9173518c WatchSource:0}: Error finding container 5ee7d376e670c51aacae07e3121a2cce5891d8bc250e22912a86453c9173518c: Status 404 returned error can't find the container with id 5ee7d376e670c51aacae07e3121a2cce5891d8bc250e22912a86453c9173518c Jul 07 11:18:36.008251 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:36.008209 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:18:36.008329 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:36.008298 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:18:36.008366 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:36.008339 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:18:36.167119 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:36.167076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" event={"ID":"c26b065b-9fa4-43b2-8803-e57c245ca099","Type":"ContainerStarted","Data":"258ab8b408e855a21041ff940f67f37a6d57dd79021ca066934240ae13d792ff"} Jul 07 11:18:36.167326 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:36.167140 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" event={"ID":"c26b065b-9fa4-43b2-8803-e57c245ca099","Type":"ContainerStarted","Data":"5ee7d376e670c51aacae07e3121a2cce5891d8bc250e22912a86453c9173518c"} Jul 07 11:18:36.197134 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:36.197085 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" podStartSLOduration=1.197070801 podStartE2EDuration="1.197070801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:18:36.19455954 +0000 UTC m=+460.671217502" watchObservedRunningTime="2026-07-07 11:18:36.197070801 +0000 UTC m=+460.673728779" Jul 07 11:18:36.855048 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:36.855017 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:37.292943 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:37.292918 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p8kcb"] Jul 07 11:18:37.295238 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:37.295223 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" Jul 07 11:18:37.297952 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:37.297930 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 11:18:37.298095 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:37.297998 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wwlh8\"" Jul 07 11:18:37.307911 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:37.307891 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p8kcb"] Jul 07 11:18:37.391265 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:37.391231 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p8kcb"] Jul 07 11:18:37.434193 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:37.434162 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77bkr\" (UniqueName: \"kubernetes.io/projected/2e8eda39-64bd-4dae-be79-b3a60c8150dc-kube-api-access-77bkr\") pod \"limitador-limitador-64c94fd64f-p8kcb\" (UID: \"2e8eda39-64bd-4dae-be79-b3a60c8150dc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" Jul 07 11:18:37.434344 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:37.434222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e8eda39-64bd-4dae-be79-b3a60c8150dc-config-file\") pod \"limitador-limitador-64c94fd64f-p8kcb\" (UID: \"2e8eda39-64bd-4dae-be79-b3a60c8150dc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" Jul 07 11:18:37.535527 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:37.535479 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77bkr\" (UniqueName: \"kubernetes.io/projected/2e8eda39-64bd-4dae-be79-b3a60c8150dc-kube-api-access-77bkr\") pod \"limitador-limitador-64c94fd64f-p8kcb\" (UID: \"2e8eda39-64bd-4dae-be79-b3a60c8150dc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" Jul 07 11:18:37.535708 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:37.535569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e8eda39-64bd-4dae-be79-b3a60c8150dc-config-file\") pod \"limitador-limitador-64c94fd64f-p8kcb\" (UID: \"2e8eda39-64bd-4dae-be79-b3a60c8150dc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" Jul 07 11:18:37.536204 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:37.536183 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e8eda39-64bd-4dae-be79-b3a60c8150dc-config-file\") pod \"limitador-limitador-64c94fd64f-p8kcb\" (UID: \"2e8eda39-64bd-4dae-be79-b3a60c8150dc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" Jul 07 11:18:37.546043 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:37.545993 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77bkr\" (UniqueName: \"kubernetes.io/projected/2e8eda39-64bd-4dae-be79-b3a60c8150dc-kube-api-access-77bkr\") pod \"limitador-limitador-64c94fd64f-p8kcb\" (UID: \"2e8eda39-64bd-4dae-be79-b3a60c8150dc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" Jul 07 11:18:37.606119 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:37.606092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" Jul 07 11:18:37.745998 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:37.745974 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p8kcb"] Jul 07 11:18:37.747819 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:18:37.747779 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e8eda39_64bd_4dae_be79_b3a60c8150dc.slice/crio-10c4f1e7de7ccd810d2a669d748cf2f80992dd7eef9bbe5fa7adf1460e0c2099 WatchSource:0}: Error finding container 10c4f1e7de7ccd810d2a669d748cf2f80992dd7eef9bbe5fa7adf1460e0c2099: Status 404 returned error can't find the container with id 10c4f1e7de7ccd810d2a669d748cf2f80992dd7eef9bbe5fa7adf1460e0c2099 Jul 07 11:18:37.860611 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:37.860546 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:38.179305 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:38.179273 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" event={"ID":"2e8eda39-64bd-4dae-be79-b3a60c8150dc","Type":"ContainerStarted","Data":"10c4f1e7de7ccd810d2a669d748cf2f80992dd7eef9bbe5fa7adf1460e0c2099"} Jul 07 11:18:38.179644 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:38.179619 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:38.180460 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:38.180439 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:18:41.200910 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:41.200867 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" event={"ID":"2e8eda39-64bd-4dae-be79-b3a60c8150dc","Type":"ContainerStarted","Data":"1ddc371d959f2e8bd69b20cd491da7c3b18bfe556f9a312848e29d9bcf9eea8c"} Jul 07 11:18:41.201287 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:41.200961 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" Jul 07 11:18:52.207611 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:52.207581 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" Jul 07 11:18:52.228057 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:52.228008 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" podStartSLOduration=12.590838508000001 podStartE2EDuration="15.227992444s" totalImagesPullingTime="2.637153936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:18:41.272287477 +0000 UTC m=+465.748945451" watchObservedRunningTime="2026-07-07 11:18:52.227992444 +0000 UTC m=+476.704650408" Jul 07 11:18:55.134849 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:55.134818 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p8kcb"] Jul 07 11:18:55.135327 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:55.135010 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" podUID="2e8eda39-64bd-4dae-be79-b3a60c8150dc" containerName="limitador" containerID="cri-o://1ddc371d959f2e8bd69b20cd491da7c3b18bfe556f9a312848e29d9bcf9eea8c" gracePeriod=30 Jul 07 11:18:55.674418 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:55.674382 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" Jul 07 11:18:55.675481 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:55.675458 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e8eda39-64bd-4dae-be79-b3a60c8150dc-config-file\") pod \"2e8eda39-64bd-4dae-be79-b3a60c8150dc\" (UID: \"2e8eda39-64bd-4dae-be79-b3a60c8150dc\") " Jul 07 11:18:55.675546 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:55.675502 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77bkr\" (UniqueName: \"kubernetes.io/projected/2e8eda39-64bd-4dae-be79-b3a60c8150dc-kube-api-access-77bkr\") pod \"2e8eda39-64bd-4dae-be79-b3a60c8150dc\" (UID: \"2e8eda39-64bd-4dae-be79-b3a60c8150dc\") " Jul 07 11:18:55.675714 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:55.675691 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e8eda39-64bd-4dae-be79-b3a60c8150dc-config-file" (OuterVolumeSpecName: "config-file") pod "2e8eda39-64bd-4dae-be79-b3a60c8150dc" (UID: "2e8eda39-64bd-4dae-be79-b3a60c8150dc"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:18:55.677536 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:55.677512 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e8eda39-64bd-4dae-be79-b3a60c8150dc-kube-api-access-77bkr" (OuterVolumeSpecName: "kube-api-access-77bkr") pod "2e8eda39-64bd-4dae-be79-b3a60c8150dc" (UID: "2e8eda39-64bd-4dae-be79-b3a60c8150dc"). InnerVolumeSpecName "kube-api-access-77bkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:18:55.776239 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:55.776183 2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e8eda39-64bd-4dae-be79-b3a60c8150dc-config-file\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:18:55.776239 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:55.776205 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77bkr\" (UniqueName: \"kubernetes.io/projected/2e8eda39-64bd-4dae-be79-b3a60c8150dc-kube-api-access-77bkr\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:18:56.273913 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:56.273885 2576 generic.go:356] "Generic (PLEG): container finished" podID="2e8eda39-64bd-4dae-be79-b3a60c8150dc" containerID="1ddc371d959f2e8bd69b20cd491da7c3b18bfe556f9a312848e29d9bcf9eea8c" exitCode=0 Jul 07 11:18:56.274262 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:56.273932 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" Jul 07 11:18:56.274262 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:56.273941 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" event={"ID":"2e8eda39-64bd-4dae-be79-b3a60c8150dc","Type":"ContainerDied","Data":"1ddc371d959f2e8bd69b20cd491da7c3b18bfe556f9a312848e29d9bcf9eea8c"} Jul 07 11:18:56.274262 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:56.273978 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p8kcb" event={"ID":"2e8eda39-64bd-4dae-be79-b3a60c8150dc","Type":"ContainerDied","Data":"10c4f1e7de7ccd810d2a669d748cf2f80992dd7eef9bbe5fa7adf1460e0c2099"} Jul 07 11:18:56.274262 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:56.274000 2576 scope.go:117] "RemoveContainer" containerID="1ddc371d959f2e8bd69b20cd491da7c3b18bfe556f9a312848e29d9bcf9eea8c" Jul 07 11:18:56.282159 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:56.282131 2576 scope.go:117] "RemoveContainer" containerID="1ddc371d959f2e8bd69b20cd491da7c3b18bfe556f9a312848e29d9bcf9eea8c" Jul 07 11:18:56.282415 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:18:56.282382 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ddc371d959f2e8bd69b20cd491da7c3b18bfe556f9a312848e29d9bcf9eea8c\": container with ID starting with 1ddc371d959f2e8bd69b20cd491da7c3b18bfe556f9a312848e29d9bcf9eea8c not found: ID does not exist" containerID="1ddc371d959f2e8bd69b20cd491da7c3b18bfe556f9a312848e29d9bcf9eea8c" Jul 07 11:18:56.282508 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:56.282423 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ddc371d959f2e8bd69b20cd491da7c3b18bfe556f9a312848e29d9bcf9eea8c"} err="failed to get container status \"1ddc371d959f2e8bd69b20cd491da7c3b18bfe556f9a312848e29d9bcf9eea8c\": rpc error: code = NotFound desc = could not find container \"1ddc371d959f2e8bd69b20cd491da7c3b18bfe556f9a312848e29d9bcf9eea8c\": container with ID starting with 1ddc371d959f2e8bd69b20cd491da7c3b18bfe556f9a312848e29d9bcf9eea8c not found: ID does not exist" Jul 07 11:18:56.292805 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:56.292784 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p8kcb"] Jul 07 11:18:56.297128 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:56.297101 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p8kcb"] Jul 07 11:18:58.054827 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:58.054791 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e8eda39-64bd-4dae-be79-b3a60c8150dc" path="/var/lib/kubelet/pods/2e8eda39-64bd-4dae-be79-b3a60c8150dc/volumes" Jul 07 11:18:58.771623 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:58.771590 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-nlthq"] Jul 07 11:18:58.771906 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:58.771894 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e8eda39-64bd-4dae-be79-b3a60c8150dc" containerName="limitador" Jul 07 11:18:58.771997 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:58.771907 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e8eda39-64bd-4dae-be79-b3a60c8150dc" containerName="limitador" Jul 07 11:18:58.771997 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:58.771958 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e8eda39-64bd-4dae-be79-b3a60c8150dc" containerName="limitador" Jul 07 11:18:58.774734 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:58.774713 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-nlthq" Jul 07 11:18:58.777549 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:58.777526 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 07 11:18:58.777549 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:58.777546 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-gqjzp\"" Jul 07 11:18:58.785255 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:58.785235 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-nlthq"] Jul 07 11:18:58.796927 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:58.796905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfpx8\" (UniqueName: \"kubernetes.io/projected/ca36cdf7-bb96-4e2a-a426-73b24c5c6467-kube-api-access-sfpx8\") pod \"postgres-69fb4594cf-nlthq\" (UID: \"ca36cdf7-bb96-4e2a-a426-73b24c5c6467\") " pod="opendatahub/postgres-69fb4594cf-nlthq" Jul 07 11:18:58.797019 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:58.796974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ca36cdf7-bb96-4e2a-a426-73b24c5c6467-data\") pod \"postgres-69fb4594cf-nlthq\" (UID: \"ca36cdf7-bb96-4e2a-a426-73b24c5c6467\") " pod="opendatahub/postgres-69fb4594cf-nlthq" Jul 07 11:18:58.897542 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:58.897508 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ca36cdf7-bb96-4e2a-a426-73b24c5c6467-data\") pod \"postgres-69fb4594cf-nlthq\" (UID: \"ca36cdf7-bb96-4e2a-a426-73b24c5c6467\") " pod="opendatahub/postgres-69fb4594cf-nlthq" Jul 07 11:18:58.897708 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:58.897586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfpx8\" (UniqueName: \"kubernetes.io/projected/ca36cdf7-bb96-4e2a-a426-73b24c5c6467-kube-api-access-sfpx8\") pod \"postgres-69fb4594cf-nlthq\" (UID: \"ca36cdf7-bb96-4e2a-a426-73b24c5c6467\") " pod="opendatahub/postgres-69fb4594cf-nlthq" Jul 07 11:18:58.897856 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:58.897834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ca36cdf7-bb96-4e2a-a426-73b24c5c6467-data\") pod \"postgres-69fb4594cf-nlthq\" (UID: \"ca36cdf7-bb96-4e2a-a426-73b24c5c6467\") " pod="opendatahub/postgres-69fb4594cf-nlthq" Jul 07 11:18:58.910189 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:58.910169 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfpx8\" (UniqueName: \"kubernetes.io/projected/ca36cdf7-bb96-4e2a-a426-73b24c5c6467-kube-api-access-sfpx8\") pod \"postgres-69fb4594cf-nlthq\" (UID: \"ca36cdf7-bb96-4e2a-a426-73b24c5c6467\") " pod="opendatahub/postgres-69fb4594cf-nlthq" Jul 07 11:18:59.085702 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:59.085637 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-nlthq" Jul 07 11:18:59.249069 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:59.249044 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-nlthq"] Jul 07 11:18:59.250574 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:18:59.250544 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca36cdf7_bb96_4e2a_a426_73b24c5c6467.slice/crio-4ecae0245b5d55e569d69c3486f4563e367180f4571ff25a44902157ed2e9024 WatchSource:0}: Error finding container 4ecae0245b5d55e569d69c3486f4563e367180f4571ff25a44902157ed2e9024: Status 404 returned error can't find the container with id 4ecae0245b5d55e569d69c3486f4563e367180f4571ff25a44902157ed2e9024 Jul 07 11:18:59.290175 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:18:59.290138 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-nlthq" event={"ID":"ca36cdf7-bb96-4e2a-a426-73b24c5c6467","Type":"ContainerStarted","Data":"4ecae0245b5d55e569d69c3486f4563e367180f4571ff25a44902157ed2e9024"} Jul 07 11:19:04.323060 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:04.323024 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-nlthq" event={"ID":"ca36cdf7-bb96-4e2a-a426-73b24c5c6467","Type":"ContainerStarted","Data":"24621551b8f29739a460d859419b4a7bb983554c9e300c7d71312b830937f3cb"} Jul 07 11:19:04.323464 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:04.323090 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-nlthq" Jul 07 11:19:04.343109 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:04.343064 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-nlthq" podStartSLOduration=1.42179948 podStartE2EDuration="6.343048941s" totalImagesPullingTime="4.921249461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:19:04.341534418 +0000 UTC m=+488.818192404" watchObservedRunningTime="2026-07-07 11:19:04.343048941 +0000 UTC m=+488.819706902" Jul 07 11:19:10.359026 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:10.358999 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-nlthq" Jul 07 11:19:12.288708 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.288669 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc"] Jul 07 11:19:12.361918 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.361889 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc"] Jul 07 11:19:12.362064 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.361988 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" Jul 07 11:19:12.365266 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.365239 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 11:19:12.365415 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.365306 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5wltf\"" Jul 07 11:19:12.365415 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.365319 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 11:19:12.402916 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.402890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc\" (UID: \"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" Jul 07 11:19:12.403058 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.402945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q4pd\" (UniqueName: \"kubernetes.io/projected/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-kube-api-access-2q4pd\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc\" (UID: \"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" Jul 07 11:19:12.403058 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.403009 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc\" (UID: \"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" Jul 07 11:19:12.503901 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.503869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc\" (UID: \"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" Jul 07 11:19:12.504041 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.503919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q4pd\" (UniqueName: \"kubernetes.io/projected/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-kube-api-access-2q4pd\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc\" (UID: \"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" Jul 07 11:19:12.504041 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.503943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc\" (UID: \"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" Jul 07 11:19:12.504215 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.504197 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc\" (UID: \"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" Jul 07 11:19:12.504256 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.504228 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc\" (UID: \"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" Jul 07 11:19:12.522439 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.522385 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q4pd\" (UniqueName: \"kubernetes.io/projected/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-kube-api-access-2q4pd\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc\" (UID: \"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" Jul 07 11:19:12.670638 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.670606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" Jul 07 11:19:12.864609 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:12.864574 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc"] Jul 07 11:19:12.866575 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:19:12.866538 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd36e3b8_0894_4aee_a9d5_c8a4a05dec73.slice/crio-2a4cdb8c51c21dc19056e5e55c9e9bc1289a83176eb25d6e88492f3d2416280a WatchSource:0}: Error finding container 2a4cdb8c51c21dc19056e5e55c9e9bc1289a83176eb25d6e88492f3d2416280a: Status 404 returned error can't find the container with id 2a4cdb8c51c21dc19056e5e55c9e9bc1289a83176eb25d6e88492f3d2416280a Jul 07 11:19:13.371144 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:13.371078 2576 generic.go:356] "Generic (PLEG): container finished" podID="bd36e3b8-0894-4aee-a9d5-c8a4a05dec73" containerID="5ffda9713fb964bdedfc56a421a17f1dd2ab07c163aae7017b4058157700b03e" exitCode=0 Jul 07 11:19:13.371144 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:13.371117 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" event={"ID":"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73","Type":"ContainerDied","Data":"5ffda9713fb964bdedfc56a421a17f1dd2ab07c163aae7017b4058157700b03e"} Jul 07 11:19:13.371518 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:13.371150 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" event={"ID":"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73","Type":"ContainerStarted","Data":"2a4cdb8c51c21dc19056e5e55c9e9bc1289a83176eb25d6e88492f3d2416280a"} Jul 07 11:19:15.383141 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:15.383112 2576 generic.go:356] "Generic (PLEG): container finished" podID="bd36e3b8-0894-4aee-a9d5-c8a4a05dec73" containerID="5694ac7d7290a6beb17794a24cda0c5568392fbd463ee56d1e75cad517f566f6" exitCode=0 Jul 07 11:19:15.383534 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:15.383199 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" event={"ID":"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73","Type":"ContainerDied","Data":"5694ac7d7290a6beb17794a24cda0c5568392fbd463ee56d1e75cad517f566f6"} Jul 07 11:19:16.389839 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:16.389806 2576 generic.go:356] "Generic (PLEG): container finished" podID="bd36e3b8-0894-4aee-a9d5-c8a4a05dec73" containerID="71eeb116c21e2ac2539957325323f1146de453d5d272870ee4fb66cdceb28232" exitCode=0 Jul 07 11:19:16.390241 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:16.389889 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" event={"ID":"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73","Type":"ContainerDied","Data":"71eeb116c21e2ac2539957325323f1146de453d5d272870ee4fb66cdceb28232"} Jul 07 11:19:17.528473 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:17.528447 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" Jul 07 11:19:17.646711 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:17.646635 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-bundle\") pod \"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73\" (UID: \"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73\") " Jul 07 11:19:17.646711 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:17.646690 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q4pd\" (UniqueName: \"kubernetes.io/projected/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-kube-api-access-2q4pd\") pod \"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73\" (UID: \"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73\") " Jul 07 11:19:17.646903 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:17.646730 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-util\") pod \"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73\" (UID: \"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73\") " Jul 07 11:19:17.647134 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:17.647112 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-bundle" (OuterVolumeSpecName: "bundle") pod "bd36e3b8-0894-4aee-a9d5-c8a4a05dec73" (UID: "bd36e3b8-0894-4aee-a9d5-c8a4a05dec73"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:19:17.648896 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:17.648874 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-kube-api-access-2q4pd" (OuterVolumeSpecName: "kube-api-access-2q4pd") pod "bd36e3b8-0894-4aee-a9d5-c8a4a05dec73" (UID: "bd36e3b8-0894-4aee-a9d5-c8a4a05dec73"). InnerVolumeSpecName "kube-api-access-2q4pd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:19:17.652038 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:17.652004 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-util" (OuterVolumeSpecName: "util") pod "bd36e3b8-0894-4aee-a9d5-c8a4a05dec73" (UID: "bd36e3b8-0894-4aee-a9d5-c8a4a05dec73"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:19:17.747667 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:17.747645 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q4pd\" (UniqueName: \"kubernetes.io/projected/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-kube-api-access-2q4pd\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:19:17.747667 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:17.747664 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-util\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:19:17.747794 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:17.747673 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd36e3b8-0894-4aee-a9d5-c8a4a05dec73-bundle\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:19:18.405690 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:18.405627 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" Jul 07 11:19:18.405690 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:18.405635 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8jsnrc" event={"ID":"bd36e3b8-0894-4aee-a9d5-c8a4a05dec73","Type":"ContainerDied","Data":"2a4cdb8c51c21dc19056e5e55c9e9bc1289a83176eb25d6e88492f3d2416280a"} Jul 07 11:19:18.405690 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:18.405674 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a4cdb8c51c21dc19056e5e55c9e9bc1289a83176eb25d6e88492f3d2416280a" Jul 07 11:19:26.110536 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.110500 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-k4b2j"] Jul 07 11:19:26.111004 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.110822 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd36e3b8-0894-4aee-a9d5-c8a4a05dec73" containerName="util" Jul 07 11:19:26.111004 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.110833 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd36e3b8-0894-4aee-a9d5-c8a4a05dec73" containerName="util" Jul 07 11:19:26.111004 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.110845 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd36e3b8-0894-4aee-a9d5-c8a4a05dec73" containerName="pull" Jul 07 11:19:26.111004 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.110849 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd36e3b8-0894-4aee-a9d5-c8a4a05dec73" containerName="pull" Jul 07 11:19:26.111004 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.110861 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd36e3b8-0894-4aee-a9d5-c8a4a05dec73" containerName="extract" Jul 07 11:19:26.111004 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.110866 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd36e3b8-0894-4aee-a9d5-c8a4a05dec73" containerName="extract" Jul 07 11:19:26.111004 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.110938 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd36e3b8-0894-4aee-a9d5-c8a4a05dec73" containerName="extract" Jul 07 11:19:26.113672 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.113657 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-k4b2j" Jul 07 11:19:26.116562 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.116543 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 07 11:19:26.116824 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.116809 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 07 11:19:26.117821 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.117792 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-m7xdk\"" Jul 07 11:19:26.132119 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.132097 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-k4b2j"] Jul 07 11:19:26.223941 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.217093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8m8w\" (UniqueName: \"kubernetes.io/projected/991c318b-fd8d-4cb9-96ad-761c942d17a8-kube-api-access-x8m8w\") pod \"keycloak-operator-d8b9d7b4d-k4b2j\" (UID: \"991c318b-fd8d-4cb9-96ad-761c942d17a8\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-k4b2j" Jul 07 11:19:26.318154 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.318122 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8m8w\" (UniqueName: \"kubernetes.io/projected/991c318b-fd8d-4cb9-96ad-761c942d17a8-kube-api-access-x8m8w\") pod \"keycloak-operator-d8b9d7b4d-k4b2j\" (UID: \"991c318b-fd8d-4cb9-96ad-761c942d17a8\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-k4b2j" Jul 07 11:19:26.333189 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.333169 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8m8w\" (UniqueName: \"kubernetes.io/projected/991c318b-fd8d-4cb9-96ad-761c942d17a8-kube-api-access-x8m8w\") pod \"keycloak-operator-d8b9d7b4d-k4b2j\" (UID: \"991c318b-fd8d-4cb9-96ad-761c942d17a8\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-k4b2j" Jul 07 11:19:26.423120 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.423094 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-k4b2j" Jul 07 11:19:26.554962 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:26.554930 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-k4b2j"] Jul 07 11:19:26.555559 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:19:26.555532 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991c318b_fd8d_4cb9_96ad_761c942d17a8.slice/crio-b3ac0f67f8c88e6e00fe7782e3962001f50fb987f2af13c37915971fd2362e17 WatchSource:0}: Error finding container b3ac0f67f8c88e6e00fe7782e3962001f50fb987f2af13c37915971fd2362e17: Status 404 returned error can't find the container with id b3ac0f67f8c88e6e00fe7782e3962001f50fb987f2af13c37915971fd2362e17 Jul 07 11:19:27.454507 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:27.454428 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-k4b2j" event={"ID":"991c318b-fd8d-4cb9-96ad-761c942d17a8","Type":"ContainerStarted","Data":"b3ac0f67f8c88e6e00fe7782e3962001f50fb987f2af13c37915971fd2362e17"} Jul 07 11:19:32.480705 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:32.480651 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-k4b2j" event={"ID":"991c318b-fd8d-4cb9-96ad-761c942d17a8","Type":"ContainerStarted","Data":"b624c1c85c38fa0d9192b43e427cdd74795bb113774bdc41cb3b212f86c39827"} Jul 07 11:19:32.503642 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:19:32.503582 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d8b9d7b4d-k4b2j" podStartSLOduration=0.736149053 podStartE2EDuration="6.503563286s" totalImagesPullingTime="5.767414233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:19:32.501194147 +0000 UTC m=+516.977852136" watchObservedRunningTime="2026-07-07 11:19:32.503563286 +0000 UTC m=+516.980221249" Jul 07 11:21:03.950887 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:03.950853 2576 generic.go:356] "Generic (PLEG): container finished" podID="c26b065b-9fa4-43b2-8803-e57c245ca099" containerID="258ab8b408e855a21041ff940f67f37a6d57dd79021ca066934240ae13d792ff" exitCode=0 Jul 07 11:21:03.951212 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:03.950927 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" event={"ID":"c26b065b-9fa4-43b2-8803-e57c245ca099","Type":"ContainerDied","Data":"258ab8b408e855a21041ff940f67f37a6d57dd79021ca066934240ae13d792ff"} Jul 07 11:21:03.951314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:03.951301 2576 scope.go:117] "RemoveContainer" containerID="258ab8b408e855a21041ff940f67f37a6d57dd79021ca066934240ae13d792ff" Jul 07 11:21:03.952338 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:03.952309 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:21:03.952466 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:03.952387 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:21:03.952538 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:03.952465 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:21:04.958186 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:04.958146 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" event={"ID":"c26b065b-9fa4-43b2-8803-e57c245ca099","Type":"ContainerStarted","Data":"a2325b2b61bf74a55064de60ce78883e544b7ad6e6249f14348ce211169b3a57"} Jul 07 11:21:05.855628 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:05.855593 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:21:05.856746 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:05.856726 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vd55d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 07 11:21:05.856810 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:05.856785 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" podUID="c26b065b-9fa4-43b2-8803-e57c245ca099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 07 11:21:06.856235 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:06.856198 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vd55d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 07 11:21:06.856742 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:06.856261 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" podUID="c26b065b-9fa4-43b2-8803-e57c245ca099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 07 11:21:07.856252 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:07.856211 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vd55d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 07 11:21:07.856769 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:07.856280 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" podUID="c26b065b-9fa4-43b2-8803-e57c245ca099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 07 11:21:08.180100 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:08.180073 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:21:08.855996 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:08.855965 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vd55d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 07 11:21:08.856178 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:08.856018 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" podUID="c26b065b-9fa4-43b2-8803-e57c245ca099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 07 11:21:09.859761 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:09.859734 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:21:09.860956 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:21:09.860931 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vd55d" Jul 07 11:22:45.949944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:45.949907 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz"] Jul 07 11:22:45.952376 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:45.952354 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:45.957033 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:45.957012 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6wgkw\"" Jul 07 11:22:45.957033 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:45.957024 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 07 11:22:45.957203 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:45.957027 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 11:22:45.957203 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:45.957074 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 11:22:45.971470 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:45.971448 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz"] Jul 07 11:22:46.035686 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.035659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c927eb4c-56a6-443a-80b7-9bbc67949cae-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.035832 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.035720 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c927eb4c-56a6-443a-80b7-9bbc67949cae-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.035832 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.035760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c927eb4c-56a6-443a-80b7-9bbc67949cae-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.035832 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.035790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c927eb4c-56a6-443a-80b7-9bbc67949cae-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.035832 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.035821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zhjd\" (UniqueName: \"kubernetes.io/projected/c927eb4c-56a6-443a-80b7-9bbc67949cae-kube-api-access-2zhjd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.035964 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.035879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c927eb4c-56a6-443a-80b7-9bbc67949cae-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.136242 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.136211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c927eb4c-56a6-443a-80b7-9bbc67949cae-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.136447 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.136255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zhjd\" (UniqueName: \"kubernetes.io/projected/c927eb4c-56a6-443a-80b7-9bbc67949cae-kube-api-access-2zhjd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.136447 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.136284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c927eb4c-56a6-443a-80b7-9bbc67949cae-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.136447 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.136331 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c927eb4c-56a6-443a-80b7-9bbc67949cae-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.136447 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.136382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c927eb4c-56a6-443a-80b7-9bbc67949cae-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.136447 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.136431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c927eb4c-56a6-443a-80b7-9bbc67949cae-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.136804 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.136780 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c927eb4c-56a6-443a-80b7-9bbc67949cae-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.137068 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.136828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c927eb4c-56a6-443a-80b7-9bbc67949cae-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.137068 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.136852 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c927eb4c-56a6-443a-80b7-9bbc67949cae-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.138949 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.138904 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c927eb4c-56a6-443a-80b7-9bbc67949cae-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.139626 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.139599 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c927eb4c-56a6-443a-80b7-9bbc67949cae-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.145811 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.145782 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zhjd\" (UniqueName: \"kubernetes.io/projected/c927eb4c-56a6-443a-80b7-9bbc67949cae-kube-api-access-2zhjd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz\" (UID: \"c927eb4c-56a6-443a-80b7-9bbc67949cae\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.262351 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.262246 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:46.401799 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.401762 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz"] Jul 07 11:22:46.402835 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:22:46.402809 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc927eb4c_56a6_443a_80b7_9bbc67949cae.slice/crio-67df98b14af57e7344098ad922b82b66274ba960f34ea82e16b46f5c3395cd0a WatchSource:0}: Error finding container 67df98b14af57e7344098ad922b82b66274ba960f34ea82e16b46f5c3395cd0a: Status 404 returned error can't find the container with id 67df98b14af57e7344098ad922b82b66274ba960f34ea82e16b46f5c3395cd0a Jul 07 11:22:46.404142 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.404127 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 11:22:46.485527 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:46.485494 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" event={"ID":"c927eb4c-56a6-443a-80b7-9bbc67949cae","Type":"ContainerStarted","Data":"67df98b14af57e7344098ad922b82b66274ba960f34ea82e16b46f5c3395cd0a"} Jul 07 11:22:48.498503 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:48.498463 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" event={"ID":"c927eb4c-56a6-443a-80b7-9bbc67949cae","Type":"ContainerStarted","Data":"c4aec47bd7005b1a0e8f020603b001a02e2701ea4c14a3526489e040348f28f1"} Jul 07 11:22:48.529514 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:48.529465 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" podStartSLOduration=2.417091701 podStartE2EDuration="3.529447312s" totalImagesPullingTime="1.112355611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:22:48.526629413 +0000 UTC m=+713.003287386" watchObservedRunningTime="2026-07-07 11:22:48.529447312 +0000 UTC m=+713.006105275" Jul 07 11:22:56.262568 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:56.262526 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:56.263003 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:56.262588 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:56.275201 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:56.275175 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:22:56.552760 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:22:56.552673 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz" Jul 07 11:29:33.536615 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:33.536582 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5"] Jul 07 11:29:33.537116 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:33.536778 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" podUID="2a9a71a3-2f78-441b-b04c-cbef99c5ea53" containerName="manager" containerID="cri-o://212d741544cbc12abc1315c82fe0016015727e9b840f9f6de6ca679540298e7b" gracePeriod=10 Jul 07 11:29:36.396733 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.396707 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" Jul 07 11:29:36.475553 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.475480 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwgcd\" (UniqueName: \"kubernetes.io/projected/2a9a71a3-2f78-441b-b04c-cbef99c5ea53-kube-api-access-hwgcd\") pod \"2a9a71a3-2f78-441b-b04c-cbef99c5ea53\" (UID: \"2a9a71a3-2f78-441b-b04c-cbef99c5ea53\") " Jul 07 11:29:36.475553 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.475519 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a9a71a3-2f78-441b-b04c-cbef99c5ea53-extensions-socket-volume\") pod \"2a9a71a3-2f78-441b-b04c-cbef99c5ea53\" (UID: \"2a9a71a3-2f78-441b-b04c-cbef99c5ea53\") " Jul 07 11:29:36.475925 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.475905 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a9a71a3-2f78-441b-b04c-cbef99c5ea53-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2a9a71a3-2f78-441b-b04c-cbef99c5ea53" (UID: "2a9a71a3-2f78-441b-b04c-cbef99c5ea53"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:29:36.477654 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.477628 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a9a71a3-2f78-441b-b04c-cbef99c5ea53-kube-api-access-hwgcd" (OuterVolumeSpecName: "kube-api-access-hwgcd") pod "2a9a71a3-2f78-441b-b04c-cbef99c5ea53" (UID: "2a9a71a3-2f78-441b-b04c-cbef99c5ea53"). InnerVolumeSpecName "kube-api-access-hwgcd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:29:36.576511 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.576480 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwgcd\" (UniqueName: \"kubernetes.io/projected/2a9a71a3-2f78-441b-b04c-cbef99c5ea53-kube-api-access-hwgcd\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:29:36.576511 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.576507 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a9a71a3-2f78-441b-b04c-cbef99c5ea53-extensions-socket-volume\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:29:36.579687 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.579660 2576 generic.go:356] "Generic (PLEG): container finished" podID="2a9a71a3-2f78-441b-b04c-cbef99c5ea53" containerID="212d741544cbc12abc1315c82fe0016015727e9b840f9f6de6ca679540298e7b" exitCode=0 Jul 07 11:29:36.579812 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.579710 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" Jul 07 11:29:36.579812 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.579746 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" event={"ID":"2a9a71a3-2f78-441b-b04c-cbef99c5ea53","Type":"ContainerDied","Data":"212d741544cbc12abc1315c82fe0016015727e9b840f9f6de6ca679540298e7b"} Jul 07 11:29:36.579812 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.579796 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5" event={"ID":"2a9a71a3-2f78-441b-b04c-cbef99c5ea53","Type":"ContainerDied","Data":"89d9101564ba7c508bade2a9ff09f5c999619d384dd183864771f5f525ef05d8"} Jul 07 11:29:36.579950 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.579819 2576 scope.go:117] "RemoveContainer" containerID="212d741544cbc12abc1315c82fe0016015727e9b840f9f6de6ca679540298e7b" Jul 07 11:29:36.590289 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.590274 2576 scope.go:117] "RemoveContainer" containerID="212d741544cbc12abc1315c82fe0016015727e9b840f9f6de6ca679540298e7b" Jul 07 11:29:36.590518 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:29:36.590497 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"212d741544cbc12abc1315c82fe0016015727e9b840f9f6de6ca679540298e7b\": container with ID starting with 212d741544cbc12abc1315c82fe0016015727e9b840f9f6de6ca679540298e7b not found: ID does not exist" containerID="212d741544cbc12abc1315c82fe0016015727e9b840f9f6de6ca679540298e7b" Jul 07 11:29:36.590589 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.590529 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"212d741544cbc12abc1315c82fe0016015727e9b840f9f6de6ca679540298e7b"} err="failed to get container status \"212d741544cbc12abc1315c82fe0016015727e9b840f9f6de6ca679540298e7b\": rpc error: code = NotFound desc = could not find container \"212d741544cbc12abc1315c82fe0016015727e9b840f9f6de6ca679540298e7b\": container with ID starting with 212d741544cbc12abc1315c82fe0016015727e9b840f9f6de6ca679540298e7b not found: ID does not exist" Jul 07 11:29:36.602446 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.602423 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5"] Jul 07 11:29:36.606944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:36.606926 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q4kc5"] Jul 07 11:29:38.055391 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:29:38.055354 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a9a71a3-2f78-441b-b04c-cbef99c5ea53" path="/var/lib/kubelet/pods/2a9a71a3-2f78-441b-b04c-cbef99c5ea53/volumes" Jul 07 11:30:00.165058 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:00.165026 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723730-978l4"] Jul 07 11:30:00.165417 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:00.165334 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a9a71a3-2f78-441b-b04c-cbef99c5ea53" containerName="manager" Jul 07 11:30:00.165417 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:00.165344 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a9a71a3-2f78-441b-b04c-cbef99c5ea53" containerName="manager" Jul 07 11:30:00.165417 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:00.165408 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a9a71a3-2f78-441b-b04c-cbef99c5ea53" containerName="manager" Jul 07 11:30:00.169296 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:00.169280 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723730-978l4" Jul 07 11:30:00.172085 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:00.172063 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5dvr6\"" Jul 07 11:30:00.178547 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:00.178518 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723730-978l4"] Jul 07 11:30:00.257924 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:00.257896 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znkwk\" (UniqueName: \"kubernetes.io/projected/dc7f3a54-b535-465a-84df-ad11996f6179-kube-api-access-znkwk\") pod \"maas-api-key-cleanup-29723730-978l4\" (UID: \"dc7f3a54-b535-465a-84df-ad11996f6179\") " pod="opendatahub/maas-api-key-cleanup-29723730-978l4" Jul 07 11:30:00.358683 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:00.358653 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znkwk\" (UniqueName: \"kubernetes.io/projected/dc7f3a54-b535-465a-84df-ad11996f6179-kube-api-access-znkwk\") pod \"maas-api-key-cleanup-29723730-978l4\" (UID: \"dc7f3a54-b535-465a-84df-ad11996f6179\") " pod="opendatahub/maas-api-key-cleanup-29723730-978l4" Jul 07 11:30:00.369723 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:00.369702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znkwk\" (UniqueName: \"kubernetes.io/projected/dc7f3a54-b535-465a-84df-ad11996f6179-kube-api-access-znkwk\") pod \"maas-api-key-cleanup-29723730-978l4\" (UID: \"dc7f3a54-b535-465a-84df-ad11996f6179\") " pod="opendatahub/maas-api-key-cleanup-29723730-978l4" Jul 07 11:30:00.480252 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:00.480198 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723730-978l4" Jul 07 11:30:00.615263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:00.615241 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723730-978l4"] Jul 07 11:30:00.617474 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:30:00.617444 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7f3a54_b535_465a_84df_ad11996f6179.slice/crio-c94d28ea0a57241640b559ad972f0d0ac81144715729348f8ff408adb5edb006 WatchSource:0}: Error finding container c94d28ea0a57241640b559ad972f0d0ac81144715729348f8ff408adb5edb006: Status 404 returned error can't find the container with id c94d28ea0a57241640b559ad972f0d0ac81144715729348f8ff408adb5edb006 Jul 07 11:30:00.619243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:00.619222 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 11:30:00.699489 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:00.699463 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723730-978l4" event={"ID":"dc7f3a54-b535-465a-84df-ad11996f6179","Type":"ContainerStarted","Data":"c94d28ea0a57241640b559ad972f0d0ac81144715729348f8ff408adb5edb006"} Jul 07 11:30:03.717334 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:03.717300 2576 generic.go:356] "Generic (PLEG): container finished" podID="dc7f3a54-b535-465a-84df-ad11996f6179" containerID="2921cf2d14e6769eab9fd4b1a0383a5f55896b5ac9e0013e8c465c464e48bfff" exitCode=0 Jul 07 11:30:03.717697 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:03.717360 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723730-978l4" event={"ID":"dc7f3a54-b535-465a-84df-ad11996f6179","Type":"ContainerDied","Data":"2921cf2d14e6769eab9fd4b1a0383a5f55896b5ac9e0013e8c465c464e48bfff"} Jul 07 11:30:04.847470 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:04.847448 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723730-978l4" Jul 07 11:30:04.900106 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:04.900077 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znkwk\" (UniqueName: \"kubernetes.io/projected/dc7f3a54-b535-465a-84df-ad11996f6179-kube-api-access-znkwk\") pod \"dc7f3a54-b535-465a-84df-ad11996f6179\" (UID: \"dc7f3a54-b535-465a-84df-ad11996f6179\") " Jul 07 11:30:04.902197 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:04.902171 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc7f3a54-b535-465a-84df-ad11996f6179-kube-api-access-znkwk" (OuterVolumeSpecName: "kube-api-access-znkwk") pod "dc7f3a54-b535-465a-84df-ad11996f6179" (UID: "dc7f3a54-b535-465a-84df-ad11996f6179"). InnerVolumeSpecName "kube-api-access-znkwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:30:05.001559 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:05.001504 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znkwk\" (UniqueName: \"kubernetes.io/projected/dc7f3a54-b535-465a-84df-ad11996f6179-kube-api-access-znkwk\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:30:05.727975 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:05.727950 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723730-978l4" Jul 07 11:30:05.727975 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:05.727960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723730-978l4" event={"ID":"dc7f3a54-b535-465a-84df-ad11996f6179","Type":"ContainerDied","Data":"c94d28ea0a57241640b559ad972f0d0ac81144715729348f8ff408adb5edb006"} Jul 07 11:30:05.728204 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:05.728002 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c94d28ea0a57241640b559ad972f0d0ac81144715729348f8ff408adb5edb006" Jul 07 11:30:36.933121 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:36.933047 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt"] Jul 07 11:30:36.933563 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:36.933350 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc7f3a54-b535-465a-84df-ad11996f6179" containerName="cleanup" Jul 07 11:30:36.933563 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:36.933359 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc7f3a54-b535-465a-84df-ad11996f6179" containerName="cleanup" Jul 07 11:30:36.933563 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:36.933439 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc7f3a54-b535-465a-84df-ad11996f6179" containerName="cleanup" Jul 07 11:30:36.939923 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:36.939907 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt" Jul 07 11:30:36.945585 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:36.945564 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xn55g\"" Jul 07 11:30:36.958421 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:36.958384 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt"] Jul 07 11:30:37.045812 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:37.045786 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51c3b523-89da-49f0-b9f0-c894a5344a0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jsnxt\" (UID: \"51c3b523-89da-49f0-b9f0-c894a5344a0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt" Jul 07 11:30:37.045923 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:37.045823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htg6t\" (UniqueName: \"kubernetes.io/projected/51c3b523-89da-49f0-b9f0-c894a5344a0c-kube-api-access-htg6t\") pod \"kuadrant-operator-controller-manager-86878c769f-jsnxt\" (UID: \"51c3b523-89da-49f0-b9f0-c894a5344a0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt" Jul 07 11:30:37.146184 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:37.146150 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51c3b523-89da-49f0-b9f0-c894a5344a0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jsnxt\" (UID: \"51c3b523-89da-49f0-b9f0-c894a5344a0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt" Jul 07 11:30:37.146184 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:37.146185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htg6t\" (UniqueName: \"kubernetes.io/projected/51c3b523-89da-49f0-b9f0-c894a5344a0c-kube-api-access-htg6t\") pod \"kuadrant-operator-controller-manager-86878c769f-jsnxt\" (UID: \"51c3b523-89da-49f0-b9f0-c894a5344a0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt" Jul 07 11:30:37.146534 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:37.146513 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51c3b523-89da-49f0-b9f0-c894a5344a0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jsnxt\" (UID: \"51c3b523-89da-49f0-b9f0-c894a5344a0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt" Jul 07 11:30:37.162507 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:37.162489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htg6t\" (UniqueName: \"kubernetes.io/projected/51c3b523-89da-49f0-b9f0-c894a5344a0c-kube-api-access-htg6t\") pod \"kuadrant-operator-controller-manager-86878c769f-jsnxt\" (UID: \"51c3b523-89da-49f0-b9f0-c894a5344a0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt" Jul 07 11:30:37.249926 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:37.249865 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt" Jul 07 11:30:37.409983 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:37.409960 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt"] Jul 07 11:30:37.412014 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:30:37.411987 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c3b523_89da_49f0_b9f0_c894a5344a0c.slice/crio-fb756351e3ecb9ab1769ede3c3d0fccb891f350f4c22d7e1ee5edfb523e0c633 WatchSource:0}: Error finding container fb756351e3ecb9ab1769ede3c3d0fccb891f350f4c22d7e1ee5edfb523e0c633: Status 404 returned error can't find the container with id fb756351e3ecb9ab1769ede3c3d0fccb891f350f4c22d7e1ee5edfb523e0c633 Jul 07 11:30:37.882695 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:37.882651 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt" event={"ID":"51c3b523-89da-49f0-b9f0-c894a5344a0c","Type":"ContainerStarted","Data":"4cc8d01ad6f91ccbdfcdb95e1677fa311aaac6269cf9f64c04885449f12e1ff7"} Jul 07 11:30:37.882966 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:37.882844 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt" Jul 07 11:30:37.882966 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:37.882899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt" event={"ID":"51c3b523-89da-49f0-b9f0-c894a5344a0c","Type":"ContainerStarted","Data":"fb756351e3ecb9ab1769ede3c3d0fccb891f350f4c22d7e1ee5edfb523e0c633"} Jul 07 11:30:37.924018 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:37.923957 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt" podStartSLOduration=1.923942823 podStartE2EDuration="1.923942823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:30:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:30:37.92393397 +0000 UTC m=+1182.400591930" watchObservedRunningTime="2026-07-07 11:30:37.923942823 +0000 UTC m=+1182.400600765" Jul 07 11:30:48.890374 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:30:48.890346 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jsnxt" Jul 07 11:36:37.484204 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.484114 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6"] Jul 07 11:36:37.488153 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.488132 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.491479 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.491456 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-90c5983b-openshift-default-dockercfg-czql4\"" Jul 07 11:36:37.515242 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.515216 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6"] Jul 07 11:36:37.605580 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.603765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-workload-socket\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.605580 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.603816 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c24p\" (UniqueName: \"kubernetes.io/projected/1932c5fd-ea69-4bde-8c32-442b091e54e7-kube-api-access-8c24p\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.605580 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.603858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-envoy\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.605580 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.603882 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-data\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.605580 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.603908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-podinfo\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.605580 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.603950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-credential-socket\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.605580 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.603986 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-workload-certs\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.605580 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.604027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-token\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.605580 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.604071 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1932c5fd-ea69-4bde-8c32-442b091e54e7-istiod-ca-cert\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.705043 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.705014 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-workload-certs\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.705043 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.705054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-token\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.705263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.705155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1932c5fd-ea69-4bde-8c32-442b091e54e7-istiod-ca-cert\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.705263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.705223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-workload-socket\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.705263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.705241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c24p\" (UniqueName: \"kubernetes.io/projected/1932c5fd-ea69-4bde-8c32-442b091e54e7-kube-api-access-8c24p\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.705473 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.705272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-envoy\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.705473 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.705288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-data\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.705473 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.705324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-podinfo\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.705473 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.705379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-credential-socket\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.705728 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.705477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-workload-certs\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.705788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.705723 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-workload-socket\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.705788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.705734 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-data\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.705886 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.705796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-credential-socket\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.705924 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.705901 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1932c5fd-ea69-4bde-8c32-442b091e54e7-istiod-ca-cert\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.707661 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.707636 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-envoy\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.707912 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.707890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-podinfo\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.720662 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.720634 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c24p\" (UniqueName: \"kubernetes.io/projected/1932c5fd-ea69-4bde-8c32-442b091e54e7-kube-api-access-8c24p\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.720828 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.720782 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-token\") pod \"e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.799511 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.799451 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:37.953100 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.953078 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6"] Jul 07 11:36:37.955084 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:36:37.955052 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1932c5fd_ea69_4bde_8c32_442b091e54e7.slice/crio-88a9a8a68b15d268927bb2a5d5e90f4c35033b8e33fa69ced34f6a2de9b20e18 WatchSource:0}: Error finding container 88a9a8a68b15d268927bb2a5d5e90f4c35033b8e33fa69ced34f6a2de9b20e18: Status 404 returned error can't find the container with id 88a9a8a68b15d268927bb2a5d5e90f4c35033b8e33fa69ced34f6a2de9b20e18 Jul 07 11:36:37.957100 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.957065 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:36:37.957157 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.957136 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:36:37.957192 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:37.957165 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:36:38.774443 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:38.774409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" event={"ID":"1932c5fd-ea69-4bde-8c32-442b091e54e7","Type":"ContainerStarted","Data":"aae079967b282a6dfc6e776ec6ea90ed035c8fb5469358dd40bfbecc643325c4"} Jul 07 11:36:38.774788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:38.774462 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" event={"ID":"1932c5fd-ea69-4bde-8c32-442b091e54e7","Type":"ContainerStarted","Data":"88a9a8a68b15d268927bb2a5d5e90f4c35033b8e33fa69ced34f6a2de9b20e18"} Jul 07 11:36:38.800098 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:38.800075 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:38.806313 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:38.806272 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" podStartSLOduration=1.806257308 podStartE2EDuration="1.806257308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:36:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:36:38.80489851 +0000 UTC m=+1543.281556471" watchObservedRunningTime="2026-07-07 11:36:38.806257308 +0000 UTC m=+1543.282915268" Jul 07 11:36:39.805490 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:39.805459 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:40.783890 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:40.783850 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:40.784828 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:40.784805 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:43.963868 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:43.963834 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6"] Jul 07 11:36:43.964435 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:43.964057 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" podUID="1932c5fd-ea69-4bde-8c32-442b091e54e7" containerName="istio-proxy" containerID="cri-o://aae079967b282a6dfc6e776ec6ea90ed035c8fb5469358dd40bfbecc643325c4" gracePeriod=30 Jul 07 11:36:49.623058 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.623029 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:49.715088 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.715065 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-envoy\") pod \"1932c5fd-ea69-4bde-8c32-442b091e54e7\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " Jul 07 11:36:49.715257 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.715099 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-podinfo\") pod \"1932c5fd-ea69-4bde-8c32-442b091e54e7\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " Jul 07 11:36:49.715257 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.715122 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-token\") pod \"1932c5fd-ea69-4bde-8c32-442b091e54e7\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " Jul 07 11:36:49.715257 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.715147 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1932c5fd-ea69-4bde-8c32-442b091e54e7-istiod-ca-cert\") pod \"1932c5fd-ea69-4bde-8c32-442b091e54e7\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " Jul 07 11:36:49.715461 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.715311 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c24p\" (UniqueName: \"kubernetes.io/projected/1932c5fd-ea69-4bde-8c32-442b091e54e7-kube-api-access-8c24p\") pod \"1932c5fd-ea69-4bde-8c32-442b091e54e7\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " Jul 07 11:36:49.715461 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.715455 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-credential-socket\") pod \"1932c5fd-ea69-4bde-8c32-442b091e54e7\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " Jul 07 11:36:49.715573 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.715527 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-data\") pod \"1932c5fd-ea69-4bde-8c32-442b091e54e7\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " Jul 07 11:36:49.715573 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.715567 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-workload-socket\") pod \"1932c5fd-ea69-4bde-8c32-442b091e54e7\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " Jul 07 11:36:49.715688 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.715591 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-workload-certs\") pod \"1932c5fd-ea69-4bde-8c32-442b091e54e7\" (UID: \"1932c5fd-ea69-4bde-8c32-442b091e54e7\") " Jul 07 11:36:49.715747 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.715692 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1932c5fd-ea69-4bde-8c32-442b091e54e7" (UID: "1932c5fd-ea69-4bde-8c32-442b091e54e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:36:49.715847 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.715823 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1932c5fd-ea69-4bde-8c32-442b091e54e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1932c5fd-ea69-4bde-8c32-442b091e54e7" (UID: "1932c5fd-ea69-4bde-8c32-442b091e54e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:36:49.716063 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.716047 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1932c5fd-ea69-4bde-8c32-442b091e54e7" (UID: "1932c5fd-ea69-4bde-8c32-442b091e54e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:36:49.716153 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.716130 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1932c5fd-ea69-4bde-8c32-442b091e54e7-istiod-ca-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:36:49.716221 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.716161 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-credential-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:36:49.716272 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.716064 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1932c5fd-ea69-4bde-8c32-442b091e54e7" (UID: "1932c5fd-ea69-4bde-8c32-442b091e54e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:36:49.716450 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.716426 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "1932c5fd-ea69-4bde-8c32-442b091e54e7" (UID: "1932c5fd-ea69-4bde-8c32-442b091e54e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:36:49.717631 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.717603 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1932c5fd-ea69-4bde-8c32-442b091e54e7" (UID: "1932c5fd-ea69-4bde-8c32-442b091e54e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:36:49.717722 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.717635 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "1932c5fd-ea69-4bde-8c32-442b091e54e7" (UID: "1932c5fd-ea69-4bde-8c32-442b091e54e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:36:49.717896 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.717873 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1932c5fd-ea69-4bde-8c32-442b091e54e7" (UID: "1932c5fd-ea69-4bde-8c32-442b091e54e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 11:36:49.717967 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.717884 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1932c5fd-ea69-4bde-8c32-442b091e54e7-kube-api-access-8c24p" (OuterVolumeSpecName: "kube-api-access-8c24p") pod "1932c5fd-ea69-4bde-8c32-442b091e54e7" (UID: "1932c5fd-ea69-4bde-8c32-442b091e54e7"). InnerVolumeSpecName "kube-api-access-8c24p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:36:49.817484 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.817455 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-envoy\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:36:49.817484 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.817477 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-podinfo\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:36:49.817484 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.817485 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-token\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:36:49.817686 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.817493 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c24p\" (UniqueName: \"kubernetes.io/projected/1932c5fd-ea69-4bde-8c32-442b091e54e7-kube-api-access-8c24p\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:36:49.817686 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.817502 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-istio-data\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:36:49.817686 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.817510 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-workload-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:36:49.817686 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.817517 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1932c5fd-ea69-4bde-8c32-442b091e54e7-workload-certs\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:36:49.843457 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.843425 2576 generic.go:356] "Generic (PLEG): container finished" podID="1932c5fd-ea69-4bde-8c32-442b091e54e7" containerID="aae079967b282a6dfc6e776ec6ea90ed035c8fb5469358dd40bfbecc643325c4" exitCode=0 Jul 07 11:36:49.843597 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.843476 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" Jul 07 11:36:49.843597 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.843505 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" event={"ID":"1932c5fd-ea69-4bde-8c32-442b091e54e7","Type":"ContainerDied","Data":"aae079967b282a6dfc6e776ec6ea90ed035c8fb5469358dd40bfbecc643325c4"} Jul 07 11:36:49.843597 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.843581 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6" event={"ID":"1932c5fd-ea69-4bde-8c32-442b091e54e7","Type":"ContainerDied","Data":"88a9a8a68b15d268927bb2a5d5e90f4c35033b8e33fa69ced34f6a2de9b20e18"} Jul 07 11:36:49.843745 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.843605 2576 scope.go:117] "RemoveContainer" containerID="aae079967b282a6dfc6e776ec6ea90ed035c8fb5469358dd40bfbecc643325c4" Jul 07 11:36:49.853217 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.853203 2576 scope.go:117] "RemoveContainer" containerID="aae079967b282a6dfc6e776ec6ea90ed035c8fb5469358dd40bfbecc643325c4" Jul 07 11:36:49.853520 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:36:49.853498 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aae079967b282a6dfc6e776ec6ea90ed035c8fb5469358dd40bfbecc643325c4\": container with ID starting with aae079967b282a6dfc6e776ec6ea90ed035c8fb5469358dd40bfbecc643325c4 not found: ID does not exist" containerID="aae079967b282a6dfc6e776ec6ea90ed035c8fb5469358dd40bfbecc643325c4" Jul 07 11:36:49.853609 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.853525 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aae079967b282a6dfc6e776ec6ea90ed035c8fb5469358dd40bfbecc643325c4"} err="failed to get container status \"aae079967b282a6dfc6e776ec6ea90ed035c8fb5469358dd40bfbecc643325c4\": rpc error: code = NotFound desc = could not find container \"aae079967b282a6dfc6e776ec6ea90ed035c8fb5469358dd40bfbecc643325c4\": container with ID starting with aae079967b282a6dfc6e776ec6ea90ed035c8fb5469358dd40bfbecc643325c4 not found: ID does not exist" Jul 07 11:36:49.872880 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.872861 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6"] Jul 07 11:36:49.877417 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:49.877384 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-90c5983b-openshift-default-578687bdd5-xvgd6"] Jul 07 11:36:50.055277 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.055199 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1932c5fd-ea69-4bde-8c32-442b091e54e7" path="/var/lib/kubelet/pods/1932c5fd-ea69-4bde-8c32-442b091e54e7/volumes" Jul 07 11:36:50.668704 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.668660 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t"] Jul 07 11:36:50.669165 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.668996 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1932c5fd-ea69-4bde-8c32-442b091e54e7" containerName="istio-proxy" Jul 07 11:36:50.669165 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.669009 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1932c5fd-ea69-4bde-8c32-442b091e54e7" containerName="istio-proxy" Jul 07 11:36:50.669165 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.669070 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1932c5fd-ea69-4bde-8c32-442b091e54e7" containerName="istio-proxy" Jul 07 11:36:50.673432 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.673412 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.681215 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:36:50.681185 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" is forbidden: User \"system:node:ip-10-0-137-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-8.ec2.internal' and this object" podUID="b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.681324 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:36:50.681209 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-ait-7b29c9bf-openshift-default-dockercfg-bh5gt\" is forbidden: User \"system:node:ip-10-0-137-8.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-8.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"e2e-ait-7b29c9bf-openshift-default-dockercfg-bh5gt\"" type="*v1.Secret" Jul 07 11:36:50.717598 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.717569 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t"] Jul 07 11:36:50.826152 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.826119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-credential-socket\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.826152 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.826152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-envoy\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.826423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.826178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-workload-certs\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.826423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.826200 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istiod-ca-cert\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.826423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.826286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-data\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.826423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.826324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-podinfo\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.826423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.826378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-token\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.826423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.826421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-workload-socket\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.826624 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.826450 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwpkr\" (UniqueName: \"kubernetes.io/projected/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-kube-api-access-pwpkr\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.926916 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.926841 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-podinfo\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.926916 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.926891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-token\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.927120 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.926928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-workload-socket\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.927120 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.926960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwpkr\" (UniqueName: \"kubernetes.io/projected/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-kube-api-access-pwpkr\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.927120 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.927005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-credential-socket\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.927120 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.927028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-envoy\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.927120 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.927065 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-workload-certs\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.927120 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.927099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istiod-ca-cert\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.927444 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.927181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-data\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.927524 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.927501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-workload-certs\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.927628 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.927603 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-workload-socket\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.927741 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.927637 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-data\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.927741 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.927678 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-credential-socket\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.928104 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.928083 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istiod-ca-cert\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.929515 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.929489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-envoy\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.929597 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.929557 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-podinfo\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.942342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.942317 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwpkr\" (UniqueName: \"kubernetes.io/projected/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-kube-api-access-pwpkr\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:50.942589 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:50.942572 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-token\") pod \"e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:51.984543 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:51.984507 2576 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" secret="" err="failed to sync secret cache: timed out waiting for the condition" Jul 07 11:36:51.984980 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:51.984618 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:52.089503 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:52.089449 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7b29c9bf-openshift-default-dockercfg-bh5gt\"" Jul 07 11:36:52.154209 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:52.153942 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t"] Jul 07 11:36:52.154386 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:52.154338 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:36:52.154518 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:52.154495 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:36:52.154609 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:52.154588 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:36:52.862076 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:52.862038 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" event={"ID":"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf","Type":"ContainerStarted","Data":"95f057dfd5f986d898a1715e7220714ee9a904e59fa5f43ebc493f64b9f295a2"} Jul 07 11:36:52.862243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:52.862091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" event={"ID":"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf","Type":"ContainerStarted","Data":"1355d293d39fe652d0bc0e760a56a838a1b459f67bef04549fbe973cb6fca0a7"} Jul 07 11:36:52.883886 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:52.883840 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" podStartSLOduration=2.883827246 podStartE2EDuration="2.883827246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:36:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:36:52.881331754 +0000 UTC m=+1557.357989741" watchObservedRunningTime="2026-07-07 11:36:52.883827246 +0000 UTC m=+1557.360485207" Jul 07 11:36:52.985039 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:52.985016 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:53.991273 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:53.991241 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:54.874308 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:54.874276 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:36:54.875156 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:36:54.875134 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:37:03.381382 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:03.381338 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t"] Jul 07 11:37:03.381949 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:03.381596 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" podUID="b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" containerName="istio-proxy" containerID="cri-o://95f057dfd5f986d898a1715e7220714ee9a904e59fa5f43ebc493f64b9f295a2" gracePeriod=30 Jul 07 11:37:05.225826 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.225804 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:37:05.259290 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.259216 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwpkr\" (UniqueName: \"kubernetes.io/projected/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-kube-api-access-pwpkr\") pod \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " Jul 07 11:37:05.259290 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.259263 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-podinfo\") pod \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " Jul 07 11:37:05.259514 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.259314 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istiod-ca-cert\") pod \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " Jul 07 11:37:05.259514 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.259342 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-envoy\") pod \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " Jul 07 11:37:05.259514 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.259433 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-data\") pod \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " Jul 07 11:37:05.259514 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.259475 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-workload-socket\") pod \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " Jul 07 11:37:05.259788 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.259761 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" (UID: "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:37:05.259847 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.259812 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-workload-certs\") pod \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " Jul 07 11:37:05.259901 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.259854 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-credential-socket\") pod \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " Jul 07 11:37:05.259901 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.259892 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-token\") pod \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\" (UID: \"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf\") " Jul 07 11:37:05.261283 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.260835 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" (UID: "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:37:05.261283 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.260926 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" (UID: "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:37:05.261283 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.261186 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" (UID: "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:37:05.261576 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.261356 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-data" (OuterVolumeSpecName: "istio-data") pod "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" (UID: "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:37:05.262870 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.262842 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-token" (OuterVolumeSpecName: "istio-token") pod "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" (UID: "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:37:05.262974 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.262952 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-kube-api-access-pwpkr" (OuterVolumeSpecName: "kube-api-access-pwpkr") pod "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" (UID: "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf"). InnerVolumeSpecName "kube-api-access-pwpkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:37:05.263546 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.263522 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" (UID: "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:37:05.264042 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.264021 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" (UID: "b65b2e3e-b8d6-4c48-ad74-dcecd44230bf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 11:37:05.360759 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.360687 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-workload-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:05.360759 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.360721 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-workload-certs\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:05.360759 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.360730 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-credential-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:05.360759 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.360739 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-token\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:05.360759 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.360748 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwpkr\" (UniqueName: \"kubernetes.io/projected/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-kube-api-access-pwpkr\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:05.360759 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.360757 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-podinfo\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:05.361022 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.360766 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istiod-ca-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:05.361022 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.360773 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-envoy\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:05.361022 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.360780 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf-istio-data\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:05.942300 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.942271 2576 generic.go:356] "Generic (PLEG): container finished" podID="b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" containerID="95f057dfd5f986d898a1715e7220714ee9a904e59fa5f43ebc493f64b9f295a2" exitCode=0 Jul 07 11:37:05.942488 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.942316 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" Jul 07 11:37:05.942488 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.942327 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" event={"ID":"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf","Type":"ContainerDied","Data":"95f057dfd5f986d898a1715e7220714ee9a904e59fa5f43ebc493f64b9f295a2"} Jul 07 11:37:05.942488 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.942369 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t" event={"ID":"b65b2e3e-b8d6-4c48-ad74-dcecd44230bf","Type":"ContainerDied","Data":"1355d293d39fe652d0bc0e760a56a838a1b459f67bef04549fbe973cb6fca0a7"} Jul 07 11:37:05.942488 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.942390 2576 scope.go:117] "RemoveContainer" containerID="95f057dfd5f986d898a1715e7220714ee9a904e59fa5f43ebc493f64b9f295a2" Jul 07 11:37:05.952367 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.952351 2576 scope.go:117] "RemoveContainer" containerID="95f057dfd5f986d898a1715e7220714ee9a904e59fa5f43ebc493f64b9f295a2" Jul 07 11:37:05.952643 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:37:05.952624 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95f057dfd5f986d898a1715e7220714ee9a904e59fa5f43ebc493f64b9f295a2\": container with ID starting with 95f057dfd5f986d898a1715e7220714ee9a904e59fa5f43ebc493f64b9f295a2 not found: ID does not exist" containerID="95f057dfd5f986d898a1715e7220714ee9a904e59fa5f43ebc493f64b9f295a2" Jul 07 11:37:05.952722 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.952652 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95f057dfd5f986d898a1715e7220714ee9a904e59fa5f43ebc493f64b9f295a2"} err="failed to get container status \"95f057dfd5f986d898a1715e7220714ee9a904e59fa5f43ebc493f64b9f295a2\": rpc error: code = NotFound desc = could not find container \"95f057dfd5f986d898a1715e7220714ee9a904e59fa5f43ebc493f64b9f295a2\": container with ID starting with 95f057dfd5f986d898a1715e7220714ee9a904e59fa5f43ebc493f64b9f295a2 not found: ID does not exist" Jul 07 11:37:05.966251 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.966229 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t"] Jul 07 11:37:05.971278 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:05.971259 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7b29c9bf-openshift-default-5d6866bfc5-rrx9t"] Jul 07 11:37:06.055031 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:06.055005 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" path="/var/lib/kubelet/pods/b65b2e3e-b8d6-4c48-ad74-dcecd44230bf/volumes" Jul 07 11:37:10.098678 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.098640 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5"] Jul 07 11:37:10.099156 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.099110 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" containerName="istio-proxy" Jul 07 11:37:10.099156 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.099128 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" containerName="istio-proxy" Jul 07 11:37:10.099263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.099229 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65b2e3e-b8d6-4c48-ad74-dcecd44230bf" containerName="istio-proxy" Jul 07 11:37:10.102580 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.102555 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.105689 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.105663 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-8bb53107-openshift-default-dockercfg-wxt4t\"" Jul 07 11:37:10.116863 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.116838 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5"] Jul 07 11:37:10.196093 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.196059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wc5q\" (UniqueName: \"kubernetes.io/projected/b0e9979b-d300-4c3a-977b-e5efa8d2930b-kube-api-access-4wc5q\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.196342 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.196322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-token\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.196540 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.196515 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-envoy\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.196686 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.196547 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istiod-ca-cert\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.196686 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.196618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-podinfo\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.196686 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.196649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-data\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.196686 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.196680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-workload-certs\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.196993 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.196723 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-credential-socket\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.196993 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.196773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-workload-socket\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.297964 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.297923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-podinfo\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.298174 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.297971 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-data\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.298174 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.298001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-workload-certs\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.298174 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.298032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-credential-socket\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.298174 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.298075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-workload-socket\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.298174 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.298109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wc5q\" (UniqueName: \"kubernetes.io/projected/b0e9979b-d300-4c3a-977b-e5efa8d2930b-kube-api-access-4wc5q\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.298500 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.298250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-token\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.298500 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.298339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-envoy\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.298500 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.298366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istiod-ca-cert\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.298500 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.298453 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-data\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.298694 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.298497 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-workload-socket\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.298775 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.298715 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-workload-certs\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.299013 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.298991 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-credential-socket\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.299091 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.299076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istiod-ca-cert\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.300653 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.300623 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-envoy\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.300867 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.300849 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-podinfo\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.307181 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.307158 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wc5q\" (UniqueName: \"kubernetes.io/projected/b0e9979b-d300-4c3a-977b-e5efa8d2930b-kube-api-access-4wc5q\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.307454 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.307433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-token\") pod \"e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.413611 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.413576 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:10.562640 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.562614 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5"] Jul 07 11:37:10.564654 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:37:10.564625 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e9979b_d300_4c3a_977b_e5efa8d2930b.slice/crio-6319b28e9050534f051e8967d286317a0b1f431758c40d2e1c04383fba77aa1b WatchSource:0}: Error finding container 6319b28e9050534f051e8967d286317a0b1f431758c40d2e1c04383fba77aa1b: Status 404 returned error can't find the container with id 6319b28e9050534f051e8967d286317a0b1f431758c40d2e1c04383fba77aa1b Jul 07 11:37:10.566966 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.566925 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:37:10.567068 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.567034 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:37:10.567134 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.567082 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:37:10.973080 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.973042 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" event={"ID":"b0e9979b-d300-4c3a-977b-e5efa8d2930b","Type":"ContainerStarted","Data":"b4718f9081d90a90241c1e467be46db2a5e47e2231943bcf91c1ddd19d1563c7"} Jul 07 11:37:10.973229 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.973096 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" event={"ID":"b0e9979b-d300-4c3a-977b-e5efa8d2930b","Type":"ContainerStarted","Data":"6319b28e9050534f051e8967d286317a0b1f431758c40d2e1c04383fba77aa1b"} Jul 07 11:37:10.998241 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:10.998196 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" podStartSLOduration=0.998180909 podStartE2EDuration="998.180909ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:37:10.995825531 +0000 UTC m=+1575.472483492" watchObservedRunningTime="2026-07-07 11:37:10.998180909 +0000 UTC m=+1575.474838871" Jul 07 11:37:11.414250 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:11.414215 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:11.419003 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:11.418980 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:11.978375 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:11.978344 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:11.979671 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:11.979650 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:16.064423 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:16.064376 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5"] Jul 07 11:37:16.064897 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:16.064544 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" podUID="b0e9979b-d300-4c3a-977b-e5efa8d2930b" containerName="istio-proxy" containerID="cri-o://b4718f9081d90a90241c1e467be46db2a5e47e2231943bcf91c1ddd19d1563c7" gracePeriod=30 Jul 07 11:37:22.045868 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.045838 2576 generic.go:356] "Generic (PLEG): container finished" podID="b0e9979b-d300-4c3a-977b-e5efa8d2930b" containerID="b4718f9081d90a90241c1e467be46db2a5e47e2231943bcf91c1ddd19d1563c7" exitCode=0 Jul 07 11:37:22.046247 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.045918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" event={"ID":"b0e9979b-d300-4c3a-977b-e5efa8d2930b","Type":"ContainerDied","Data":"b4718f9081d90a90241c1e467be46db2a5e47e2231943bcf91c1ddd19d1563c7"} Jul 07 11:37:22.127742 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.127715 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:22.200678 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.200651 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-workload-socket\") pod \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " Jul 07 11:37:22.200828 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.200707 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-workload-certs\") pod \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " Jul 07 11:37:22.200828 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.200734 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-podinfo\") pod \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " Jul 07 11:37:22.200828 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.200750 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-data\") pod \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " Jul 07 11:37:22.200828 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.200773 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-credential-socket\") pod \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " Jul 07 11:37:22.200828 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.200796 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-token\") pod \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " Jul 07 11:37:22.201086 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.200904 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istiod-ca-cert\") pod \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " Jul 07 11:37:22.201086 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.200913 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b0e9979b-d300-4c3a-977b-e5efa8d2930b" (UID: "b0e9979b-d300-4c3a-977b-e5efa8d2930b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:37:22.201086 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.200952 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wc5q\" (UniqueName: \"kubernetes.io/projected/b0e9979b-d300-4c3a-977b-e5efa8d2930b-kube-api-access-4wc5q\") pod \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " Jul 07 11:37:22.201245 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.201105 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-envoy\") pod \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\" (UID: \"b0e9979b-d300-4c3a-977b-e5efa8d2930b\") " Jul 07 11:37:22.201245 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.201170 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b0e9979b-d300-4c3a-977b-e5efa8d2930b" (UID: "b0e9979b-d300-4c3a-977b-e5efa8d2930b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:37:22.201354 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.201253 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b0e9979b-d300-4c3a-977b-e5efa8d2930b" (UID: "b0e9979b-d300-4c3a-977b-e5efa8d2930b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:37:22.201354 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.201312 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b0e9979b-d300-4c3a-977b-e5efa8d2930b" (UID: "b0e9979b-d300-4c3a-977b-e5efa8d2930b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:37:22.201596 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.201552 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-workload-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:22.201596 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.201574 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-workload-certs\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:22.201596 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.201587 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-credential-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:22.201787 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.201599 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istiod-ca-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:22.201787 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.201622 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-data" (OuterVolumeSpecName: "istio-data") pod "b0e9979b-d300-4c3a-977b-e5efa8d2930b" (UID: "b0e9979b-d300-4c3a-977b-e5efa8d2930b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:37:22.203226 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.203204 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-token" (OuterVolumeSpecName: "istio-token") pod "b0e9979b-d300-4c3a-977b-e5efa8d2930b" (UID: "b0e9979b-d300-4c3a-977b-e5efa8d2930b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:37:22.203341 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.203308 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b0e9979b-d300-4c3a-977b-e5efa8d2930b" (UID: "b0e9979b-d300-4c3a-977b-e5efa8d2930b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:37:22.203632 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.203610 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b0e9979b-d300-4c3a-977b-e5efa8d2930b" (UID: "b0e9979b-d300-4c3a-977b-e5efa8d2930b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 11:37:22.203717 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.203650 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0e9979b-d300-4c3a-977b-e5efa8d2930b-kube-api-access-4wc5q" (OuterVolumeSpecName: "kube-api-access-4wc5q") pod "b0e9979b-d300-4c3a-977b-e5efa8d2930b" (UID: "b0e9979b-d300-4c3a-977b-e5efa8d2930b"). InnerVolumeSpecName "kube-api-access-4wc5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:37:22.302925 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.302904 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-podinfo\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:22.302925 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.302923 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-data\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:22.303050 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.302931 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-token\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:22.303050 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.302939 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wc5q\" (UniqueName: \"kubernetes.io/projected/b0e9979b-d300-4c3a-977b-e5efa8d2930b-kube-api-access-4wc5q\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:22.303050 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:22.302947 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0e9979b-d300-4c3a-977b-e5efa8d2930b-istio-envoy\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:37:23.052560 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:23.052530 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" Jul 07 11:37:23.053032 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:23.052573 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5" event={"ID":"b0e9979b-d300-4c3a-977b-e5efa8d2930b","Type":"ContainerDied","Data":"6319b28e9050534f051e8967d286317a0b1f431758c40d2e1c04383fba77aa1b"} Jul 07 11:37:23.053032 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:23.052643 2576 scope.go:117] "RemoveContainer" containerID="b4718f9081d90a90241c1e467be46db2a5e47e2231943bcf91c1ddd19d1563c7" Jul 07 11:37:23.090432 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:23.090391 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5"] Jul 07 11:37:23.101831 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:23.101808 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-8bb53107-openshift-default-8594b6fb75-fswn5"] Jul 07 11:37:24.055819 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:37:24.055783 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0e9979b-d300-4c3a-977b-e5efa8d2930b" path="/var/lib/kubelet/pods/b0e9979b-d300-4c3a-977b-e5efa8d2930b/volumes" Jul 07 11:39:08.361866 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.361833 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv"] Jul 07 11:39:08.362473 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.362182 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e9979b-d300-4c3a-977b-e5efa8d2930b" containerName="istio-proxy" Jul 07 11:39:08.362473 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.362193 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e9979b-d300-4c3a-977b-e5efa8d2930b" containerName="istio-proxy" Jul 07 11:39:08.362473 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.362278 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0e9979b-d300-4c3a-977b-e5efa8d2930b" containerName="istio-proxy" Jul 07 11:39:08.364279 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.364261 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.367943 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.367920 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ce6aaeca-openshift-default-dockercfg-n2rw4\"" Jul 07 11:39:08.393897 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.393869 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv"] Jul 07 11:39:08.449514 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.449485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-istio-envoy\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.449514 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.449513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-istio-data\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.449691 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.449535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-credential-socket\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.449691 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.449565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01cb7089-8e69-4578-925b-14c8dddef741-istio-podinfo\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.449691 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.449605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-workload-certs\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.449691 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.449663 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-workload-socket\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.449817 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.449697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01cb7089-8e69-4578-925b-14c8dddef741-istio-token\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.449817 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.449716 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glzgm\" (UniqueName: \"kubernetes.io/projected/01cb7089-8e69-4578-925b-14c8dddef741-kube-api-access-glzgm\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.449817 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.449786 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01cb7089-8e69-4578-925b-14c8dddef741-istiod-ca-cert\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.551091 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.551057 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01cb7089-8e69-4578-925b-14c8dddef741-istiod-ca-cert\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.551263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.551113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-istio-envoy\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.551263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.551239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-istio-data\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.551384 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.551275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-credential-socket\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.551384 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.551301 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01cb7089-8e69-4578-925b-14c8dddef741-istio-podinfo\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.551384 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.551344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-workload-certs\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.551586 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.551449 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-workload-socket\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.551586 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.551474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01cb7089-8e69-4578-925b-14c8dddef741-istio-token\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.551586 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.551496 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glzgm\" (UniqueName: \"kubernetes.io/projected/01cb7089-8e69-4578-925b-14c8dddef741-kube-api-access-glzgm\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.551586 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.551575 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-istio-data\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.551776 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.551653 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-credential-socket\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.551776 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.551706 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-workload-certs\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.552045 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.551844 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-workload-socket\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.552045 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.551908 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01cb7089-8e69-4578-925b-14c8dddef741-istiod-ca-cert\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.553600 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.553565 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-istio-envoy\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.553838 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.553817 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01cb7089-8e69-4578-925b-14c8dddef741-istio-podinfo\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.561102 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.561080 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01cb7089-8e69-4578-925b-14c8dddef741-istio-token\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.561264 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.561247 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glzgm\" (UniqueName: \"kubernetes.io/projected/01cb7089-8e69-4578-925b-14c8dddef741-kube-api-access-glzgm\") pod \"e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.675908 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.675887 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:08.819076 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.819048 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv"] Jul 07 11:39:08.820527 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:39:08.820485 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01cb7089_8e69_4578_925b_14c8dddef741.slice/crio-a230d3ea2e784ec4fac57e60ea8424f5bb038634dd8d1e41bed81aed75e6a556 WatchSource:0}: Error finding container a230d3ea2e784ec4fac57e60ea8424f5bb038634dd8d1e41bed81aed75e6a556: Status 404 returned error can't find the container with id a230d3ea2e784ec4fac57e60ea8424f5bb038634dd8d1e41bed81aed75e6a556 Jul 07 11:39:08.822581 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.822547 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:39:08.822661 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.822616 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:39:08.822705 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:08.822652 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:39:09.605071 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:09.605034 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" event={"ID":"01cb7089-8e69-4578-925b-14c8dddef741","Type":"ContainerStarted","Data":"3e8fbe1f00cec061f00cf638dfef9844043c587d6120a902b37533bd54a1e001"} Jul 07 11:39:09.605505 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:09.605095 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" event={"ID":"01cb7089-8e69-4578-925b-14c8dddef741","Type":"ContainerStarted","Data":"a230d3ea2e784ec4fac57e60ea8424f5bb038634dd8d1e41bed81aed75e6a556"} Jul 07 11:39:09.629616 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:09.629561 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" podStartSLOduration=1.6295427 podStartE2EDuration="1.6295427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:39:09.628972019 +0000 UTC m=+1694.105629977" watchObservedRunningTime="2026-07-07 11:39:09.6295427 +0000 UTC m=+1694.106200663" Jul 07 11:39:09.677042 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:09.677018 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:09.681771 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:09.681753 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:10.610947 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:10.610916 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:10.611920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:10.611898 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:25.612075 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:25.612001 2576 patch_prober.go:28] interesting pod/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 11:39:25.612075 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:25.612065 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" podUID="01cb7089-8e69-4578-925b-14c8dddef741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 11:39:25.690360 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:25.690328 2576 generic.go:356] "Generic (PLEG): container finished" podID="01cb7089-8e69-4578-925b-14c8dddef741" containerID="3e8fbe1f00cec061f00cf638dfef9844043c587d6120a902b37533bd54a1e001" exitCode=0 Jul 07 11:39:25.690536 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:25.690376 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" event={"ID":"01cb7089-8e69-4578-925b-14c8dddef741","Type":"ContainerDied","Data":"3e8fbe1f00cec061f00cf638dfef9844043c587d6120a902b37533bd54a1e001"} Jul 07 11:39:25.690764 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:25.690750 2576 scope.go:117] "RemoveContainer" containerID="3e8fbe1f00cec061f00cf638dfef9844043c587d6120a902b37533bd54a1e001" Jul 07 11:39:25.691842 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:25.691812 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:39:25.691913 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:25.691902 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:39:25.691949 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:25.691941 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:39:26.712571 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:26.712523 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" event={"ID":"01cb7089-8e69-4578-925b-14c8dddef741","Type":"ContainerStarted","Data":"04761f76409f4a9faea2e7428d21675e0ad838cac4ed464f273a9262d7d94594"} Jul 07 11:39:27.676488 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:27.676449 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:27.676700 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:27.676667 2576 patch_prober.go:28] interesting pod/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 11:39:27.676780 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:27.676736 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" podUID="01cb7089-8e69-4578-925b-14c8dddef741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 11:39:28.676751 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:28.676716 2576 patch_prober.go:28] interesting pod/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 11:39:28.677128 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:28.676769 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" podUID="01cb7089-8e69-4578-925b-14c8dddef741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 11:39:29.676417 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:29.676364 2576 patch_prober.go:28] interesting pod/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 11:39:29.676597 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:29.676449 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" podUID="01cb7089-8e69-4578-925b-14c8dddef741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 11:39:30.484865 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:30.484826 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv"] Jul 07 11:39:30.485348 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:30.485058 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" podUID="01cb7089-8e69-4578-925b-14c8dddef741" containerName="istio-proxy" containerID="cri-o://04761f76409f4a9faea2e7428d21675e0ad838cac4ed464f273a9262d7d94594" gracePeriod=30 Jul 07 11:39:35.723593 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.723569 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:35.758940 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.758873 2576 generic.go:356] "Generic (PLEG): container finished" podID="01cb7089-8e69-4578-925b-14c8dddef741" containerID="04761f76409f4a9faea2e7428d21675e0ad838cac4ed464f273a9262d7d94594" exitCode=0 Jul 07 11:39:35.758940 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.758921 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" Jul 07 11:39:35.759123 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.758957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" event={"ID":"01cb7089-8e69-4578-925b-14c8dddef741","Type":"ContainerDied","Data":"04761f76409f4a9faea2e7428d21675e0ad838cac4ed464f273a9262d7d94594"} Jul 07 11:39:35.759123 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.759014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv" event={"ID":"01cb7089-8e69-4578-925b-14c8dddef741","Type":"ContainerDied","Data":"a230d3ea2e784ec4fac57e60ea8424f5bb038634dd8d1e41bed81aed75e6a556"} Jul 07 11:39:35.759123 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.759031 2576 scope.go:117] "RemoveContainer" containerID="04761f76409f4a9faea2e7428d21675e0ad838cac4ed464f273a9262d7d94594" Jul 07 11:39:35.767474 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.767459 2576 scope.go:117] "RemoveContainer" containerID="3e8fbe1f00cec061f00cf638dfef9844043c587d6120a902b37533bd54a1e001" Jul 07 11:39:35.775049 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.775033 2576 scope.go:117] "RemoveContainer" containerID="04761f76409f4a9faea2e7428d21675e0ad838cac4ed464f273a9262d7d94594" Jul 07 11:39:35.775286 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:39:35.775264 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04761f76409f4a9faea2e7428d21675e0ad838cac4ed464f273a9262d7d94594\": container with ID starting with 04761f76409f4a9faea2e7428d21675e0ad838cac4ed464f273a9262d7d94594 not found: ID does not exist" containerID="04761f76409f4a9faea2e7428d21675e0ad838cac4ed464f273a9262d7d94594" Jul 07 11:39:35.775384 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.775294 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04761f76409f4a9faea2e7428d21675e0ad838cac4ed464f273a9262d7d94594"} err="failed to get container status \"04761f76409f4a9faea2e7428d21675e0ad838cac4ed464f273a9262d7d94594\": rpc error: code = NotFound desc = could not find container \"04761f76409f4a9faea2e7428d21675e0ad838cac4ed464f273a9262d7d94594\": container with ID starting with 04761f76409f4a9faea2e7428d21675e0ad838cac4ed464f273a9262d7d94594 not found: ID does not exist" Jul 07 11:39:35.775384 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.775312 2576 scope.go:117] "RemoveContainer" containerID="3e8fbe1f00cec061f00cf638dfef9844043c587d6120a902b37533bd54a1e001" Jul 07 11:39:35.775552 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:39:35.775533 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e8fbe1f00cec061f00cf638dfef9844043c587d6120a902b37533bd54a1e001\": container with ID starting with 3e8fbe1f00cec061f00cf638dfef9844043c587d6120a902b37533bd54a1e001 not found: ID does not exist" containerID="3e8fbe1f00cec061f00cf638dfef9844043c587d6120a902b37533bd54a1e001" Jul 07 11:39:35.775592 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.775558 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e8fbe1f00cec061f00cf638dfef9844043c587d6120a902b37533bd54a1e001"} err="failed to get container status \"3e8fbe1f00cec061f00cf638dfef9844043c587d6120a902b37533bd54a1e001\": rpc error: code = NotFound desc = could not find container \"3e8fbe1f00cec061f00cf638dfef9844043c587d6120a902b37533bd54a1e001\": container with ID starting with 3e8fbe1f00cec061f00cf638dfef9844043c587d6120a902b37533bd54a1e001 not found: ID does not exist" Jul 07 11:39:35.785838 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.785820 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01cb7089-8e69-4578-925b-14c8dddef741-istio-token\") pod \"01cb7089-8e69-4578-925b-14c8dddef741\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " Jul 07 11:39:35.785931 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.785855 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01cb7089-8e69-4578-925b-14c8dddef741-istiod-ca-cert\") pod \"01cb7089-8e69-4578-925b-14c8dddef741\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " Jul 07 11:39:35.785931 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.785911 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-workload-certs\") pod \"01cb7089-8e69-4578-925b-14c8dddef741\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " Jul 07 11:39:35.786041 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.785974 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-workload-socket\") pod \"01cb7089-8e69-4578-925b-14c8dddef741\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " Jul 07 11:39:35.786041 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.786003 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-istio-envoy\") pod \"01cb7089-8e69-4578-925b-14c8dddef741\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " Jul 07 11:39:35.786041 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.786029 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-credential-socket\") pod \"01cb7089-8e69-4578-925b-14c8dddef741\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " Jul 07 11:39:35.786183 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.786101 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01cb7089-8e69-4578-925b-14c8dddef741-istio-podinfo\") pod \"01cb7089-8e69-4578-925b-14c8dddef741\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " Jul 07 11:39:35.786183 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.786139 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-istio-data\") pod \"01cb7089-8e69-4578-925b-14c8dddef741\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " Jul 07 11:39:35.786183 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.786168 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glzgm\" (UniqueName: \"kubernetes.io/projected/01cb7089-8e69-4578-925b-14c8dddef741-kube-api-access-glzgm\") pod \"01cb7089-8e69-4578-925b-14c8dddef741\" (UID: \"01cb7089-8e69-4578-925b-14c8dddef741\") " Jul 07 11:39:35.786330 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.786236 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "01cb7089-8e69-4578-925b-14c8dddef741" (UID: "01cb7089-8e69-4578-925b-14c8dddef741"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:39:35.786330 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.786254 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "01cb7089-8e69-4578-925b-14c8dddef741" (UID: "01cb7089-8e69-4578-925b-14c8dddef741"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:39:35.786330 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.786262 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01cb7089-8e69-4578-925b-14c8dddef741-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "01cb7089-8e69-4578-925b-14c8dddef741" (UID: "01cb7089-8e69-4578-925b-14c8dddef741"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:39:35.786597 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.786540 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01cb7089-8e69-4578-925b-14c8dddef741-istiod-ca-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:39:35.786597 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.786564 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-workload-certs\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:39:35.786597 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.786578 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-workload-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:39:35.786597 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.786579 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "01cb7089-8e69-4578-925b-14c8dddef741" (UID: "01cb7089-8e69-4578-925b-14c8dddef741"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:39:35.787433 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.787386 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-istio-data" (OuterVolumeSpecName: "istio-data") pod "01cb7089-8e69-4578-925b-14c8dddef741" (UID: "01cb7089-8e69-4578-925b-14c8dddef741"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:39:35.788023 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.787999 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01cb7089-8e69-4578-925b-14c8dddef741-istio-token" (OuterVolumeSpecName: "istio-token") pod "01cb7089-8e69-4578-925b-14c8dddef741" (UID: "01cb7089-8e69-4578-925b-14c8dddef741"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:39:35.788245 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.788230 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01cb7089-8e69-4578-925b-14c8dddef741-kube-api-access-glzgm" (OuterVolumeSpecName: "kube-api-access-glzgm") pod "01cb7089-8e69-4578-925b-14c8dddef741" (UID: "01cb7089-8e69-4578-925b-14c8dddef741"). InnerVolumeSpecName "kube-api-access-glzgm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:39:35.788307 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.788235 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "01cb7089-8e69-4578-925b-14c8dddef741" (UID: "01cb7089-8e69-4578-925b-14c8dddef741"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:39:35.788431 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.788409 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01cb7089-8e69-4578-925b-14c8dddef741-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "01cb7089-8e69-4578-925b-14c8dddef741" (UID: "01cb7089-8e69-4578-925b-14c8dddef741"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 11:39:35.887532 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.887512 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-istio-envoy\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:39:35.887532 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.887533 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-credential-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:39:35.887662 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.887542 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01cb7089-8e69-4578-925b-14c8dddef741-istio-podinfo\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:39:35.887662 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.887551 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01cb7089-8e69-4578-925b-14c8dddef741-istio-data\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:39:35.887662 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.887558 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glzgm\" (UniqueName: \"kubernetes.io/projected/01cb7089-8e69-4578-925b-14c8dddef741-kube-api-access-glzgm\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:39:35.887662 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:35.887567 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01cb7089-8e69-4578-925b-14c8dddef741-istio-token\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:39:36.078858 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:36.078832 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv"] Jul 07 11:39:36.086437 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:36.086412 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ce6aaeca-openshift-default-68d547f6dc-p4fbv"] Jul 07 11:39:38.054966 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:38.054935 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01cb7089-8e69-4578-925b-14c8dddef741" path="/var/lib/kubelet/pods/01cb7089-8e69-4578-925b-14c8dddef741/volumes" Jul 07 11:39:49.770385 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.770346 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql"] Jul 07 11:39:49.770899 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.770878 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01cb7089-8e69-4578-925b-14c8dddef741" containerName="istio-proxy" Jul 07 11:39:49.770980 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.770903 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="01cb7089-8e69-4578-925b-14c8dddef741" containerName="istio-proxy" Jul 07 11:39:49.771035 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.771011 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="01cb7089-8e69-4578-925b-14c8dddef741" containerName="istio-proxy" Jul 07 11:39:49.771035 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.771024 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="01cb7089-8e69-4578-925b-14c8dddef741" containerName="istio-proxy" Jul 07 11:39:49.773954 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.773932 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:49.776824 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.776805 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-180e9350-openshift-default-dockercfg-jkg2d\"" Jul 07 11:39:49.787112 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.787087 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql"] Jul 07 11:39:49.898481 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.898445 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-data\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:49.898670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.898497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-token\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:49.898670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.898550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnwjg\" (UniqueName: \"kubernetes.io/projected/c5150973-6a0f-40be-ab24-429beb9dcc4d-kube-api-access-bnwjg\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:49.898670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.898599 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-podinfo\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:49.898670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.898629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-workload-certs\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:49.898670 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.898655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-envoy\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:49.898891 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.898701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-credential-socket\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:49.898891 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.898721 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5150973-6a0f-40be-ab24-429beb9dcc4d-istiod-ca-cert\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:49.898891 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.898774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-workload-socket\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:49.999773 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.999735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-token\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:49.999912 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.999782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnwjg\" (UniqueName: \"kubernetes.io/projected/c5150973-6a0f-40be-ab24-429beb9dcc4d-kube-api-access-bnwjg\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:49.999912 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.999814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-podinfo\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:49.999912 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.999843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-workload-certs\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:49.999912 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.999869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-envoy\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:50.000153 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:49.999975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-credential-socket\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:50.000153 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.000026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5150973-6a0f-40be-ab24-429beb9dcc4d-istiod-ca-cert\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:50.000153 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.000071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-workload-socket\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:50.000305 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.000154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-data\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:50.000387 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.000363 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-credential-socket\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:50.000543 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.000519 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-data\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:50.000879 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.000854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5150973-6a0f-40be-ab24-429beb9dcc4d-istiod-ca-cert\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:50.001037 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.000932 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-workload-certs\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:50.001037 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.000952 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-workload-socket\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:50.002527 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.002505 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-envoy\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:50.002613 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.002514 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-podinfo\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:50.008408 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.008370 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-token\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:50.008501 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.008450 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnwjg\" (UniqueName: \"kubernetes.io/projected/c5150973-6a0f-40be-ab24-429beb9dcc4d-kube-api-access-bnwjg\") pod \"e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:50.085151 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.085093 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:50.221861 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.221841 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql"] Jul 07 11:39:50.224110 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:39:50.224075 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5150973_6a0f_40be_ab24_429beb9dcc4d.slice/crio-6217a2dac8b1fc10bb68efb454b58cfe7283dc999b2d1e0c3c824675f9dc3a15 WatchSource:0}: Error finding container 6217a2dac8b1fc10bb68efb454b58cfe7283dc999b2d1e0c3c824675f9dc3a15: Status 404 returned error can't find the container with id 6217a2dac8b1fc10bb68efb454b58cfe7283dc999b2d1e0c3c824675f9dc3a15 Jul 07 11:39:50.226133 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.226106 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:39:50.226208 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.226162 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:39:50.226208 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.226188 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:39:50.837305 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.837273 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" event={"ID":"c5150973-6a0f-40be-ab24-429beb9dcc4d","Type":"ContainerStarted","Data":"788c28104105b2ddd5cbdd809ac322ee22161109b09adba7f4a08bd84c1ceddd"} Jul 07 11:39:50.837687 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.837320 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" event={"ID":"c5150973-6a0f-40be-ab24-429beb9dcc4d","Type":"ContainerStarted","Data":"6217a2dac8b1fc10bb68efb454b58cfe7283dc999b2d1e0c3c824675f9dc3a15"} Jul 07 11:39:50.898179 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:50.898134 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" podStartSLOduration=1.8981207690000002 podStartE2EDuration="1.898120769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:39:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:39:50.896274702 +0000 UTC m=+1735.372932661" watchObservedRunningTime="2026-07-07 11:39:50.898120769 +0000 UTC m=+1735.374778729" Jul 07 11:39:51.086070 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:51.086033 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:51.090907 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:51.090842 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:51.842470 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:51.842442 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:39:51.843491 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:39:51.843474 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:40:05.925148 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:05.925113 2576 generic.go:356] "Generic (PLEG): container finished" podID="c5150973-6a0f-40be-ab24-429beb9dcc4d" containerID="788c28104105b2ddd5cbdd809ac322ee22161109b09adba7f4a08bd84c1ceddd" exitCode=0 Jul 07 11:40:05.925552 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:05.925192 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" event={"ID":"c5150973-6a0f-40be-ab24-429beb9dcc4d","Type":"ContainerDied","Data":"788c28104105b2ddd5cbdd809ac322ee22161109b09adba7f4a08bd84c1ceddd"} Jul 07 11:40:05.925602 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:05.925588 2576 scope.go:117] "RemoveContainer" containerID="788c28104105b2ddd5cbdd809ac322ee22161109b09adba7f4a08bd84c1ceddd" Jul 07 11:40:05.926566 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:05.926541 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:40:05.926635 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:05.926604 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:40:05.926690 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:05.926634 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:40:06.843095 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:06.843060 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:40:06.931790 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:06.931758 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" event={"ID":"c5150973-6a0f-40be-ab24-429beb9dcc4d","Type":"ContainerStarted","Data":"208faf362f32ffb609a7ca1069a4e7419fe3bf13806897883698bebe2d6cc75c"} Jul 07 11:40:07.085620 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:07.085588 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:40:07.086894 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:07.086866 2576 patch_prober.go:28] interesting pod/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 11:40:07.087025 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:07.086925 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" podUID="c5150973-6a0f-40be-ab24-429beb9dcc4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 11:40:08.086199 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:08.086161 2576 patch_prober.go:28] interesting pod/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 11:40:08.086701 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:08.086227 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" podUID="c5150973-6a0f-40be-ab24-429beb9dcc4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 11:40:09.085930 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:09.085894 2576 patch_prober.go:28] interesting pod/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 11:40:09.086613 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:09.086203 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" podUID="c5150973-6a0f-40be-ab24-429beb9dcc4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 11:40:10.085872 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:10.085837 2576 patch_prober.go:28] interesting pod/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 11:40:10.086168 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:10.086139 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" podUID="c5150973-6a0f-40be-ab24-429beb9dcc4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 11:40:11.089678 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:11.089646 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:40:11.090044 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:11.089885 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:40:11.090494 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:40:11.090477 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:41:35.507979 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:35.507943 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql"] Jul 07 11:41:35.508596 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:35.508152 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" podUID="c5150973-6a0f-40be-ab24-429beb9dcc4d" containerName="istio-proxy" containerID="cri-o://208faf362f32ffb609a7ca1069a4e7419fe3bf13806897883698bebe2d6cc75c" gracePeriod=30 Jul 07 11:41:40.750276 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.750253 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:41:40.878504 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.878426 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnwjg\" (UniqueName: \"kubernetes.io/projected/c5150973-6a0f-40be-ab24-429beb9dcc4d-kube-api-access-bnwjg\") pod \"c5150973-6a0f-40be-ab24-429beb9dcc4d\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " Jul 07 11:41:40.878504 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.878465 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5150973-6a0f-40be-ab24-429beb9dcc4d-istiod-ca-cert\") pod \"c5150973-6a0f-40be-ab24-429beb9dcc4d\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " Jul 07 11:41:40.878504 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.878496 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-workload-certs\") pod \"c5150973-6a0f-40be-ab24-429beb9dcc4d\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " Jul 07 11:41:40.878749 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.878515 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-token\") pod \"c5150973-6a0f-40be-ab24-429beb9dcc4d\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " Jul 07 11:41:40.878749 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.878538 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-podinfo\") pod \"c5150973-6a0f-40be-ab24-429beb9dcc4d\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " Jul 07 11:41:40.878749 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.878580 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-credential-socket\") pod \"c5150973-6a0f-40be-ab24-429beb9dcc4d\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " Jul 07 11:41:40.878749 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.878604 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-envoy\") pod \"c5150973-6a0f-40be-ab24-429beb9dcc4d\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " Jul 07 11:41:40.878749 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.878638 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-workload-socket\") pod \"c5150973-6a0f-40be-ab24-429beb9dcc4d\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " Jul 07 11:41:40.878749 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.878661 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-data\") pod \"c5150973-6a0f-40be-ab24-429beb9dcc4d\" (UID: \"c5150973-6a0f-40be-ab24-429beb9dcc4d\") " Jul 07 11:41:40.879051 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.878849 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c5150973-6a0f-40be-ab24-429beb9dcc4d" (UID: "c5150973-6a0f-40be-ab24-429beb9dcc4d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:41:40.879051 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.878910 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c5150973-6a0f-40be-ab24-429beb9dcc4d" (UID: "c5150973-6a0f-40be-ab24-429beb9dcc4d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:41:40.879051 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.879037 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c5150973-6a0f-40be-ab24-429beb9dcc4d" (UID: "c5150973-6a0f-40be-ab24-429beb9dcc4d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:41:40.879365 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.879278 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5150973-6a0f-40be-ab24-429beb9dcc4d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c5150973-6a0f-40be-ab24-429beb9dcc4d" (UID: "c5150973-6a0f-40be-ab24-429beb9dcc4d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:41:40.879658 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.879640 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-data" (OuterVolumeSpecName: "istio-data") pod "c5150973-6a0f-40be-ab24-429beb9dcc4d" (UID: "c5150973-6a0f-40be-ab24-429beb9dcc4d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:41:40.880825 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.880793 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5150973-6a0f-40be-ab24-429beb9dcc4d-kube-api-access-bnwjg" (OuterVolumeSpecName: "kube-api-access-bnwjg") pod "c5150973-6a0f-40be-ab24-429beb9dcc4d" (UID: "c5150973-6a0f-40be-ab24-429beb9dcc4d"). InnerVolumeSpecName "kube-api-access-bnwjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:41:40.880932 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.880846 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c5150973-6a0f-40be-ab24-429beb9dcc4d" (UID: "c5150973-6a0f-40be-ab24-429beb9dcc4d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:41:40.881292 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.881265 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-token" (OuterVolumeSpecName: "istio-token") pod "c5150973-6a0f-40be-ab24-429beb9dcc4d" (UID: "c5150973-6a0f-40be-ab24-429beb9dcc4d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:41:40.881292 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.881270 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c5150973-6a0f-40be-ab24-429beb9dcc4d" (UID: "c5150973-6a0f-40be-ab24-429beb9dcc4d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 11:41:40.979565 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.979533 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-podinfo\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:41:40.979565 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.979562 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-credential-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:41:40.979693 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.979571 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-envoy\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:41:40.979693 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.979579 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-workload-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:41:40.979693 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.979587 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-data\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:41:40.979693 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.979594 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnwjg\" (UniqueName: \"kubernetes.io/projected/c5150973-6a0f-40be-ab24-429beb9dcc4d-kube-api-access-bnwjg\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:41:40.979693 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.979603 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5150973-6a0f-40be-ab24-429beb9dcc4d-istiod-ca-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:41:40.979693 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.979611 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5150973-6a0f-40be-ab24-429beb9dcc4d-workload-certs\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:41:40.979693 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:40.979618 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5150973-6a0f-40be-ab24-429beb9dcc4d-istio-token\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:41:41.428493 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:41.428446 2576 generic.go:356] "Generic (PLEG): container finished" podID="c5150973-6a0f-40be-ab24-429beb9dcc4d" containerID="208faf362f32ffb609a7ca1069a4e7419fe3bf13806897883698bebe2d6cc75c" exitCode=0 Jul 07 11:41:41.428493 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:41.428490 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" Jul 07 11:41:41.428712 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:41.428515 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" event={"ID":"c5150973-6a0f-40be-ab24-429beb9dcc4d","Type":"ContainerDied","Data":"208faf362f32ffb609a7ca1069a4e7419fe3bf13806897883698bebe2d6cc75c"} Jul 07 11:41:41.428712 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:41.428579 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql" event={"ID":"c5150973-6a0f-40be-ab24-429beb9dcc4d","Type":"ContainerDied","Data":"6217a2dac8b1fc10bb68efb454b58cfe7283dc999b2d1e0c3c824675f9dc3a15"} Jul 07 11:41:41.428712 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:41.428602 2576 scope.go:117] "RemoveContainer" containerID="208faf362f32ffb609a7ca1069a4e7419fe3bf13806897883698bebe2d6cc75c" Jul 07 11:41:41.438659 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:41.438644 2576 scope.go:117] "RemoveContainer" containerID="788c28104105b2ddd5cbdd809ac322ee22161109b09adba7f4a08bd84c1ceddd" Jul 07 11:41:41.446649 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:41.446632 2576 scope.go:117] "RemoveContainer" containerID="208faf362f32ffb609a7ca1069a4e7419fe3bf13806897883698bebe2d6cc75c" Jul 07 11:41:41.446911 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:41:41.446893 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"208faf362f32ffb609a7ca1069a4e7419fe3bf13806897883698bebe2d6cc75c\": container with ID starting with 208faf362f32ffb609a7ca1069a4e7419fe3bf13806897883698bebe2d6cc75c not found: ID does not exist" containerID="208faf362f32ffb609a7ca1069a4e7419fe3bf13806897883698bebe2d6cc75c" Jul 07 11:41:41.446971 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:41.446919 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"208faf362f32ffb609a7ca1069a4e7419fe3bf13806897883698bebe2d6cc75c"} err="failed to get container status \"208faf362f32ffb609a7ca1069a4e7419fe3bf13806897883698bebe2d6cc75c\": rpc error: code = NotFound desc = could not find container \"208faf362f32ffb609a7ca1069a4e7419fe3bf13806897883698bebe2d6cc75c\": container with ID starting with 208faf362f32ffb609a7ca1069a4e7419fe3bf13806897883698bebe2d6cc75c not found: ID does not exist" Jul 07 11:41:41.446971 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:41.446936 2576 scope.go:117] "RemoveContainer" containerID="788c28104105b2ddd5cbdd809ac322ee22161109b09adba7f4a08bd84c1ceddd" Jul 07 11:41:41.447177 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:41:41.447159 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"788c28104105b2ddd5cbdd809ac322ee22161109b09adba7f4a08bd84c1ceddd\": container with ID starting with 788c28104105b2ddd5cbdd809ac322ee22161109b09adba7f4a08bd84c1ceddd not found: ID does not exist" containerID="788c28104105b2ddd5cbdd809ac322ee22161109b09adba7f4a08bd84c1ceddd" Jul 07 11:41:41.447235 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:41.447187 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"788c28104105b2ddd5cbdd809ac322ee22161109b09adba7f4a08bd84c1ceddd"} err="failed to get container status \"788c28104105b2ddd5cbdd809ac322ee22161109b09adba7f4a08bd84c1ceddd\": rpc error: code = NotFound desc = could not find container \"788c28104105b2ddd5cbdd809ac322ee22161109b09adba7f4a08bd84c1ceddd\": container with ID starting with 788c28104105b2ddd5cbdd809ac322ee22161109b09adba7f4a08bd84c1ceddd not found: ID does not exist" Jul 07 11:41:41.456969 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:41.456939 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql"] Jul 07 11:41:41.470128 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:41.470103 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-180e9350-openshift-default-57f7cf75d7-kzdql"] Jul 07 11:41:42.055521 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:41:42.055489 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5150973-6a0f-40be-ab24-429beb9dcc4d" path="/var/lib/kubelet/pods/c5150973-6a0f-40be-ab24-429beb9dcc4d/volumes" Jul 07 11:42:31.729649 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.729618 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw"] Jul 07 11:42:31.730092 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.730078 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01cb7089-8e69-4578-925b-14c8dddef741" containerName="istio-proxy" Jul 07 11:42:31.730141 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.730095 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="01cb7089-8e69-4578-925b-14c8dddef741" containerName="istio-proxy" Jul 07 11:42:31.730141 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.730131 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5150973-6a0f-40be-ab24-429beb9dcc4d" containerName="istio-proxy" Jul 07 11:42:31.730141 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.730139 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5150973-6a0f-40be-ab24-429beb9dcc4d" containerName="istio-proxy" Jul 07 11:42:31.730233 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.730151 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5150973-6a0f-40be-ab24-429beb9dcc4d" containerName="istio-proxy" Jul 07 11:42:31.730233 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.730159 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5150973-6a0f-40be-ab24-429beb9dcc4d" containerName="istio-proxy" Jul 07 11:42:31.730293 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.730233 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5150973-6a0f-40be-ab24-429beb9dcc4d" containerName="istio-proxy" Jul 07 11:42:31.730293 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.730245 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5150973-6a0f-40be-ab24-429beb9dcc4d" containerName="istio-proxy" Jul 07 11:42:31.733476 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.733459 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.737865 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.737835 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-efe248-openshift-default-dockercfg-nqkg8\"" Jul 07 11:42:31.782719 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.782694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d82c38f-06db-416b-85e9-31a73652b508-istiod-ca-cert\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.782863 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.782736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9bfh\" (UniqueName: \"kubernetes.io/projected/8d82c38f-06db-416b-85e9-31a73652b508-kube-api-access-t9bfh\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.782863 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.782844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-credential-socket\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.783033 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.782912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-workload-socket\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.783033 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.782938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-istio-envoy\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.783033 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.783004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d82c38f-06db-416b-85e9-31a73652b508-istio-podinfo\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.783193 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.783039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-workload-certs\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.783193 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.783070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-istio-data\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.783193 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.783108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d82c38f-06db-416b-85e9-31a73652b508-istio-token\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.853623 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.853596 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw"] Jul 07 11:42:31.883943 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.883909 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-credential-socket\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.884114 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.883955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-workload-socket\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.884114 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.883972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-istio-envoy\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.884114 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.884010 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d82c38f-06db-416b-85e9-31a73652b508-istio-podinfo\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.884114 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.884042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-workload-certs\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.884114 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.884068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-istio-data\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.884114 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.884100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d82c38f-06db-416b-85e9-31a73652b508-istio-token\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.884440 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.884142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d82c38f-06db-416b-85e9-31a73652b508-istiod-ca-cert\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.884440 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.884165 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9bfh\" (UniqueName: \"kubernetes.io/projected/8d82c38f-06db-416b-85e9-31a73652b508-kube-api-access-t9bfh\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.884440 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.884337 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-credential-socket\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.884440 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.884413 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-workload-socket\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.884713 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.884680 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-workload-certs\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.885043 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.885021 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-istio-data\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.885130 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.885071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d82c38f-06db-416b-85e9-31a73652b508-istiod-ca-cert\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.887137 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.887102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-istio-envoy\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.887562 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.887541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d82c38f-06db-416b-85e9-31a73652b508-istio-podinfo\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.894710 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.894690 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d82c38f-06db-416b-85e9-31a73652b508-istio-token\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:31.894912 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:31.894891 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9bfh\" (UniqueName: \"kubernetes.io/projected/8d82c38f-06db-416b-85e9-31a73652b508-kube-api-access-t9bfh\") pod \"e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:32.045154 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:32.045087 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:32.199494 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:32.199465 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw"] Jul 07 11:42:32.200454 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:42:32.200425 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d82c38f_06db_416b_85e9_31a73652b508.slice/crio-ef080e7b577c58033fc2828b22d73c0886f75d4ed64e31d5983dd455cd629817 WatchSource:0}: Error finding container ef080e7b577c58033fc2828b22d73c0886f75d4ed64e31d5983dd455cd629817: Status 404 returned error can't find the container with id ef080e7b577c58033fc2828b22d73c0886f75d4ed64e31d5983dd455cd629817 Jul 07 11:42:32.202542 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:32.202512 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:42:32.202619 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:32.202580 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:42:32.202619 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:32.202610 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:42:32.698638 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:32.698582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" event={"ID":"8d82c38f-06db-416b-85e9-31a73652b508","Type":"ContainerStarted","Data":"aa85ce2621eee1c996aff81f99128572384c48f5d2a2712e0a55cc4e66eb6043"} Jul 07 11:42:32.698845 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:32.698665 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" event={"ID":"8d82c38f-06db-416b-85e9-31a73652b508","Type":"ContainerStarted","Data":"ef080e7b577c58033fc2828b22d73c0886f75d4ed64e31d5983dd455cd629817"} Jul 07 11:42:32.730855 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:32.730807 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" podStartSLOduration=1.7307889749999998 podStartE2EDuration="1.730788975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:42:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:42:32.729513395 +0000 UTC m=+1897.206171356" watchObservedRunningTime="2026-07-07 11:42:32.730788975 +0000 UTC m=+1897.207446936" Jul 07 11:42:33.045613 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:33.045529 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:33.050389 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:33.050367 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:33.704323 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:33.704296 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:33.705309 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:33.705293 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:40.009912 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.009877 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6"] Jul 07 11:42:40.013312 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.013285 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.016556 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.016535 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-2507eb-openshift-default-dockercfg-bfrnp\"" Jul 07 11:42:40.049806 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.049781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-workload-certs\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.049945 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.049833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-data\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.049945 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.049858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-token\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.049945 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.049926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70666d19-579d-4183-aac7-f1e8dd1d9356-istiod-ca-cert\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.050106 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.049953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-credential-socket\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.050106 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.049986 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdzsc\" (UniqueName: \"kubernetes.io/projected/70666d19-579d-4183-aac7-f1e8dd1d9356-kube-api-access-pdzsc\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.050106 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.050028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-podinfo\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.050243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.050110 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-envoy\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.050243 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.050143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-workload-socket\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.063530 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.063501 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6"] Jul 07 11:42:40.151586 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.151554 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-workload-certs\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.151809 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.151593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-data\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.151809 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.151619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-token\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.151809 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.151650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70666d19-579d-4183-aac7-f1e8dd1d9356-istiod-ca-cert\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.151809 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.151674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-credential-socket\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.151809 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.151703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdzsc\" (UniqueName: \"kubernetes.io/projected/70666d19-579d-4183-aac7-f1e8dd1d9356-kube-api-access-pdzsc\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.151809 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.151736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-podinfo\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.152143 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.151880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-envoy\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.152143 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.151930 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-workload-socket\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.152143 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.152017 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-workload-certs\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.152143 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.152065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-data\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.152143 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.152110 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-credential-socket\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.152389 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.152276 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-workload-socket\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.152711 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.152681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70666d19-579d-4183-aac7-f1e8dd1d9356-istiod-ca-cert\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.154222 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.154195 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-envoy\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.154337 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.154266 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-podinfo\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.166979 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.166950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdzsc\" (UniqueName: \"kubernetes.io/projected/70666d19-579d-4183-aac7-f1e8dd1d9356-kube-api-access-pdzsc\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.170471 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.170450 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-token\") pod \"e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.324507 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.324428 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:40.479170 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.479145 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6"] Jul 07 11:42:40.480914 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:42:40.480882 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70666d19_579d_4183_aac7_f1e8dd1d9356.slice/crio-6f379aff0ac36841b6e3876be9457b03a7412cbf62cf5f539e4199da4d5170dd WatchSource:0}: Error finding container 6f379aff0ac36841b6e3876be9457b03a7412cbf62cf5f539e4199da4d5170dd: Status 404 returned error can't find the container with id 6f379aff0ac36841b6e3876be9457b03a7412cbf62cf5f539e4199da4d5170dd Jul 07 11:42:40.483209 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.483176 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:42:40.483294 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.483239 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:42:40.483294 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.483269 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:42:40.740373 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.740339 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" event={"ID":"70666d19-579d-4183-aac7-f1e8dd1d9356","Type":"ContainerStarted","Data":"b90f5cc9364dbfbcf49cf5922b1b7489e124a1a80ca19f0662a9df8ede71f620"} Jul 07 11:42:40.740585 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.740406 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" event={"ID":"70666d19-579d-4183-aac7-f1e8dd1d9356","Type":"ContainerStarted","Data":"6f379aff0ac36841b6e3876be9457b03a7412cbf62cf5f539e4199da4d5170dd"} Jul 07 11:42:40.770907 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:40.770864 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" podStartSLOduration=1.7708465100000002 podStartE2EDuration="1.77084651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:42:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:42:40.770111814 +0000 UTC m=+1905.246769774" watchObservedRunningTime="2026-07-07 11:42:40.77084651 +0000 UTC m=+1905.247504472" Jul 07 11:42:41.325557 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:41.325523 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:41.330385 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:41.330361 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:41.745369 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:41.745340 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:41.746176 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:41.746152 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:49.613337 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:49.612961 2576 patch_prober.go:28] interesting pod/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": read tcp 10.133.0.2:50802->10.133.0.53:15021: read: connection reset by peer" start-of-body= Jul 07 11:42:49.613337 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:49.613056 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" podUID="8d82c38f-06db-416b-85e9-31a73652b508" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": read tcp 10.133.0.2:50802->10.133.0.53:15021: read: connection reset by peer" Jul 07 11:42:49.792439 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:49.792349 2576 generic.go:356] "Generic (PLEG): container finished" podID="8d82c38f-06db-416b-85e9-31a73652b508" containerID="aa85ce2621eee1c996aff81f99128572384c48f5d2a2712e0a55cc4e66eb6043" exitCode=0 Jul 07 11:42:49.792439 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:49.792419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" event={"ID":"8d82c38f-06db-416b-85e9-31a73652b508","Type":"ContainerDied","Data":"aa85ce2621eee1c996aff81f99128572384c48f5d2a2712e0a55cc4e66eb6043"} Jul 07 11:42:49.792795 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:49.792777 2576 scope.go:117] "RemoveContainer" containerID="aa85ce2621eee1c996aff81f99128572384c48f5d2a2712e0a55cc4e66eb6043" Jul 07 11:42:49.793829 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:49.793801 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:42:49.793900 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:49.793875 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:42:49.793942 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:49.793910 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:42:50.803705 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:50.803663 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" event={"ID":"8d82c38f-06db-416b-85e9-31a73652b508","Type":"ContainerStarted","Data":"3da0f7e399229cfd58c0c1f4f436a1776b2ff2999152c4175a2904e6504b2eab"} Jul 07 11:42:51.045518 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:51.045389 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:51.045764 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:51.045727 2576 patch_prober.go:28] interesting pod/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 07 11:42:51.045896 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:51.045786 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" podUID="8d82c38f-06db-416b-85e9-31a73652b508" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 07 11:42:52.046030 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:52.045987 2576 patch_prober.go:28] interesting pod/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 07 11:42:52.046520 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:52.046045 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" podUID="8d82c38f-06db-416b-85e9-31a73652b508" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 07 11:42:53.046185 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:53.046138 2576 patch_prober.go:28] interesting pod/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 07 11:42:53.046682 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:53.046214 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" podUID="8d82c38f-06db-416b-85e9-31a73652b508" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 07 11:42:54.046470 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:54.046432 2576 patch_prober.go:28] interesting pod/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 07 11:42:54.046888 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:54.046492 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" podUID="8d82c38f-06db-416b-85e9-31a73652b508" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 07 11:42:55.049413 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:55.049376 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:55.049756 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:55.049718 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:55.050519 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:55.050496 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:42:57.786603 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:57.786560 2576 patch_prober.go:28] interesting pod/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 11:42:57.788033 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:57.786631 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" podUID="70666d19-579d-4183-aac7-f1e8dd1d9356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 11:42:57.861987 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:57.861953 2576 generic.go:356] "Generic (PLEG): container finished" podID="70666d19-579d-4183-aac7-f1e8dd1d9356" containerID="b90f5cc9364dbfbcf49cf5922b1b7489e124a1a80ca19f0662a9df8ede71f620" exitCode=0 Jul 07 11:42:57.862106 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:57.862029 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" event={"ID":"70666d19-579d-4183-aac7-f1e8dd1d9356","Type":"ContainerDied","Data":"b90f5cc9364dbfbcf49cf5922b1b7489e124a1a80ca19f0662a9df8ede71f620"} Jul 07 11:42:57.862450 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:57.862435 2576 scope.go:117] "RemoveContainer" containerID="b90f5cc9364dbfbcf49cf5922b1b7489e124a1a80ca19f0662a9df8ede71f620" Jul 07 11:42:57.863410 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:57.863367 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:42:57.863523 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:57.863466 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:42:57.863523 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:57.863515 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:42:58.869452 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:58.869419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" event={"ID":"70666d19-579d-4183-aac7-f1e8dd1d9356","Type":"ContainerStarted","Data":"50561f6597c1387d2c62cf73dbf593c8786bf8a9f90cdf9ba026b640ebd631a9"} Jul 07 11:42:59.325474 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:59.325437 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:42:59.325665 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:59.325626 2576 patch_prober.go:28] interesting pod/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 07 11:42:59.325714 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:42:59.325671 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" podUID="70666d19-579d-4183-aac7-f1e8dd1d9356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 07 11:43:00.325605 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:43:00.325572 2576 patch_prober.go:28] interesting pod/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 07 11:43:00.325995 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:43:00.325621 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" podUID="70666d19-579d-4183-aac7-f1e8dd1d9356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 07 11:43:01.325468 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:43:01.325430 2576 patch_prober.go:28] interesting pod/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 07 11:43:01.325643 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:43:01.325486 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" podUID="70666d19-579d-4183-aac7-f1e8dd1d9356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 07 11:43:02.325140 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:43:02.325106 2576 patch_prober.go:28] interesting pod/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 07 11:43:02.325318 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:43:02.325163 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" podUID="70666d19-579d-4183-aac7-f1e8dd1d9356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 07 11:43:03.328251 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:43:03.328214 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:43:03.328721 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:43:03.328584 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:43:03.329275 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:43:03.329255 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:44:24.892222 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:24.892190 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw"] Jul 07 11:44:24.892752 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:24.892417 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" podUID="8d82c38f-06db-416b-85e9-31a73652b508" containerName="istio-proxy" containerID="cri-o://3da0f7e399229cfd58c0c1f4f436a1776b2ff2999152c4175a2904e6504b2eab" gracePeriod=30 Jul 07 11:44:25.052139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:25.052092 2576 patch_prober.go:28] interesting pod/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 11:44:25.052307 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:25.052160 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" podUID="8d82c38f-06db-416b-85e9-31a73652b508" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 11:44:30.137864 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.137839 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:44:30.181197 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.181170 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d82c38f-06db-416b-85e9-31a73652b508-istiod-ca-cert\") pod \"8d82c38f-06db-416b-85e9-31a73652b508\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " Jul 07 11:44:30.181356 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.181212 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-credential-socket\") pod \"8d82c38f-06db-416b-85e9-31a73652b508\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " Jul 07 11:44:30.181356 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.181248 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9bfh\" (UniqueName: \"kubernetes.io/projected/8d82c38f-06db-416b-85e9-31a73652b508-kube-api-access-t9bfh\") pod \"8d82c38f-06db-416b-85e9-31a73652b508\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " Jul 07 11:44:30.181495 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.181359 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d82c38f-06db-416b-85e9-31a73652b508-istio-token\") pod \"8d82c38f-06db-416b-85e9-31a73652b508\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " Jul 07 11:44:30.181495 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.181466 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-istio-envoy\") pod \"8d82c38f-06db-416b-85e9-31a73652b508\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " Jul 07 11:44:30.181603 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.181503 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d82c38f-06db-416b-85e9-31a73652b508-istio-podinfo\") pod \"8d82c38f-06db-416b-85e9-31a73652b508\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " Jul 07 11:44:30.181603 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.181528 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-istio-data\") pod \"8d82c38f-06db-416b-85e9-31a73652b508\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " Jul 07 11:44:30.181603 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.181530 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d82c38f-06db-416b-85e9-31a73652b508" (UID: "8d82c38f-06db-416b-85e9-31a73652b508"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:44:30.181603 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.181561 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-workload-socket\") pod \"8d82c38f-06db-416b-85e9-31a73652b508\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " Jul 07 11:44:30.181808 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.181609 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-workload-certs\") pod \"8d82c38f-06db-416b-85e9-31a73652b508\" (UID: \"8d82c38f-06db-416b-85e9-31a73652b508\") " Jul 07 11:44:30.181893 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.181873 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d82c38f-06db-416b-85e9-31a73652b508-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d82c38f-06db-416b-85e9-31a73652b508" (UID: "8d82c38f-06db-416b-85e9-31a73652b508"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:44:30.181956 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.181893 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-credential-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:30.182465 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.182428 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d82c38f-06db-416b-85e9-31a73652b508" (UID: "8d82c38f-06db-416b-85e9-31a73652b508"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:44:30.182756 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.182457 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d82c38f-06db-416b-85e9-31a73652b508" (UID: "8d82c38f-06db-416b-85e9-31a73652b508"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:44:30.182938 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.182904 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d82c38f-06db-416b-85e9-31a73652b508" (UID: "8d82c38f-06db-416b-85e9-31a73652b508"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:44:30.184581 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.184558 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d82c38f-06db-416b-85e9-31a73652b508-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d82c38f-06db-416b-85e9-31a73652b508" (UID: "8d82c38f-06db-416b-85e9-31a73652b508"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 11:44:30.184748 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.184724 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d82c38f-06db-416b-85e9-31a73652b508-kube-api-access-t9bfh" (OuterVolumeSpecName: "kube-api-access-t9bfh") pod "8d82c38f-06db-416b-85e9-31a73652b508" (UID: "8d82c38f-06db-416b-85e9-31a73652b508"). InnerVolumeSpecName "kube-api-access-t9bfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:44:30.184875 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.184856 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d82c38f-06db-416b-85e9-31a73652b508" (UID: "8d82c38f-06db-416b-85e9-31a73652b508"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:44:30.185121 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.185102 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d82c38f-06db-416b-85e9-31a73652b508-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d82c38f-06db-416b-85e9-31a73652b508" (UID: "8d82c38f-06db-416b-85e9-31a73652b508"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:44:30.282885 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.282861 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-istio-envoy\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:30.282885 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.282882 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d82c38f-06db-416b-85e9-31a73652b508-istio-podinfo\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:30.283005 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.282890 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-istio-data\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:30.283005 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.282897 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-workload-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:30.283005 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.282905 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d82c38f-06db-416b-85e9-31a73652b508-workload-certs\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:30.283005 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.282912 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d82c38f-06db-416b-85e9-31a73652b508-istiod-ca-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:30.283005 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.282919 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9bfh\" (UniqueName: \"kubernetes.io/projected/8d82c38f-06db-416b-85e9-31a73652b508-kube-api-access-t9bfh\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:30.283005 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.282927 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d82c38f-06db-416b-85e9-31a73652b508-istio-token\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:30.355824 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.355799 2576 generic.go:356] "Generic (PLEG): container finished" podID="8d82c38f-06db-416b-85e9-31a73652b508" containerID="3da0f7e399229cfd58c0c1f4f436a1776b2ff2999152c4175a2904e6504b2eab" exitCode=0 Jul 07 11:44:30.355914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.355835 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" event={"ID":"8d82c38f-06db-416b-85e9-31a73652b508","Type":"ContainerDied","Data":"3da0f7e399229cfd58c0c1f4f436a1776b2ff2999152c4175a2904e6504b2eab"} Jul 07 11:44:30.355914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.355844 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" Jul 07 11:44:30.355914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.355884 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw" event={"ID":"8d82c38f-06db-416b-85e9-31a73652b508","Type":"ContainerDied","Data":"ef080e7b577c58033fc2828b22d73c0886f75d4ed64e31d5983dd455cd629817"} Jul 07 11:44:30.355914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.355907 2576 scope.go:117] "RemoveContainer" containerID="3da0f7e399229cfd58c0c1f4f436a1776b2ff2999152c4175a2904e6504b2eab" Jul 07 11:44:30.364882 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.364865 2576 scope.go:117] "RemoveContainer" containerID="aa85ce2621eee1c996aff81f99128572384c48f5d2a2712e0a55cc4e66eb6043" Jul 07 11:44:30.374973 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.374958 2576 scope.go:117] "RemoveContainer" containerID="3da0f7e399229cfd58c0c1f4f436a1776b2ff2999152c4175a2904e6504b2eab" Jul 07 11:44:30.375220 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:44:30.375202 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3da0f7e399229cfd58c0c1f4f436a1776b2ff2999152c4175a2904e6504b2eab\": container with ID starting with 3da0f7e399229cfd58c0c1f4f436a1776b2ff2999152c4175a2904e6504b2eab not found: ID does not exist" containerID="3da0f7e399229cfd58c0c1f4f436a1776b2ff2999152c4175a2904e6504b2eab" Jul 07 11:44:30.375256 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.375227 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da0f7e399229cfd58c0c1f4f436a1776b2ff2999152c4175a2904e6504b2eab"} err="failed to get container status \"3da0f7e399229cfd58c0c1f4f436a1776b2ff2999152c4175a2904e6504b2eab\": rpc error: code = NotFound desc = could not find container \"3da0f7e399229cfd58c0c1f4f436a1776b2ff2999152c4175a2904e6504b2eab\": container with ID starting with 3da0f7e399229cfd58c0c1f4f436a1776b2ff2999152c4175a2904e6504b2eab not found: ID does not exist" Jul 07 11:44:30.375256 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.375244 2576 scope.go:117] "RemoveContainer" containerID="aa85ce2621eee1c996aff81f99128572384c48f5d2a2712e0a55cc4e66eb6043" Jul 07 11:44:30.375473 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:44:30.375444 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa85ce2621eee1c996aff81f99128572384c48f5d2a2712e0a55cc4e66eb6043\": container with ID starting with aa85ce2621eee1c996aff81f99128572384c48f5d2a2712e0a55cc4e66eb6043 not found: ID does not exist" containerID="aa85ce2621eee1c996aff81f99128572384c48f5d2a2712e0a55cc4e66eb6043" Jul 07 11:44:30.375530 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.375471 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa85ce2621eee1c996aff81f99128572384c48f5d2a2712e0a55cc4e66eb6043"} err="failed to get container status \"aa85ce2621eee1c996aff81f99128572384c48f5d2a2712e0a55cc4e66eb6043\": rpc error: code = NotFound desc = could not find container \"aa85ce2621eee1c996aff81f99128572384c48f5d2a2712e0a55cc4e66eb6043\": container with ID starting with aa85ce2621eee1c996aff81f99128572384c48f5d2a2712e0a55cc4e66eb6043 not found: ID does not exist" Jul 07 11:44:30.399032 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.399005 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw"] Jul 07 11:44:30.410199 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:30.410176 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-efe248-openshift-default-5444fc6b49-8k8lw"] Jul 07 11:44:32.055175 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:32.055138 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d82c38f-06db-416b-85e9-31a73652b508" path="/var/lib/kubelet/pods/8d82c38f-06db-416b-85e9-31a73652b508/volumes" Jul 07 11:44:32.525887 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:32.525843 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6"] Jul 07 11:44:32.526185 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:32.526156 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" podUID="70666d19-579d-4183-aac7-f1e8dd1d9356" containerName="istio-proxy" containerID="cri-o://50561f6597c1387d2c62cf73dbf593c8786bf8a9f90cdf9ba026b640ebd631a9" gracePeriod=30 Jul 07 11:44:33.330956 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.330922 2576 patch_prober.go:28] interesting pod/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 11:44:33.331371 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.330996 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" podUID="70666d19-579d-4183-aac7-f1e8dd1d9356" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 11:44:33.375676 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.375645 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f"] Jul 07 11:44:33.375985 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.375972 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d82c38f-06db-416b-85e9-31a73652b508" containerName="istio-proxy" Jul 07 11:44:33.376027 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.375986 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d82c38f-06db-416b-85e9-31a73652b508" containerName="istio-proxy" Jul 07 11:44:33.376027 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.375997 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d82c38f-06db-416b-85e9-31a73652b508" containerName="istio-proxy" Jul 07 11:44:33.376027 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.376002 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d82c38f-06db-416b-85e9-31a73652b508" containerName="istio-proxy" Jul 07 11:44:33.376116 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.376058 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d82c38f-06db-416b-85e9-31a73652b508" containerName="istio-proxy" Jul 07 11:44:33.376116 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.376066 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d82c38f-06db-416b-85e9-31a73652b508" containerName="istio-proxy" Jul 07 11:44:33.378956 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.378935 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.381658 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.381634 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a114ee-openshift-default-dockercfg-t5v4x\"" Jul 07 11:44:33.394470 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.394450 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f"] Jul 07 11:44:33.411932 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.411906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-envoy\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.412054 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.411941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istiod-ca-cert\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.412054 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.411966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4sm2\" (UniqueName: \"kubernetes.io/projected/f93f3ca3-01ef-4189-ad79-df7741fe9f99-kube-api-access-z4sm2\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.412054 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.412027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-podinfo\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.412212 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.412076 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-credential-socket\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.412212 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.412111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-workload-socket\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.412212 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.412160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-token\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.412315 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.412217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-workload-certs\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.412315 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.412272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-data\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.513263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.513229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-envoy\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.513263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.513264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istiod-ca-cert\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.513543 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.513283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4sm2\" (UniqueName: \"kubernetes.io/projected/f93f3ca3-01ef-4189-ad79-df7741fe9f99-kube-api-access-z4sm2\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.513543 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.513443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-podinfo\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.513543 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.513519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-credential-socket\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.513707 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.513562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-workload-socket\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.513707 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.513615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-token\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.513707 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.513643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-workload-certs\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.513868 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.513705 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-data\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.513868 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.513829 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-credential-socket\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.514002 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.513979 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-workload-socket\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.514162 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.514142 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istiod-ca-cert\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.514221 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.514145 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-workload-certs\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.514272 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.514214 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-data\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.515749 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.515733 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-envoy\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.516315 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.516293 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-podinfo\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.523050 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.523025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4sm2\" (UniqueName: \"kubernetes.io/projected/f93f3ca3-01ef-4189-ad79-df7741fe9f99-kube-api-access-z4sm2\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.523160 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.523101 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-token\") pod \"e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.691149 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.691113 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:33.835556 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.835531 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f"] Jul 07 11:44:33.837149 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:44:33.837121 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93f3ca3_01ef_4189_ad79_df7741fe9f99.slice/crio-6374314bc7933a342a1487d272645989f30763f93ccace3499aac392db3b0283 WatchSource:0}: Error finding container 6374314bc7933a342a1487d272645989f30763f93ccace3499aac392db3b0283: Status 404 returned error can't find the container with id 6374314bc7933a342a1487d272645989f30763f93ccace3499aac392db3b0283 Jul 07 11:44:33.839226 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.839187 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:44:33.839305 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.839277 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:44:33.839345 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:33.839315 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:44:34.381156 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:34.381124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" event={"ID":"f93f3ca3-01ef-4189-ad79-df7741fe9f99","Type":"ContainerStarted","Data":"fa2b59946e17765a67d019213bf2ab16e53c590bb5430a246491960bd5e66aa4"} Jul 07 11:44:34.381652 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:34.381174 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" event={"ID":"f93f3ca3-01ef-4189-ad79-df7741fe9f99","Type":"ContainerStarted","Data":"6374314bc7933a342a1487d272645989f30763f93ccace3499aac392db3b0283"} Jul 07 11:44:34.404413 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:34.404361 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" podStartSLOduration=1.404347074 podStartE2EDuration="1.404347074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:44:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:44:34.402626879 +0000 UTC m=+2018.879284843" watchObservedRunningTime="2026-07-07 11:44:34.404347074 +0000 UTC m=+2018.881005112" Jul 07 11:44:34.691451 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:34.691421 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:34.695898 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:34.695876 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:35.387545 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:35.387514 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:35.388638 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:35.388613 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:37.792429 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.792357 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:44:37.851832 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.851794 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-workload-socket\") pod \"70666d19-579d-4183-aac7-f1e8dd1d9356\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " Jul 07 11:44:37.851832 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.851831 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70666d19-579d-4183-aac7-f1e8dd1d9356-istiod-ca-cert\") pod \"70666d19-579d-4183-aac7-f1e8dd1d9356\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " Jul 07 11:44:37.852011 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.851871 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdzsc\" (UniqueName: \"kubernetes.io/projected/70666d19-579d-4183-aac7-f1e8dd1d9356-kube-api-access-pdzsc\") pod \"70666d19-579d-4183-aac7-f1e8dd1d9356\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " Jul 07 11:44:37.852011 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.851900 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-envoy\") pod \"70666d19-579d-4183-aac7-f1e8dd1d9356\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " Jul 07 11:44:37.852011 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.851971 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-workload-certs\") pod \"70666d19-579d-4183-aac7-f1e8dd1d9356\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " Jul 07 11:44:37.852011 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.851996 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-token\") pod \"70666d19-579d-4183-aac7-f1e8dd1d9356\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " Jul 07 11:44:37.852187 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.852054 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-credential-socket\") pod \"70666d19-579d-4183-aac7-f1e8dd1d9356\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " Jul 07 11:44:37.852187 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.852090 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-data\") pod \"70666d19-579d-4183-aac7-f1e8dd1d9356\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " Jul 07 11:44:37.852187 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.852083 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "70666d19-579d-4183-aac7-f1e8dd1d9356" (UID: "70666d19-579d-4183-aac7-f1e8dd1d9356"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:44:37.852187 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.852116 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-podinfo\") pod \"70666d19-579d-4183-aac7-f1e8dd1d9356\" (UID: \"70666d19-579d-4183-aac7-f1e8dd1d9356\") " Jul 07 11:44:37.852392 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.852249 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "70666d19-579d-4183-aac7-f1e8dd1d9356" (UID: "70666d19-579d-4183-aac7-f1e8dd1d9356"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:44:37.852392 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.852299 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "70666d19-579d-4183-aac7-f1e8dd1d9356" (UID: "70666d19-579d-4183-aac7-f1e8dd1d9356"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:44:37.852392 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.852388 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-workload-certs\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:37.852566 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.852421 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-credential-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:37.852566 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.852430 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-workload-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:37.852566 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.852549 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70666d19-579d-4183-aac7-f1e8dd1d9356-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "70666d19-579d-4183-aac7-f1e8dd1d9356" (UID: "70666d19-579d-4183-aac7-f1e8dd1d9356"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:44:37.853081 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.853059 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-data" (OuterVolumeSpecName: "istio-data") pod "70666d19-579d-4183-aac7-f1e8dd1d9356" (UID: "70666d19-579d-4183-aac7-f1e8dd1d9356"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:44:37.854366 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.854326 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "70666d19-579d-4183-aac7-f1e8dd1d9356" (UID: "70666d19-579d-4183-aac7-f1e8dd1d9356"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:44:37.854523 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.854503 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-token" (OuterVolumeSpecName: "istio-token") pod "70666d19-579d-4183-aac7-f1e8dd1d9356" (UID: "70666d19-579d-4183-aac7-f1e8dd1d9356"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:44:37.854731 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.854714 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "70666d19-579d-4183-aac7-f1e8dd1d9356" (UID: "70666d19-579d-4183-aac7-f1e8dd1d9356"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 11:44:37.854805 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.854768 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70666d19-579d-4183-aac7-f1e8dd1d9356-kube-api-access-pdzsc" (OuterVolumeSpecName: "kube-api-access-pdzsc") pod "70666d19-579d-4183-aac7-f1e8dd1d9356" (UID: "70666d19-579d-4183-aac7-f1e8dd1d9356"). InnerVolumeSpecName "kube-api-access-pdzsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:44:37.952914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.952895 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70666d19-579d-4183-aac7-f1e8dd1d9356-istiod-ca-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:37.953010 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.952916 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdzsc\" (UniqueName: \"kubernetes.io/projected/70666d19-579d-4183-aac7-f1e8dd1d9356-kube-api-access-pdzsc\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:37.953010 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.952930 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-envoy\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:37.953010 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.952939 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-token\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:37.953010 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.952946 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-data\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:37.953010 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:37.952953 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70666d19-579d-4183-aac7-f1e8dd1d9356-istio-podinfo\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:44:38.405708 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:38.405628 2576 generic.go:356] "Generic (PLEG): container finished" podID="70666d19-579d-4183-aac7-f1e8dd1d9356" containerID="50561f6597c1387d2c62cf73dbf593c8786bf8a9f90cdf9ba026b640ebd631a9" exitCode=0 Jul 07 11:44:38.405708 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:38.405670 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" event={"ID":"70666d19-579d-4183-aac7-f1e8dd1d9356","Type":"ContainerDied","Data":"50561f6597c1387d2c62cf73dbf593c8786bf8a9f90cdf9ba026b640ebd631a9"} Jul 07 11:44:38.405892 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:38.405748 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" event={"ID":"70666d19-579d-4183-aac7-f1e8dd1d9356","Type":"ContainerDied","Data":"6f379aff0ac36841b6e3876be9457b03a7412cbf62cf5f539e4199da4d5170dd"} Jul 07 11:44:38.405892 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:38.405683 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6" Jul 07 11:44:38.405892 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:38.405764 2576 scope.go:117] "RemoveContainer" containerID="50561f6597c1387d2c62cf73dbf593c8786bf8a9f90cdf9ba026b640ebd631a9" Jul 07 11:44:38.414882 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:38.414866 2576 scope.go:117] "RemoveContainer" containerID="b90f5cc9364dbfbcf49cf5922b1b7489e124a1a80ca19f0662a9df8ede71f620" Jul 07 11:44:38.422558 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:38.422543 2576 scope.go:117] "RemoveContainer" containerID="50561f6597c1387d2c62cf73dbf593c8786bf8a9f90cdf9ba026b640ebd631a9" Jul 07 11:44:38.422817 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:44:38.422798 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50561f6597c1387d2c62cf73dbf593c8786bf8a9f90cdf9ba026b640ebd631a9\": container with ID starting with 50561f6597c1387d2c62cf73dbf593c8786bf8a9f90cdf9ba026b640ebd631a9 not found: ID does not exist" containerID="50561f6597c1387d2c62cf73dbf593c8786bf8a9f90cdf9ba026b640ebd631a9" Jul 07 11:44:38.422870 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:38.422828 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50561f6597c1387d2c62cf73dbf593c8786bf8a9f90cdf9ba026b640ebd631a9"} err="failed to get container status \"50561f6597c1387d2c62cf73dbf593c8786bf8a9f90cdf9ba026b640ebd631a9\": rpc error: code = NotFound desc = could not find container \"50561f6597c1387d2c62cf73dbf593c8786bf8a9f90cdf9ba026b640ebd631a9\": container with ID starting with 50561f6597c1387d2c62cf73dbf593c8786bf8a9f90cdf9ba026b640ebd631a9 not found: ID does not exist" Jul 07 11:44:38.422870 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:38.422846 2576 scope.go:117] "RemoveContainer" containerID="b90f5cc9364dbfbcf49cf5922b1b7489e124a1a80ca19f0662a9df8ede71f620" Jul 07 11:44:38.423061 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:44:38.423043 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b90f5cc9364dbfbcf49cf5922b1b7489e124a1a80ca19f0662a9df8ede71f620\": container with ID starting with b90f5cc9364dbfbcf49cf5922b1b7489e124a1a80ca19f0662a9df8ede71f620 not found: ID does not exist" containerID="b90f5cc9364dbfbcf49cf5922b1b7489e124a1a80ca19f0662a9df8ede71f620" Jul 07 11:44:38.423119 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:38.423070 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b90f5cc9364dbfbcf49cf5922b1b7489e124a1a80ca19f0662a9df8ede71f620"} err="failed to get container status \"b90f5cc9364dbfbcf49cf5922b1b7489e124a1a80ca19f0662a9df8ede71f620\": rpc error: code = NotFound desc = could not find container \"b90f5cc9364dbfbcf49cf5922b1b7489e124a1a80ca19f0662a9df8ede71f620\": container with ID starting with b90f5cc9364dbfbcf49cf5922b1b7489e124a1a80ca19f0662a9df8ede71f620 not found: ID does not exist" Jul 07 11:44:38.465815 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:38.465786 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6"] Jul 07 11:44:38.497739 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:38.497709 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-2507eb-openshift-default-789fbb5fdf-9qdg6"] Jul 07 11:44:40.055222 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:40.055194 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70666d19-579d-4183-aac7-f1e8dd1d9356" path="/var/lib/kubelet/pods/70666d19-579d-4183-aac7-f1e8dd1d9356/volumes" Jul 07 11:44:41.696062 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.696027 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p"] Jul 07 11:44:41.696568 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.696550 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70666d19-579d-4183-aac7-f1e8dd1d9356" containerName="istio-proxy" Jul 07 11:44:41.696660 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.696572 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="70666d19-579d-4183-aac7-f1e8dd1d9356" containerName="istio-proxy" Jul 07 11:44:41.696703 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.696672 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="70666d19-579d-4183-aac7-f1e8dd1d9356" containerName="istio-proxy" Jul 07 11:44:41.696703 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.696689 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="70666d19-579d-4183-aac7-f1e8dd1d9356" containerName="istio-proxy" Jul 07 11:44:41.701302 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.701280 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.704070 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.704051 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-cd7fa7-openshift-default-dockercfg-wn8s8\"" Jul 07 11:44:41.714269 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.714249 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p"] Jul 07 11:44:41.787855 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.787819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-credential-socket\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.788019 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.787907 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnm45\" (UniqueName: \"kubernetes.io/projected/8d4a74c6-2936-4e9d-934c-bcba972c169f-kube-api-access-vnm45\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.788019 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.787977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d4a74c6-2936-4e9d-934c-bcba972c169f-istiod-ca-cert\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.788131 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.788021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-token\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.788131 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.788050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-workload-certs\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.788131 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.788084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-data\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.788131 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.788111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-workload-socket\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.788391 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.788173 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-envoy\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.788391 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.788210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-podinfo\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.889103 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.889066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-credential-socket\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.889273 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.889124 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnm45\" (UniqueName: \"kubernetes.io/projected/8d4a74c6-2936-4e9d-934c-bcba972c169f-kube-api-access-vnm45\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.889273 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.889237 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d4a74c6-2936-4e9d-934c-bcba972c169f-istiod-ca-cert\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.889354 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.889272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-token\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.889354 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.889298 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-workload-certs\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.889519 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.889493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-data\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.889592 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.889545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-workload-socket\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.889639 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.889545 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-credential-socket\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.889678 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.889663 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-workload-certs\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.889726 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.889684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-envoy\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.889778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.889732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-podinfo\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.889879 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.889860 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-data\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.889943 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.889887 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-workload-socket\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.890257 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.890232 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d4a74c6-2936-4e9d-934c-bcba972c169f-istiod-ca-cert\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.891904 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.891879 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-envoy\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.892094 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.892075 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-podinfo\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.897958 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.897938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnm45\" (UniqueName: \"kubernetes.io/projected/8d4a74c6-2936-4e9d-934c-bcba972c169f-kube-api-access-vnm45\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:41.898511 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:41.898490 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-token\") pod \"e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:42.011626 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:42.011559 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:42.155829 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:42.155804 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p"] Jul 07 11:44:42.157388 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:44:42.157363 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d4a74c6_2936_4e9d_934c_bcba972c169f.slice/crio-44d1a1c7b22f14e3512084fdba3c63b52407c0044af8734f1aba33878a0c155f WatchSource:0}: Error finding container 44d1a1c7b22f14e3512084fdba3c63b52407c0044af8734f1aba33878a0c155f: Status 404 returned error can't find the container with id 44d1a1c7b22f14e3512084fdba3c63b52407c0044af8734f1aba33878a0c155f Jul 07 11:44:42.159471 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:42.159442 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:44:42.159550 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:42.159504 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:44:42.159550 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:42.159534 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:44:42.430565 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:42.430529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" event={"ID":"8d4a74c6-2936-4e9d-934c-bcba972c169f","Type":"ContainerStarted","Data":"66f413ead974556de5e9987bae780ecfad6616ecebd87fe04d47c98b05093315"} Jul 07 11:44:42.430748 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:42.430587 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" event={"ID":"8d4a74c6-2936-4e9d-934c-bcba972c169f","Type":"ContainerStarted","Data":"44d1a1c7b22f14e3512084fdba3c63b52407c0044af8734f1aba33878a0c155f"} Jul 07 11:44:42.452901 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:42.452854 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" podStartSLOduration=1.4528179620000001 podStartE2EDuration="1.452817962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:44:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:44:42.450703933 +0000 UTC m=+2026.927361893" watchObservedRunningTime="2026-07-07 11:44:42.452817962 +0000 UTC m=+2026.929475921" Jul 07 11:44:43.012141 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:43.012108 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:43.016852 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:43.016825 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:43.435925 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:43.435890 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:43.436974 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:43.436955 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:50.389513 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:50.389091 2576 patch_prober.go:28] interesting pod/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 07 11:44:50.389513 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:50.389151 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" podUID="f93f3ca3-01ef-4189-ad79-df7741fe9f99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 07 11:44:50.476361 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:50.476331 2576 generic.go:356] "Generic (PLEG): container finished" podID="f93f3ca3-01ef-4189-ad79-df7741fe9f99" containerID="fa2b59946e17765a67d019213bf2ab16e53c590bb5430a246491960bd5e66aa4" exitCode=0 Jul 07 11:44:50.476549 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:50.476425 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" event={"ID":"f93f3ca3-01ef-4189-ad79-df7741fe9f99","Type":"ContainerDied","Data":"fa2b59946e17765a67d019213bf2ab16e53c590bb5430a246491960bd5e66aa4"} Jul 07 11:44:50.476823 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:50.476809 2576 scope.go:117] "RemoveContainer" containerID="fa2b59946e17765a67d019213bf2ab16e53c590bb5430a246491960bd5e66aa4" Jul 07 11:44:50.477928 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:50.477900 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:44:50.478025 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:50.477962 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:44:50.478025 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:50.477992 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:44:51.486273 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:51.486227 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" event={"ID":"f93f3ca3-01ef-4189-ad79-df7741fe9f99","Type":"ContainerStarted","Data":"a3ec6f2ee266070fb888b6722284bf0435d4713fa4a62366dd5df4ce8b5869f7"} Jul 07 11:44:51.691684 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:51.691644 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:51.691889 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:51.691794 2576 patch_prober.go:28] interesting pod/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 07 11:44:51.691889 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:51.691837 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" podUID="f93f3ca3-01ef-4189-ad79-df7741fe9f99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 07 11:44:52.691816 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:52.691780 2576 patch_prober.go:28] interesting pod/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 07 11:44:52.692390 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:52.692360 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" podUID="f93f3ca3-01ef-4189-ad79-df7741fe9f99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 07 11:44:53.692553 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:53.692509 2576 patch_prober.go:28] interesting pod/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 07 11:44:53.693065 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:53.692579 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" podUID="f93f3ca3-01ef-4189-ad79-df7741fe9f99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 07 11:44:54.692033 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:54.691987 2576 patch_prober.go:28] interesting pod/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 07 11:44:54.692240 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:54.692056 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" podUID="f93f3ca3-01ef-4189-ad79-df7741fe9f99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 07 11:44:55.695249 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:55.695213 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:55.695726 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:55.695647 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:55.696340 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:55.696318 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:44:57.528997 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:57.528964 2576 generic.go:356] "Generic (PLEG): container finished" podID="8d4a74c6-2936-4e9d-934c-bcba972c169f" containerID="66f413ead974556de5e9987bae780ecfad6616ecebd87fe04d47c98b05093315" exitCode=0 Jul 07 11:44:57.529493 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:57.529039 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" event={"ID":"8d4a74c6-2936-4e9d-934c-bcba972c169f","Type":"ContainerDied","Data":"66f413ead974556de5e9987bae780ecfad6616ecebd87fe04d47c98b05093315"} Jul 07 11:44:57.529629 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:57.529613 2576 scope.go:117] "RemoveContainer" containerID="66f413ead974556de5e9987bae780ecfad6616ecebd87fe04d47c98b05093315" Jul 07 11:44:57.530573 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:57.530550 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:44:57.530640 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:57.530616 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:44:57.530686 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:57.530652 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:44:58.436452 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:58.436424 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:58.537864 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:58.537829 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" event={"ID":"8d4a74c6-2936-4e9d-934c-bcba972c169f","Type":"ContainerStarted","Data":"06f3c2d0311ec70ebdcc3c0e764020e4d8ba5969a55b6d390a717f50b9342576"} Jul 07 11:44:59.012107 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:59.012067 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:44:59.013303 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:59.013275 2576 patch_prober.go:28] interesting pod/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 07 11:44:59.013443 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:44:59.013334 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" podUID="8d4a74c6-2936-4e9d-934c-bcba972c169f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 07 11:45:00.012860 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:00.012821 2576 patch_prober.go:28] interesting pod/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 07 11:45:00.013314 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:00.012883 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" podUID="8d4a74c6-2936-4e9d-934c-bcba972c169f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 07 11:45:01.012635 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:01.012598 2576 patch_prober.go:28] interesting pod/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 07 11:45:01.012827 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:01.012657 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" podUID="8d4a74c6-2936-4e9d-934c-bcba972c169f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 07 11:45:02.011900 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:02.011862 2576 patch_prober.go:28] interesting pod/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 07 11:45:02.012279 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:02.011917 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" podUID="8d4a74c6-2936-4e9d-934c-bcba972c169f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 07 11:45:03.015468 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:03.015438 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:45:03.015921 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:03.015830 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:45:03.016604 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:03.016579 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:45:03.816094 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:03.816063 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f"] Jul 07 11:45:03.816316 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:03.816265 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" podUID="f93f3ca3-01ef-4189-ad79-df7741fe9f99" containerName="istio-proxy" containerID="cri-o://a3ec6f2ee266070fb888b6722284bf0435d4713fa4a62366dd5df4ce8b5869f7" gracePeriod=30 Jul 07 11:45:09.056495 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.056464 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:45:09.059558 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.059536 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istiod-ca-cert\") pod \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " Jul 07 11:45:09.059671 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.059587 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-workload-certs\") pod \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " Jul 07 11:45:09.059671 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.059651 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-envoy\") pod \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " Jul 07 11:45:09.059781 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.059700 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-workload-socket\") pod \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " Jul 07 11:45:09.059781 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.059726 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-data\") pod \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " Jul 07 11:45:09.059781 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.059760 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4sm2\" (UniqueName: \"kubernetes.io/projected/f93f3ca3-01ef-4189-ad79-df7741fe9f99-kube-api-access-z4sm2\") pod \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " Jul 07 11:45:09.059934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.059798 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f93f3ca3-01ef-4189-ad79-df7741fe9f99" (UID: "f93f3ca3-01ef-4189-ad79-df7741fe9f99"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:45:09.059934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.059805 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-podinfo\") pod \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " Jul 07 11:45:09.059934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.059862 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-credential-socket\") pod \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " Jul 07 11:45:09.059934 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.059874 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f93f3ca3-01ef-4189-ad79-df7741fe9f99" (UID: "f93f3ca3-01ef-4189-ad79-df7741fe9f99"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:45:09.060150 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.060001 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f93f3ca3-01ef-4189-ad79-df7741fe9f99" (UID: "f93f3ca3-01ef-4189-ad79-df7741fe9f99"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:45:09.060206 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.060150 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f93f3ca3-01ef-4189-ad79-df7741fe9f99" (UID: "f93f3ca3-01ef-4189-ad79-df7741fe9f99"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:45:09.060260 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.060222 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-workload-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:09.060260 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.060247 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istiod-ca-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:09.060344 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.060260 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-workload-certs\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:09.060954 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.060917 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-data" (OuterVolumeSpecName: "istio-data") pod "f93f3ca3-01ef-4189-ad79-df7741fe9f99" (UID: "f93f3ca3-01ef-4189-ad79-df7741fe9f99"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:45:09.062116 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.062096 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f93f3ca3-01ef-4189-ad79-df7741fe9f99" (UID: "f93f3ca3-01ef-4189-ad79-df7741fe9f99"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:45:09.062510 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.062492 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f93f3ca3-01ef-4189-ad79-df7741fe9f99" (UID: "f93f3ca3-01ef-4189-ad79-df7741fe9f99"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 11:45:09.062596 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.062526 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f93f3ca3-01ef-4189-ad79-df7741fe9f99-kube-api-access-z4sm2" (OuterVolumeSpecName: "kube-api-access-z4sm2") pod "f93f3ca3-01ef-4189-ad79-df7741fe9f99" (UID: "f93f3ca3-01ef-4189-ad79-df7741fe9f99"). InnerVolumeSpecName "kube-api-access-z4sm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:45:09.161185 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.161167 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-token\") pod \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\" (UID: \"f93f3ca3-01ef-4189-ad79-df7741fe9f99\") " Jul 07 11:45:09.161365 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.161352 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-envoy\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:09.161432 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.161367 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-data\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:09.161432 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.161376 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4sm2\" (UniqueName: \"kubernetes.io/projected/f93f3ca3-01ef-4189-ad79-df7741fe9f99-kube-api-access-z4sm2\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:09.161432 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.161384 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-podinfo\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:09.161432 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.161392 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93f3ca3-01ef-4189-ad79-df7741fe9f99-credential-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:09.163144 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.163126 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-token" (OuterVolumeSpecName: "istio-token") pod "f93f3ca3-01ef-4189-ad79-df7741fe9f99" (UID: "f93f3ca3-01ef-4189-ad79-df7741fe9f99"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:45:09.261975 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.261953 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f93f3ca3-01ef-4189-ad79-df7741fe9f99-istio-token\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:09.597636 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.597553 2576 generic.go:356] "Generic (PLEG): container finished" podID="f93f3ca3-01ef-4189-ad79-df7741fe9f99" containerID="a3ec6f2ee266070fb888b6722284bf0435d4713fa4a62366dd5df4ce8b5869f7" exitCode=0 Jul 07 11:45:09.597636 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.597604 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" Jul 07 11:45:09.597636 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.597625 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" event={"ID":"f93f3ca3-01ef-4189-ad79-df7741fe9f99","Type":"ContainerDied","Data":"a3ec6f2ee266070fb888b6722284bf0435d4713fa4a62366dd5df4ce8b5869f7"} Jul 07 11:45:09.597873 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.597678 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f" event={"ID":"f93f3ca3-01ef-4189-ad79-df7741fe9f99","Type":"ContainerDied","Data":"6374314bc7933a342a1487d272645989f30763f93ccace3499aac392db3b0283"} Jul 07 11:45:09.597873 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.597699 2576 scope.go:117] "RemoveContainer" containerID="a3ec6f2ee266070fb888b6722284bf0435d4713fa4a62366dd5df4ce8b5869f7" Jul 07 11:45:09.607701 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.607686 2576 scope.go:117] "RemoveContainer" containerID="fa2b59946e17765a67d019213bf2ab16e53c590bb5430a246491960bd5e66aa4" Jul 07 11:45:09.615601 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.615484 2576 scope.go:117] "RemoveContainer" containerID="a3ec6f2ee266070fb888b6722284bf0435d4713fa4a62366dd5df4ce8b5869f7" Jul 07 11:45:09.615910 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:45:09.615887 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3ec6f2ee266070fb888b6722284bf0435d4713fa4a62366dd5df4ce8b5869f7\": container with ID starting with a3ec6f2ee266070fb888b6722284bf0435d4713fa4a62366dd5df4ce8b5869f7 not found: ID does not exist" containerID="a3ec6f2ee266070fb888b6722284bf0435d4713fa4a62366dd5df4ce8b5869f7" Jul 07 11:45:09.615972 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.615917 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3ec6f2ee266070fb888b6722284bf0435d4713fa4a62366dd5df4ce8b5869f7"} err="failed to get container status \"a3ec6f2ee266070fb888b6722284bf0435d4713fa4a62366dd5df4ce8b5869f7\": rpc error: code = NotFound desc = could not find container \"a3ec6f2ee266070fb888b6722284bf0435d4713fa4a62366dd5df4ce8b5869f7\": container with ID starting with a3ec6f2ee266070fb888b6722284bf0435d4713fa4a62366dd5df4ce8b5869f7 not found: ID does not exist" Jul 07 11:45:09.615972 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.615933 2576 scope.go:117] "RemoveContainer" containerID="fa2b59946e17765a67d019213bf2ab16e53c590bb5430a246491960bd5e66aa4" Jul 07 11:45:09.616165 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:45:09.616150 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa2b59946e17765a67d019213bf2ab16e53c590bb5430a246491960bd5e66aa4\": container with ID starting with fa2b59946e17765a67d019213bf2ab16e53c590bb5430a246491960bd5e66aa4 not found: ID does not exist" containerID="fa2b59946e17765a67d019213bf2ab16e53c590bb5430a246491960bd5e66aa4" Jul 07 11:45:09.616199 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.616170 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa2b59946e17765a67d019213bf2ab16e53c590bb5430a246491960bd5e66aa4"} err="failed to get container status \"fa2b59946e17765a67d019213bf2ab16e53c590bb5430a246491960bd5e66aa4\": rpc error: code = NotFound desc = could not find container \"fa2b59946e17765a67d019213bf2ab16e53c590bb5430a246491960bd5e66aa4\": container with ID starting with fa2b59946e17765a67d019213bf2ab16e53c590bb5430a246491960bd5e66aa4 not found: ID does not exist" Jul 07 11:45:09.620265 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.620244 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f"] Jul 07 11:45:09.628141 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:09.628122 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a114ee-openshift-default-55794494d5-5sv2f"] Jul 07 11:45:10.055754 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:10.055725 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f93f3ca3-01ef-4189-ad79-df7741fe9f99" path="/var/lib/kubelet/pods/f93f3ca3-01ef-4189-ad79-df7741fe9f99/volumes" Jul 07 11:45:10.801696 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:10.801663 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p"] Jul 07 11:45:10.802054 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:10.801865 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" podUID="8d4a74c6-2936-4e9d-934c-bcba972c169f" containerName="istio-proxy" containerID="cri-o://06f3c2d0311ec70ebdcc3c0e764020e4d8ba5969a55b6d390a717f50b9342576" gracePeriod=30 Jul 07 11:45:11.627367 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.627336 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87"] Jul 07 11:45:11.627780 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.627761 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f93f3ca3-01ef-4189-ad79-df7741fe9f99" containerName="istio-proxy" Jul 07 11:45:11.627876 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.627782 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f93f3ca3-01ef-4189-ad79-df7741fe9f99" containerName="istio-proxy" Jul 07 11:45:11.627876 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.627802 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f93f3ca3-01ef-4189-ad79-df7741fe9f99" containerName="istio-proxy" Jul 07 11:45:11.627876 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.627811 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f93f3ca3-01ef-4189-ad79-df7741fe9f99" containerName="istio-proxy" Jul 07 11:45:11.627876 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.627836 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70666d19-579d-4183-aac7-f1e8dd1d9356" containerName="istio-proxy" Jul 07 11:45:11.627876 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.627844 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="70666d19-579d-4183-aac7-f1e8dd1d9356" containerName="istio-proxy" Jul 07 11:45:11.628107 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.627935 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f93f3ca3-01ef-4189-ad79-df7741fe9f99" containerName="istio-proxy" Jul 07 11:45:11.631307 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.631283 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.634492 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.634471 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-b5d0aa-openshift-default-dockercfg-z86kd\"" Jul 07 11:45:11.644082 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.644061 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87"] Jul 07 11:45:11.679213 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.679185 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istiod-ca-cert\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.679307 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.679223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl26n\" (UniqueName: \"kubernetes.io/projected/9bb86d85-7092-445c-8a52-cd5b5c99c46e-kube-api-access-hl26n\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.679307 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.679247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-token\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.679307 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.679271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-credential-socket\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.679307 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.679298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-data\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.679456 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.679313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-podinfo\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.679456 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.679336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-envoy\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.679456 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.679422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-workload-socket\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.679555 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.679468 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-workload-certs\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.780740 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.780701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-workload-socket\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.780929 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.780755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-workload-certs\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.780929 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.780801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istiod-ca-cert\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.780929 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.780837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl26n\" (UniqueName: \"kubernetes.io/projected/9bb86d85-7092-445c-8a52-cd5b5c99c46e-kube-api-access-hl26n\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.780929 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.780875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-token\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.781139 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.780965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-credential-socket\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.781200 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.781167 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-workload-socket\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.781254 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.781196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-workload-certs\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.781309 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.781292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-data\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.781363 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.781324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-podinfo\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.781559 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.781537 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-credential-socket\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.781647 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.781584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-envoy\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.781647 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.781595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-data\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.781751 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.781670 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istiod-ca-cert\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.783863 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.783840 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-podinfo\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.784077 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.784057 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-envoy\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.789621 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.789599 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-token\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.790129 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.790110 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl26n\" (UniqueName: \"kubernetes.io/projected/9bb86d85-7092-445c-8a52-cd5b5c99c46e-kube-api-access-hl26n\") pod \"e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:11.943990 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:11.943971 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:12.090503 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:45:12.090460 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb86d85_7092_445c_8a52_cd5b5c99c46e.slice/crio-ef30e89d803b80c9da83fccddbd23cada4e402654984cee24f03bbf49a9d6e26 WatchSource:0}: Error finding container ef30e89d803b80c9da83fccddbd23cada4e402654984cee24f03bbf49a9d6e26: Status 404 returned error can't find the container with id ef30e89d803b80c9da83fccddbd23cada4e402654984cee24f03bbf49a9d6e26 Jul 07 11:45:12.090931 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:12.090907 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87"] Jul 07 11:45:12.092611 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:12.092573 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:45:12.092733 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:12.092634 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:45:12.092733 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:12.092663 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:45:12.619089 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:12.619053 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" event={"ID":"9bb86d85-7092-445c-8a52-cd5b5c99c46e","Type":"ContainerStarted","Data":"728b0d5708804d759dd08cbac0b501caea10087289daf7e11509f5ad70ed7d9a"} Jul 07 11:45:12.619251 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:12.619106 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" event={"ID":"9bb86d85-7092-445c-8a52-cd5b5c99c46e","Type":"ContainerStarted","Data":"ef30e89d803b80c9da83fccddbd23cada4e402654984cee24f03bbf49a9d6e26"} Jul 07 11:45:12.644151 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:12.644103 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" podStartSLOduration=1.644087983 podStartE2EDuration="1.644087983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:45:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:45:12.641914511 +0000 UTC m=+2057.118572472" watchObservedRunningTime="2026-07-07 11:45:12.644087983 +0000 UTC m=+2057.120745939" Jul 07 11:45:12.944943 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:12.944912 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:13.952331 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:13.952295 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:14.629370 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:14.629340 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:14.630503 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:14.630485 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:16.059894 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.059871 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:45:16.121814 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.121736 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-token\") pod \"8d4a74c6-2936-4e9d-934c-bcba972c169f\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " Jul 07 11:45:16.121814 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.121773 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-workload-certs\") pod \"8d4a74c6-2936-4e9d-934c-bcba972c169f\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " Jul 07 11:45:16.122004 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.121817 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d4a74c6-2936-4e9d-934c-bcba972c169f-istiod-ca-cert\") pod \"8d4a74c6-2936-4e9d-934c-bcba972c169f\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " Jul 07 11:45:16.122004 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.121856 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-credential-socket\") pod \"8d4a74c6-2936-4e9d-934c-bcba972c169f\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " Jul 07 11:45:16.122004 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.121878 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-envoy\") pod \"8d4a74c6-2936-4e9d-934c-bcba972c169f\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " Jul 07 11:45:16.122004 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.121908 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-workload-socket\") pod \"8d4a74c6-2936-4e9d-934c-bcba972c169f\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " Jul 07 11:45:16.122004 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.121968 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnm45\" (UniqueName: \"kubernetes.io/projected/8d4a74c6-2936-4e9d-934c-bcba972c169f-kube-api-access-vnm45\") pod \"8d4a74c6-2936-4e9d-934c-bcba972c169f\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " Jul 07 11:45:16.122004 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.121995 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-podinfo\") pod \"8d4a74c6-2936-4e9d-934c-bcba972c169f\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " Jul 07 11:45:16.122271 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.122026 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-data\") pod \"8d4a74c6-2936-4e9d-934c-bcba972c169f\" (UID: \"8d4a74c6-2936-4e9d-934c-bcba972c169f\") " Jul 07 11:45:16.122271 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.122236 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d4a74c6-2936-4e9d-934c-bcba972c169f" (UID: "8d4a74c6-2936-4e9d-934c-bcba972c169f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:45:16.122414 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.122374 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d4a74c6-2936-4e9d-934c-bcba972c169f" (UID: "8d4a74c6-2936-4e9d-934c-bcba972c169f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:45:16.122488 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.122390 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d4a74c6-2936-4e9d-934c-bcba972c169f" (UID: "8d4a74c6-2936-4e9d-934c-bcba972c169f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:45:16.122488 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.122426 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d4a74c6-2936-4e9d-934c-bcba972c169f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d4a74c6-2936-4e9d-934c-bcba972c169f" (UID: "8d4a74c6-2936-4e9d-934c-bcba972c169f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:45:16.122600 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.122501 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-credential-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:16.123013 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.122990 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d4a74c6-2936-4e9d-934c-bcba972c169f" (UID: "8d4a74c6-2936-4e9d-934c-bcba972c169f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:45:16.124439 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.124413 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d4a74c6-2936-4e9d-934c-bcba972c169f" (UID: "8d4a74c6-2936-4e9d-934c-bcba972c169f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 11:45:16.124551 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.124493 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d4a74c6-2936-4e9d-934c-bcba972c169f-kube-api-access-vnm45" (OuterVolumeSpecName: "kube-api-access-vnm45") pod "8d4a74c6-2936-4e9d-934c-bcba972c169f" (UID: "8d4a74c6-2936-4e9d-934c-bcba972c169f"). InnerVolumeSpecName "kube-api-access-vnm45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:45:16.124633 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.124613 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d4a74c6-2936-4e9d-934c-bcba972c169f" (UID: "8d4a74c6-2936-4e9d-934c-bcba972c169f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:45:16.124694 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.124651 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d4a74c6-2936-4e9d-934c-bcba972c169f" (UID: "8d4a74c6-2936-4e9d-934c-bcba972c169f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:45:16.223591 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.223558 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-envoy\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:16.223591 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.223590 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-workload-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:16.223818 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.223604 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnm45\" (UniqueName: \"kubernetes.io/projected/8d4a74c6-2936-4e9d-934c-bcba972c169f-kube-api-access-vnm45\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:16.223818 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.223617 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-podinfo\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:16.223818 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.223629 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-data\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:16.223818 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.223639 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d4a74c6-2936-4e9d-934c-bcba972c169f-istio-token\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:16.223818 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.223651 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d4a74c6-2936-4e9d-934c-bcba972c169f-workload-certs\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:16.223818 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.223661 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d4a74c6-2936-4e9d-934c-bcba972c169f-istiod-ca-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:45:16.640636 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.640605 2576 generic.go:356] "Generic (PLEG): container finished" podID="8d4a74c6-2936-4e9d-934c-bcba972c169f" containerID="06f3c2d0311ec70ebdcc3c0e764020e4d8ba5969a55b6d390a717f50b9342576" exitCode=0 Jul 07 11:45:16.640814 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.640642 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" event={"ID":"8d4a74c6-2936-4e9d-934c-bcba972c169f","Type":"ContainerDied","Data":"06f3c2d0311ec70ebdcc3c0e764020e4d8ba5969a55b6d390a717f50b9342576"} Jul 07 11:45:16.640814 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.640660 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" Jul 07 11:45:16.640814 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.640712 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p" event={"ID":"8d4a74c6-2936-4e9d-934c-bcba972c169f","Type":"ContainerDied","Data":"44d1a1c7b22f14e3512084fdba3c63b52407c0044af8734f1aba33878a0c155f"} Jul 07 11:45:16.640814 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.640746 2576 scope.go:117] "RemoveContainer" containerID="06f3c2d0311ec70ebdcc3c0e764020e4d8ba5969a55b6d390a717f50b9342576" Jul 07 11:45:16.649915 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.649900 2576 scope.go:117] "RemoveContainer" containerID="66f413ead974556de5e9987bae780ecfad6616ecebd87fe04d47c98b05093315" Jul 07 11:45:16.657991 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.657974 2576 scope.go:117] "RemoveContainer" containerID="06f3c2d0311ec70ebdcc3c0e764020e4d8ba5969a55b6d390a717f50b9342576" Jul 07 11:45:16.658239 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:45:16.658219 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06f3c2d0311ec70ebdcc3c0e764020e4d8ba5969a55b6d390a717f50b9342576\": container with ID starting with 06f3c2d0311ec70ebdcc3c0e764020e4d8ba5969a55b6d390a717f50b9342576 not found: ID does not exist" containerID="06f3c2d0311ec70ebdcc3c0e764020e4d8ba5969a55b6d390a717f50b9342576" Jul 07 11:45:16.658290 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.658246 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06f3c2d0311ec70ebdcc3c0e764020e4d8ba5969a55b6d390a717f50b9342576"} err="failed to get container status \"06f3c2d0311ec70ebdcc3c0e764020e4d8ba5969a55b6d390a717f50b9342576\": rpc error: code = NotFound desc = could not find container \"06f3c2d0311ec70ebdcc3c0e764020e4d8ba5969a55b6d390a717f50b9342576\": container with ID starting with 06f3c2d0311ec70ebdcc3c0e764020e4d8ba5969a55b6d390a717f50b9342576 not found: ID does not exist" Jul 07 11:45:16.658290 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.658262 2576 scope.go:117] "RemoveContainer" containerID="66f413ead974556de5e9987bae780ecfad6616ecebd87fe04d47c98b05093315" Jul 07 11:45:16.658488 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:45:16.658472 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66f413ead974556de5e9987bae780ecfad6616ecebd87fe04d47c98b05093315\": container with ID starting with 66f413ead974556de5e9987bae780ecfad6616ecebd87fe04d47c98b05093315 not found: ID does not exist" containerID="66f413ead974556de5e9987bae780ecfad6616ecebd87fe04d47c98b05093315" Jul 07 11:45:16.658547 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.658492 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66f413ead974556de5e9987bae780ecfad6616ecebd87fe04d47c98b05093315"} err="failed to get container status \"66f413ead974556de5e9987bae780ecfad6616ecebd87fe04d47c98b05093315\": rpc error: code = NotFound desc = could not find container \"66f413ead974556de5e9987bae780ecfad6616ecebd87fe04d47c98b05093315\": container with ID starting with 66f413ead974556de5e9987bae780ecfad6616ecebd87fe04d47c98b05093315 not found: ID does not exist" Jul 07 11:45:16.662686 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.662666 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p"] Jul 07 11:45:16.667219 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:16.667196 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-cd7fa7-openshift-default-5549548985-gbv6p"] Jul 07 11:45:18.055461 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:18.055431 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d4a74c6-2936-4e9d-934c-bcba972c169f" path="/var/lib/kubelet/pods/8d4a74c6-2936-4e9d-934c-bcba972c169f/volumes" Jul 07 11:45:19.777011 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.776980 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7"] Jul 07 11:45:19.777463 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.777300 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d4a74c6-2936-4e9d-934c-bcba972c169f" containerName="istio-proxy" Jul 07 11:45:19.777463 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.777311 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d4a74c6-2936-4e9d-934c-bcba972c169f" containerName="istio-proxy" Jul 07 11:45:19.777463 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.777322 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d4a74c6-2936-4e9d-934c-bcba972c169f" containerName="istio-proxy" Jul 07 11:45:19.777463 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.777327 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d4a74c6-2936-4e9d-934c-bcba972c169f" containerName="istio-proxy" Jul 07 11:45:19.777463 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.777383 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f93f3ca3-01ef-4189-ad79-df7741fe9f99" containerName="istio-proxy" Jul 07 11:45:19.777463 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.777392 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d4a74c6-2936-4e9d-934c-bcba972c169f" containerName="istio-proxy" Jul 07 11:45:19.780609 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.780587 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.783438 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.783417 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-43ebe2-openshift-default-dockercfg-wqkgk\"" Jul 07 11:45:19.795199 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.795177 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7"] Jul 07 11:45:19.854463 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.854433 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-envoy\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.854620 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.854470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-data\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.854620 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.854498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-podinfo\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.854620 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.854583 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t85xw\" (UniqueName: \"kubernetes.io/projected/5aff8a7d-6688-42b1-ad90-2fc521983ac4-kube-api-access-t85xw\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.854620 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.854615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-credential-socket\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.854815 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.854635 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-token\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.854815 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.854660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istiod-ca-cert\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.854815 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.854725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-workload-certs\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.854815 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.854769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-workload-socket\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.956203 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.956165 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-data\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.956203 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.956207 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-podinfo\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.956447 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.956235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t85xw\" (UniqueName: \"kubernetes.io/projected/5aff8a7d-6688-42b1-ad90-2fc521983ac4-kube-api-access-t85xw\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.956447 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.956273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-credential-socket\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.956447 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.956296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-token\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.956447 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.956320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istiod-ca-cert\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.956447 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.956350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-workload-certs\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.956447 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.956384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-workload-socket\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.956758 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.956543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-envoy\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.956758 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.956688 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-credential-socket\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.956866 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.956808 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-workload-certs\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.956920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.956862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-data\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.956920 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.956878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-workload-socket\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.957004 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.956969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istiod-ca-cert\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.958757 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.958734 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-envoy\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.958977 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.958958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-podinfo\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.968366 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.968338 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-token\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:19.968555 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:19.968538 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t85xw\" (UniqueName: \"kubernetes.io/projected/5aff8a7d-6688-42b1-ad90-2fc521983ac4-kube-api-access-t85xw\") pod \"e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:20.092534 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:20.092458 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:20.233720 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:20.233688 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7"] Jul 07 11:45:20.235796 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:45:20.235754 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aff8a7d_6688_42b1_ad90_2fc521983ac4.slice/crio-fc79bce1136650f7224ddbf986a459ab3200ff56bb0354cfbff09f6661ea9d6d WatchSource:0}: Error finding container fc79bce1136650f7224ddbf986a459ab3200ff56bb0354cfbff09f6661ea9d6d: Status 404 returned error can't find the container with id fc79bce1136650f7224ddbf986a459ab3200ff56bb0354cfbff09f6661ea9d6d Jul 07 11:45:20.238013 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:20.237978 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:45:20.238099 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:20.238044 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:45:20.238099 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:20.238071 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:45:20.665384 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:20.665344 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" event={"ID":"5aff8a7d-6688-42b1-ad90-2fc521983ac4","Type":"ContainerStarted","Data":"98fafd47fae4aaf5730d36543410688de5b85df4a06a3977595a0b6555110af1"} Jul 07 11:45:20.665604 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:20.665429 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" event={"ID":"5aff8a7d-6688-42b1-ad90-2fc521983ac4","Type":"ContainerStarted","Data":"fc79bce1136650f7224ddbf986a459ab3200ff56bb0354cfbff09f6661ea9d6d"} Jul 07 11:45:20.689612 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:20.689553 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" podStartSLOduration=1.689532359 podStartE2EDuration="1.689532359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:45:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:45:20.688316674 +0000 UTC m=+2065.164974629" watchObservedRunningTime="2026-07-07 11:45:20.689532359 +0000 UTC m=+2065.166190319" Jul 07 11:45:21.093655 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:21.093547 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:21.105416 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:21.105359 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:21.671054 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:21.671025 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:21.671883 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:21.671867 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:27.720220 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:27.720139 2576 generic.go:356] "Generic (PLEG): container finished" podID="9bb86d85-7092-445c-8a52-cd5b5c99c46e" containerID="728b0d5708804d759dd08cbac0b501caea10087289daf7e11509f5ad70ed7d9a" exitCode=0 Jul 07 11:45:27.720220 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:27.720198 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" event={"ID":"9bb86d85-7092-445c-8a52-cd5b5c99c46e","Type":"ContainerDied","Data":"728b0d5708804d759dd08cbac0b501caea10087289daf7e11509f5ad70ed7d9a"} Jul 07 11:45:27.720656 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:27.720593 2576 scope.go:117] "RemoveContainer" containerID="728b0d5708804d759dd08cbac0b501caea10087289daf7e11509f5ad70ed7d9a" Jul 07 11:45:27.721600 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:27.721570 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:45:27.721707 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:27.721651 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:45:27.721778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:27.721697 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:45:28.732531 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:28.731760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" event={"ID":"9bb86d85-7092-445c-8a52-cd5b5c99c46e","Type":"ContainerStarted","Data":"d7fa27d7f85c2637e3fe6527f334ca2b7764c4d60a7a84582d006133376cd36c"} Jul 07 11:45:28.944571 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:28.944534 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:28.945742 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:28.945718 2576 patch_prober.go:28] interesting pod/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 07 11:45:28.945933 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:28.945905 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" podUID="9bb86d85-7092-445c-8a52-cd5b5c99c46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 07 11:45:29.629945 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:29.629911 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:29.945320 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:29.944997 2576 patch_prober.go:28] interesting pod/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 07 11:45:29.945320 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:29.945047 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" podUID="9bb86d85-7092-445c-8a52-cd5b5c99c46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 07 11:45:30.944770 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:30.944733 2576 patch_prober.go:28] interesting pod/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 07 11:45:30.944945 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:30.944786 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" podUID="9bb86d85-7092-445c-8a52-cd5b5c99c46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 07 11:45:31.945126 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:31.945088 2576 patch_prober.go:28] interesting pod/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 07 11:45:31.945487 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:31.945155 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" podUID="9bb86d85-7092-445c-8a52-cd5b5c99c46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 07 11:45:32.949355 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:32.949325 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:32.950431 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:32.950410 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:45:35.771773 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:35.771740 2576 generic.go:356] "Generic (PLEG): container finished" podID="5aff8a7d-6688-42b1-ad90-2fc521983ac4" containerID="98fafd47fae4aaf5730d36543410688de5b85df4a06a3977595a0b6555110af1" exitCode=0 Jul 07 11:45:35.772183 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:35.771815 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" event={"ID":"5aff8a7d-6688-42b1-ad90-2fc521983ac4","Type":"ContainerDied","Data":"98fafd47fae4aaf5730d36543410688de5b85df4a06a3977595a0b6555110af1"} Jul 07 11:45:35.772183 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:35.772178 2576 scope.go:117] "RemoveContainer" containerID="98fafd47fae4aaf5730d36543410688de5b85df4a06a3977595a0b6555110af1" Jul 07 11:45:35.773179 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:35.773151 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:45:35.773256 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:35.773238 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:45:35.773298 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:35.773285 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 11:45:36.671274 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:36.671241 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:36.779533 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:36.779492 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" event={"ID":"5aff8a7d-6688-42b1-ad90-2fc521983ac4","Type":"ContainerStarted","Data":"f85b13aeb870613f1756e6f928fedf56a67e82adfb19b4e48a60c620100e6a63"} Jul 07 11:45:37.094938 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:37.093807 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:37.095233 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:37.095205 2576 patch_prober.go:28] interesting pod/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 07 11:45:37.095430 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:37.095381 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" podUID="5aff8a7d-6688-42b1-ad90-2fc521983ac4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 07 11:45:38.093794 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:38.093758 2576 patch_prober.go:28] interesting pod/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 07 11:45:38.094353 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:38.094324 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" podUID="5aff8a7d-6688-42b1-ad90-2fc521983ac4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 07 11:45:39.093682 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:39.093645 2576 patch_prober.go:28] interesting pod/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 07 11:45:39.093982 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:39.093945 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" podUID="5aff8a7d-6688-42b1-ad90-2fc521983ac4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 07 11:45:40.093930 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:40.093887 2576 patch_prober.go:28] interesting pod/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 07 11:45:40.094142 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:40.093962 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" podUID="5aff8a7d-6688-42b1-ad90-2fc521983ac4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 07 11:45:41.097266 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:41.097234 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:41.097645 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:41.097497 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:45:41.098038 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:45:41.098020 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:52:25.993319 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:25.993286 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87"] Jul 07 11:52:25.993766 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:25.993533 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" podUID="9bb86d85-7092-445c-8a52-cd5b5c99c46e" containerName="istio-proxy" containerID="cri-o://d7fa27d7f85c2637e3fe6527f334ca2b7764c4d60a7a84582d006133376cd36c" gracePeriod=30 Jul 07 11:52:31.240410 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.240371 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:52:31.270291 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.270223 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl26n\" (UniqueName: \"kubernetes.io/projected/9bb86d85-7092-445c-8a52-cd5b5c99c46e-kube-api-access-hl26n\") pod \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " Jul 07 11:52:31.270387 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.270312 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-workload-socket\") pod \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " Jul 07 11:52:31.270387 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.270349 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-credential-socket\") pod \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " Jul 07 11:52:31.270478 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.270385 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-workload-certs\") pod \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " Jul 07 11:52:31.270478 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.270432 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istiod-ca-cert\") pod \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " Jul 07 11:52:31.270478 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.270471 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-token\") pod \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " Jul 07 11:52:31.270628 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.270505 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-envoy\") pod \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " Jul 07 11:52:31.270628 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.270549 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-podinfo\") pod \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " Jul 07 11:52:31.270628 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.270591 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-data\") pod \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\" (UID: \"9bb86d85-7092-445c-8a52-cd5b5c99c46e\") " Jul 07 11:52:31.270923 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.270582 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9bb86d85-7092-445c-8a52-cd5b5c99c46e" (UID: "9bb86d85-7092-445c-8a52-cd5b5c99c46e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:52:31.270923 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.270603 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9bb86d85-7092-445c-8a52-cd5b5c99c46e" (UID: "9bb86d85-7092-445c-8a52-cd5b5c99c46e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:52:31.270923 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.270913 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9bb86d85-7092-445c-8a52-cd5b5c99c46e" (UID: "9bb86d85-7092-445c-8a52-cd5b5c99c46e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:52:31.271155 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.270987 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9bb86d85-7092-445c-8a52-cd5b5c99c46e" (UID: "9bb86d85-7092-445c-8a52-cd5b5c99c46e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:52:31.271820 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.271793 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-data" (OuterVolumeSpecName: "istio-data") pod "9bb86d85-7092-445c-8a52-cd5b5c99c46e" (UID: "9bb86d85-7092-445c-8a52-cd5b5c99c46e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:52:31.272714 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.272677 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-token" (OuterVolumeSpecName: "istio-token") pod "9bb86d85-7092-445c-8a52-cd5b5c99c46e" (UID: "9bb86d85-7092-445c-8a52-cd5b5c99c46e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:52:31.272800 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.272762 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bb86d85-7092-445c-8a52-cd5b5c99c46e-kube-api-access-hl26n" (OuterVolumeSpecName: "kube-api-access-hl26n") pod "9bb86d85-7092-445c-8a52-cd5b5c99c46e" (UID: "9bb86d85-7092-445c-8a52-cd5b5c99c46e"). InnerVolumeSpecName "kube-api-access-hl26n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:52:31.273479 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.273455 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9bb86d85-7092-445c-8a52-cd5b5c99c46e" (UID: "9bb86d85-7092-445c-8a52-cd5b5c99c46e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 11:52:31.273479 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.273456 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9bb86d85-7092-445c-8a52-cd5b5c99c46e" (UID: "9bb86d85-7092-445c-8a52-cd5b5c99c46e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:52:31.371534 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.371496 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl26n\" (UniqueName: \"kubernetes.io/projected/9bb86d85-7092-445c-8a52-cd5b5c99c46e-kube-api-access-hl26n\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:31.371534 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.371533 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-workload-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:31.371692 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.371547 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-credential-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:31.371692 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.371558 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-workload-certs\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:31.371692 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.371572 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istiod-ca-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:31.371692 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.371583 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-token\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:31.371692 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.371593 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-envoy\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:31.371692 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.371604 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-podinfo\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:31.371692 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.371616 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bb86d85-7092-445c-8a52-cd5b5c99c46e-istio-data\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:31.970889 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.970858 2576 generic.go:356] "Generic (PLEG): container finished" podID="9bb86d85-7092-445c-8a52-cd5b5c99c46e" containerID="d7fa27d7f85c2637e3fe6527f334ca2b7764c4d60a7a84582d006133376cd36c" exitCode=0 Jul 07 11:52:31.971084 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.970895 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" Jul 07 11:52:31.971084 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.970904 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" event={"ID":"9bb86d85-7092-445c-8a52-cd5b5c99c46e","Type":"ContainerDied","Data":"d7fa27d7f85c2637e3fe6527f334ca2b7764c4d60a7a84582d006133376cd36c"} Jul 07 11:52:31.971084 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.970945 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87" event={"ID":"9bb86d85-7092-445c-8a52-cd5b5c99c46e","Type":"ContainerDied","Data":"ef30e89d803b80c9da83fccddbd23cada4e402654984cee24f03bbf49a9d6e26"} Jul 07 11:52:31.971084 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.970966 2576 scope.go:117] "RemoveContainer" containerID="d7fa27d7f85c2637e3fe6527f334ca2b7764c4d60a7a84582d006133376cd36c" Jul 07 11:52:31.980336 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.980319 2576 scope.go:117] "RemoveContainer" containerID="728b0d5708804d759dd08cbac0b501caea10087289daf7e11509f5ad70ed7d9a" Jul 07 11:52:31.988911 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.988893 2576 scope.go:117] "RemoveContainer" containerID="d7fa27d7f85c2637e3fe6527f334ca2b7764c4d60a7a84582d006133376cd36c" Jul 07 11:52:31.989219 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:52:31.989195 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7fa27d7f85c2637e3fe6527f334ca2b7764c4d60a7a84582d006133376cd36c\": container with ID starting with d7fa27d7f85c2637e3fe6527f334ca2b7764c4d60a7a84582d006133376cd36c not found: ID does not exist" containerID="d7fa27d7f85c2637e3fe6527f334ca2b7764c4d60a7a84582d006133376cd36c" Jul 07 11:52:31.989338 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.989226 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7fa27d7f85c2637e3fe6527f334ca2b7764c4d60a7a84582d006133376cd36c"} err="failed to get container status \"d7fa27d7f85c2637e3fe6527f334ca2b7764c4d60a7a84582d006133376cd36c\": rpc error: code = NotFound desc = could not find container \"d7fa27d7f85c2637e3fe6527f334ca2b7764c4d60a7a84582d006133376cd36c\": container with ID starting with d7fa27d7f85c2637e3fe6527f334ca2b7764c4d60a7a84582d006133376cd36c not found: ID does not exist" Jul 07 11:52:31.989338 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.989247 2576 scope.go:117] "RemoveContainer" containerID="728b0d5708804d759dd08cbac0b501caea10087289daf7e11509f5ad70ed7d9a" Jul 07 11:52:31.989570 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:52:31.989540 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"728b0d5708804d759dd08cbac0b501caea10087289daf7e11509f5ad70ed7d9a\": container with ID starting with 728b0d5708804d759dd08cbac0b501caea10087289daf7e11509f5ad70ed7d9a not found: ID does not exist" containerID="728b0d5708804d759dd08cbac0b501caea10087289daf7e11509f5ad70ed7d9a" Jul 07 11:52:31.989637 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.989580 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"728b0d5708804d759dd08cbac0b501caea10087289daf7e11509f5ad70ed7d9a"} err="failed to get container status \"728b0d5708804d759dd08cbac0b501caea10087289daf7e11509f5ad70ed7d9a\": rpc error: code = NotFound desc = could not find container \"728b0d5708804d759dd08cbac0b501caea10087289daf7e11509f5ad70ed7d9a\": container with ID starting with 728b0d5708804d759dd08cbac0b501caea10087289daf7e11509f5ad70ed7d9a not found: ID does not exist" Jul 07 11:52:31.996372 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:31.996342 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87"] Jul 07 11:52:32.000335 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:32.000308 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-b5d0aa-openshift-default-5fc568f895-7bx87"] Jul 07 11:52:32.057620 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:32.057589 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bb86d85-7092-445c-8a52-cd5b5c99c46e" path="/var/lib/kubelet/pods/9bb86d85-7092-445c-8a52-cd5b5c99c46e/volumes" Jul 07 11:52:33.614806 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:33.614772 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7"] Jul 07 11:52:33.615215 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:33.614971 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" podUID="5aff8a7d-6688-42b1-ad90-2fc521983ac4" containerName="istio-proxy" containerID="cri-o://f85b13aeb870613f1756e6f928fedf56a67e82adfb19b4e48a60c620100e6a63" gracePeriod=30 Jul 07 11:52:38.877083 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.877023 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:52:38.938127 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.938082 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istiod-ca-cert\") pod \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " Jul 07 11:52:38.938127 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.938132 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-workload-socket\") pod \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " Jul 07 11:52:38.938366 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.938167 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-podinfo\") pod \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " Jul 07 11:52:38.938366 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.938276 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-token\") pod \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " Jul 07 11:52:38.938366 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.938336 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t85xw\" (UniqueName: \"kubernetes.io/projected/5aff8a7d-6688-42b1-ad90-2fc521983ac4-kube-api-access-t85xw\") pod \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " Jul 07 11:52:38.938366 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.938362 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-credential-socket\") pod \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " Jul 07 11:52:38.938618 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.938425 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-envoy\") pod \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " Jul 07 11:52:38.938618 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.938457 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-workload-certs\") pod \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " Jul 07 11:52:38.938618 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.938455 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5aff8a7d-6688-42b1-ad90-2fc521983ac4" (UID: "5aff8a7d-6688-42b1-ad90-2fc521983ac4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:52:38.938618 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.938502 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5aff8a7d-6688-42b1-ad90-2fc521983ac4" (UID: "5aff8a7d-6688-42b1-ad90-2fc521983ac4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:52:38.938618 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.938510 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-data\") pod \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\" (UID: \"5aff8a7d-6688-42b1-ad90-2fc521983ac4\") " Jul 07 11:52:38.938927 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.938639 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5aff8a7d-6688-42b1-ad90-2fc521983ac4" (UID: "5aff8a7d-6688-42b1-ad90-2fc521983ac4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:52:38.938927 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.938661 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5aff8a7d-6688-42b1-ad90-2fc521983ac4" (UID: "5aff8a7d-6688-42b1-ad90-2fc521983ac4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:52:38.939149 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.939099 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istiod-ca-cert\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:38.939149 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.939128 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-workload-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:38.939149 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.939142 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-credential-socket\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:38.939149 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.939155 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-workload-certs\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:38.939570 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.939550 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-data" (OuterVolumeSpecName: "istio-data") pod "5aff8a7d-6688-42b1-ad90-2fc521983ac4" (UID: "5aff8a7d-6688-42b1-ad90-2fc521983ac4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:52:38.940624 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.940598 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-token" (OuterVolumeSpecName: "istio-token") pod "5aff8a7d-6688-42b1-ad90-2fc521983ac4" (UID: "5aff8a7d-6688-42b1-ad90-2fc521983ac4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:52:38.940725 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.940619 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5aff8a7d-6688-42b1-ad90-2fc521983ac4" (UID: "5aff8a7d-6688-42b1-ad90-2fc521983ac4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 11:52:38.940725 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.940675 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aff8a7d-6688-42b1-ad90-2fc521983ac4-kube-api-access-t85xw" (OuterVolumeSpecName: "kube-api-access-t85xw") pod "5aff8a7d-6688-42b1-ad90-2fc521983ac4" (UID: "5aff8a7d-6688-42b1-ad90-2fc521983ac4"). InnerVolumeSpecName "kube-api-access-t85xw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:52:38.940725 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:38.940691 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5aff8a7d-6688-42b1-ad90-2fc521983ac4" (UID: "5aff8a7d-6688-42b1-ad90-2fc521983ac4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 11:52:39.010799 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.010764 2576 generic.go:356] "Generic (PLEG): container finished" podID="5aff8a7d-6688-42b1-ad90-2fc521983ac4" containerID="f85b13aeb870613f1756e6f928fedf56a67e82adfb19b4e48a60c620100e6a63" exitCode=0 Jul 07 11:52:39.010799 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.010804 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" event={"ID":"5aff8a7d-6688-42b1-ad90-2fc521983ac4","Type":"ContainerDied","Data":"f85b13aeb870613f1756e6f928fedf56a67e82adfb19b4e48a60c620100e6a63"} Jul 07 11:52:39.011024 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.010823 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" Jul 07 11:52:39.011024 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.010846 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7" event={"ID":"5aff8a7d-6688-42b1-ad90-2fc521983ac4","Type":"ContainerDied","Data":"fc79bce1136650f7224ddbf986a459ab3200ff56bb0354cfbff09f6661ea9d6d"} Jul 07 11:52:39.011024 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.010869 2576 scope.go:117] "RemoveContainer" containerID="f85b13aeb870613f1756e6f928fedf56a67e82adfb19b4e48a60c620100e6a63" Jul 07 11:52:39.020477 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.020459 2576 scope.go:117] "RemoveContainer" containerID="98fafd47fae4aaf5730d36543410688de5b85df4a06a3977595a0b6555110af1" Jul 07 11:52:39.028643 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.028625 2576 scope.go:117] "RemoveContainer" containerID="f85b13aeb870613f1756e6f928fedf56a67e82adfb19b4e48a60c620100e6a63" Jul 07 11:52:39.028928 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:52:39.028910 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f85b13aeb870613f1756e6f928fedf56a67e82adfb19b4e48a60c620100e6a63\": container with ID starting with f85b13aeb870613f1756e6f928fedf56a67e82adfb19b4e48a60c620100e6a63 not found: ID does not exist" containerID="f85b13aeb870613f1756e6f928fedf56a67e82adfb19b4e48a60c620100e6a63" Jul 07 11:52:39.028977 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.028937 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f85b13aeb870613f1756e6f928fedf56a67e82adfb19b4e48a60c620100e6a63"} err="failed to get container status \"f85b13aeb870613f1756e6f928fedf56a67e82adfb19b4e48a60c620100e6a63\": rpc error: code = NotFound desc = could not find container \"f85b13aeb870613f1756e6f928fedf56a67e82adfb19b4e48a60c620100e6a63\": container with ID starting with f85b13aeb870613f1756e6f928fedf56a67e82adfb19b4e48a60c620100e6a63 not found: ID does not exist" Jul 07 11:52:39.028977 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.028955 2576 scope.go:117] "RemoveContainer" containerID="98fafd47fae4aaf5730d36543410688de5b85df4a06a3977595a0b6555110af1" Jul 07 11:52:39.029176 ip-10-0-137-8 kubenswrapper[2576]: E0707 11:52:39.029158 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98fafd47fae4aaf5730d36543410688de5b85df4a06a3977595a0b6555110af1\": container with ID starting with 98fafd47fae4aaf5730d36543410688de5b85df4a06a3977595a0b6555110af1 not found: ID does not exist" containerID="98fafd47fae4aaf5730d36543410688de5b85df4a06a3977595a0b6555110af1" Jul 07 11:52:39.029232 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.029183 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98fafd47fae4aaf5730d36543410688de5b85df4a06a3977595a0b6555110af1"} err="failed to get container status \"98fafd47fae4aaf5730d36543410688de5b85df4a06a3977595a0b6555110af1\": rpc error: code = NotFound desc = could not find container \"98fafd47fae4aaf5730d36543410688de5b85df4a06a3977595a0b6555110af1\": container with ID starting with 98fafd47fae4aaf5730d36543410688de5b85df4a06a3977595a0b6555110af1 not found: ID does not exist" Jul 07 11:52:39.037060 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.037037 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7"] Jul 07 11:52:39.039914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.039646 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t85xw\" (UniqueName: \"kubernetes.io/projected/5aff8a7d-6688-42b1-ad90-2fc521983ac4-kube-api-access-t85xw\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:39.039914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.039675 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-envoy\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:39.039914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.039690 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-data\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:39.039914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.039702 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-podinfo\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:39.039914 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.039718 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aff8a7d-6688-42b1-ad90-2fc521983ac4-istio-token\") on node \"ip-10-0-137-8.ec2.internal\" DevicePath \"\"" Jul 07 11:52:39.042089 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.042071 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-43ebe2-openshift-default-c5c7b8c55-ggzg7"] Jul 07 11:52:39.396728 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.396697 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723730-978l4_dc7f3a54-b535-465a-84df-ad11996f6179/cleanup/0.log" Jul 07 11:52:39.733376 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:39.733345 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tdpw6_93317f79-bc39-4dda-aa71-de6124939709/server/0.log" Jul 07 11:52:40.054464 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:40.054376 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aff8a7d-6688-42b1-ad90-2fc521983ac4" path="/var/lib/kubelet/pods/5aff8a7d-6688-42b1-ad90-2fc521983ac4/volumes" Jul 07 11:52:40.083224 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:40.083198 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm_296d6f28-dc03-4019-a541-cca4f0ca91ab/copy-manifests/0.log" Jul 07 11:52:40.091152 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:40.091134 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm_296d6f28-dc03-4019-a541-cca4f0ca91ab/manager/0.log" Jul 07 11:52:40.343357 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:40.343284 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-nlthq_ca36cdf7-bb96-4e2a-a426-73b24c5c6467/postgres/0.log" Jul 07 11:52:41.179378 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:41.179348 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm_73dce630-9f3e-425f-9e36-595127c39459/util/0.log" Jul 07 11:52:41.197232 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:41.197196 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm_73dce630-9f3e-425f-9e36-595127c39459/pull/0.log" Jul 07 11:52:41.211263 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:41.211242 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm_73dce630-9f3e-425f-9e36-595127c39459/extract/0.log" Jul 07 11:52:41.340025 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:41.339999 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp_f15cec8a-6444-4864-b5da-5ea9dd0fa56e/util/0.log" Jul 07 11:52:41.348066 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:41.348047 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp_f15cec8a-6444-4864-b5da-5ea9dd0fa56e/pull/0.log" Jul 07 11:52:41.356212 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:41.356192 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp_f15cec8a-6444-4864-b5da-5ea9dd0fa56e/extract/0.log" Jul 07 11:52:41.478517 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:41.478447 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd_46dbb5de-ff69-4a3b-8b57-48733d0848f1/util/0.log" Jul 07 11:52:41.487227 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:41.487207 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd_46dbb5de-ff69-4a3b-8b57-48733d0848f1/pull/0.log" Jul 07 11:52:41.494087 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:41.494070 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd_46dbb5de-ff69-4a3b-8b57-48733d0848f1/extract/0.log" Jul 07 11:52:41.606704 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:41.606679 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc_9caa147b-1a48-4d79-b10f-311e40b7b291/util/0.log" Jul 07 11:52:41.614977 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:41.614953 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc_9caa147b-1a48-4d79-b10f-311e40b7b291/pull/0.log" Jul 07 11:52:41.622633 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:41.622613 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc_9caa147b-1a48-4d79-b10f-311e40b7b291/extract/0.log" Jul 07 11:52:41.970303 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:41.970274 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qvfth_723d6471-97a3-401c-a32a-4ef075bb8e54/manager/0.log" Jul 07 11:52:42.310757 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:42.310680 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jsnxt_51c3b523-89da-49f0-b9f0-c894a5344a0c/manager/0.log" Jul 07 11:52:42.877436 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:42.877389 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42p6hz_0c7a195e-3e93-46f5-b22d-a9bd05fa460e/istio-proxy/0.log" Jul 07 11:52:42.994891 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:42.994863 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kb4t9_387bde3b-2aa7-4e0b-9714-f40f1500c301/discovery/0.log" Jul 07 11:52:43.224568 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:43.224534 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5df5f4cc47-vbxbx_6e87dafe-49d0-426a-9c58-6220a6cb9ec7/kube-auth-proxy/0.log" Jul 07 11:52:43.345054 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:43.345027 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vd55d_c26b065b-9fa4-43b2-8803-e57c245ca099/istio-proxy/1.log" Jul 07 11:52:44.371357 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:44.371331 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtf2kz_c927eb4c-56a6-443a-80b7-9bbc67949cae/main/0.log" Jul 07 11:52:48.663894 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.663806 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rl7lp/must-gather-dxb7c"] Jul 07 11:52:48.664209 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.664199 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bb86d85-7092-445c-8a52-cd5b5c99c46e" containerName="istio-proxy" Jul 07 11:52:48.664259 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.664211 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bb86d85-7092-445c-8a52-cd5b5c99c46e" containerName="istio-proxy" Jul 07 11:52:48.664259 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.664221 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aff8a7d-6688-42b1-ad90-2fc521983ac4" containerName="istio-proxy" Jul 07 11:52:48.664259 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.664226 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aff8a7d-6688-42b1-ad90-2fc521983ac4" containerName="istio-proxy" Jul 07 11:52:48.664259 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.664231 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bb86d85-7092-445c-8a52-cd5b5c99c46e" containerName="istio-proxy" Jul 07 11:52:48.664259 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.664239 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bb86d85-7092-445c-8a52-cd5b5c99c46e" containerName="istio-proxy" Jul 07 11:52:48.664259 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.664251 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aff8a7d-6688-42b1-ad90-2fc521983ac4" containerName="istio-proxy" Jul 07 11:52:48.664259 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.664256 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aff8a7d-6688-42b1-ad90-2fc521983ac4" containerName="istio-proxy" Jul 07 11:52:48.664498 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.664309 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d4a74c6-2936-4e9d-934c-bcba972c169f" containerName="istio-proxy" Jul 07 11:52:48.664498 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.664319 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aff8a7d-6688-42b1-ad90-2fc521983ac4" containerName="istio-proxy" Jul 07 11:52:48.664498 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.664326 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bb86d85-7092-445c-8a52-cd5b5c99c46e" containerName="istio-proxy" Jul 07 11:52:48.664498 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.664442 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bb86d85-7092-445c-8a52-cd5b5c99c46e" containerName="istio-proxy" Jul 07 11:52:48.664498 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.664451 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aff8a7d-6688-42b1-ad90-2fc521983ac4" containerName="istio-proxy" Jul 07 11:52:48.667241 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.667225 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rl7lp/must-gather-dxb7c" Jul 07 11:52:48.670242 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.670222 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rl7lp\"/\"kube-root-ca.crt\"" Jul 07 11:52:48.670515 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.670500 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rl7lp\"/\"default-dockercfg-2t97q\"" Jul 07 11:52:48.670778 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.670764 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rl7lp\"/\"openshift-service-ca.crt\"" Jul 07 11:52:48.685598 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.685578 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rl7lp/must-gather-dxb7c"] Jul 07 11:52:48.723660 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.723640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bfe748d8-baa9-4d0d-bba3-57c723d73495-must-gather-output\") pod \"must-gather-dxb7c\" (UID: \"bfe748d8-baa9-4d0d-bba3-57c723d73495\") " pod="openshift-must-gather-rl7lp/must-gather-dxb7c" Jul 07 11:52:48.723780 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.723666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkrfk\" (UniqueName: \"kubernetes.io/projected/bfe748d8-baa9-4d0d-bba3-57c723d73495-kube-api-access-zkrfk\") pod \"must-gather-dxb7c\" (UID: \"bfe748d8-baa9-4d0d-bba3-57c723d73495\") " pod="openshift-must-gather-rl7lp/must-gather-dxb7c" Jul 07 11:52:48.824833 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.824809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bfe748d8-baa9-4d0d-bba3-57c723d73495-must-gather-output\") pod \"must-gather-dxb7c\" (UID: \"bfe748d8-baa9-4d0d-bba3-57c723d73495\") " pod="openshift-must-gather-rl7lp/must-gather-dxb7c" Jul 07 11:52:48.824944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.824840 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkrfk\" (UniqueName: \"kubernetes.io/projected/bfe748d8-baa9-4d0d-bba3-57c723d73495-kube-api-access-zkrfk\") pod \"must-gather-dxb7c\" (UID: \"bfe748d8-baa9-4d0d-bba3-57c723d73495\") " pod="openshift-must-gather-rl7lp/must-gather-dxb7c" Jul 07 11:52:48.825142 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.825116 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bfe748d8-baa9-4d0d-bba3-57c723d73495-must-gather-output\") pod \"must-gather-dxb7c\" (UID: \"bfe748d8-baa9-4d0d-bba3-57c723d73495\") " pod="openshift-must-gather-rl7lp/must-gather-dxb7c" Jul 07 11:52:48.835708 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.835690 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkrfk\" (UniqueName: \"kubernetes.io/projected/bfe748d8-baa9-4d0d-bba3-57c723d73495-kube-api-access-zkrfk\") pod \"must-gather-dxb7c\" (UID: \"bfe748d8-baa9-4d0d-bba3-57c723d73495\") " pod="openshift-must-gather-rl7lp/must-gather-dxb7c" Jul 07 11:52:48.976536 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:48.976481 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rl7lp/must-gather-dxb7c" Jul 07 11:52:49.119909 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:49.119880 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rl7lp/must-gather-dxb7c"] Jul 07 11:52:49.120548 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:52:49.120525 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfe748d8_baa9_4d0d_bba3_57c723d73495.slice/crio-bc31a5b1d766d489bc9c0801153a2716a4fb03287b2a5fcd17327bf31505bdd7 WatchSource:0}: Error finding container bc31a5b1d766d489bc9c0801153a2716a4fb03287b2a5fcd17327bf31505bdd7: Status 404 returned error can't find the container with id bc31a5b1d766d489bc9c0801153a2716a4fb03287b2a5fcd17327bf31505bdd7 Jul 07 11:52:49.122518 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:49.122498 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 11:52:50.072576 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:50.072489 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rl7lp/must-gather-dxb7c" event={"ID":"bfe748d8-baa9-4d0d-bba3-57c723d73495","Type":"ContainerStarted","Data":"705a04e9e25ccad08ae8277f214356ce5beb9c71a099f0374605d7a4d6b3b7e8"} Jul 07 11:52:50.072576 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:50.072541 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rl7lp/must-gather-dxb7c" event={"ID":"bfe748d8-baa9-4d0d-bba3-57c723d73495","Type":"ContainerStarted","Data":"a7de6fcb92fd2826a0f767e719086a3b3514cf6716aa4d582d5abbba06487814"} Jul 07 11:52:50.072576 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:50.072561 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rl7lp/must-gather-dxb7c" event={"ID":"bfe748d8-baa9-4d0d-bba3-57c723d73495","Type":"ContainerStarted","Data":"bc31a5b1d766d489bc9c0801153a2716a4fb03287b2a5fcd17327bf31505bdd7"} Jul 07 11:52:50.092944 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:50.092887 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rl7lp/must-gather-dxb7c" podStartSLOduration=1.397417022 podStartE2EDuration="2.092866114s" totalImagesPullingTime="695.449092ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:52:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:52:50.090217945 +0000 UTC m=+2514.566875932" watchObservedRunningTime="2026-07-07 11:52:50.092866114 +0000 UTC m=+2514.569524076" Jul 07 11:52:51.558844 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:51.558817 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9ntcg_9106972d-25a4-4ca7-b58b-72e4af5cbef9/global-pull-secret-syncer/0.log" Jul 07 11:52:51.724867 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:51.724831 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zcp9j_b530b5f3-833a-4b83-9cdc-0f496a0225ce/konnectivity-agent/0.log" Jul 07 11:52:51.774089 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:51.774063 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-8.ec2.internal_2ca19b4fae04ee4ffd4ef9397655850d/haproxy/0.log" Jul 07 11:52:55.839344 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:55.839233 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm_73dce630-9f3e-425f-9e36-595127c39459/extract/0.log" Jul 07 11:52:55.879582 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:55.879506 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm_73dce630-9f3e-425f-9e36-595127c39459/util/0.log" Jul 07 11:52:55.914663 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:55.914630 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597c6pm_73dce630-9f3e-425f-9e36-595127c39459/pull/0.log" Jul 07 11:52:55.961058 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:55.960798 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp_f15cec8a-6444-4864-b5da-5ea9dd0fa56e/extract/0.log" Jul 07 11:52:55.997091 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:55.997000 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp_f15cec8a-6444-4864-b5da-5ea9dd0fa56e/util/0.log" Jul 07 11:52:56.024132 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:56.024101 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j8wqp_f15cec8a-6444-4864-b5da-5ea9dd0fa56e/pull/0.log" Jul 07 11:52:56.056539 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:56.056513 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd_46dbb5de-ff69-4a3b-8b57-48733d0848f1/extract/0.log" Jul 07 11:52:56.088542 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:56.088510 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd_46dbb5de-ff69-4a3b-8b57-48733d0848f1/util/0.log" Jul 07 11:52:56.118014 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:56.117904 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bm2gd_46dbb5de-ff69-4a3b-8b57-48733d0848f1/pull/0.log" Jul 07 11:52:56.156812 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:56.156763 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc_9caa147b-1a48-4d79-b10f-311e40b7b291/extract/0.log" Jul 07 11:52:56.188318 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:56.188296 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc_9caa147b-1a48-4d79-b10f-311e40b7b291/util/0.log" Jul 07 11:52:56.221047 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:56.221021 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jzclc_9caa147b-1a48-4d79-b10f-311e40b7b291/pull/0.log" Jul 07 11:52:56.664094 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:56.664067 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qvfth_723d6471-97a3-401c-a32a-4ef075bb8e54/manager/0.log" Jul 07 11:52:56.909428 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:56.909147 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jsnxt_51c3b523-89da-49f0-b9f0-c894a5344a0c/manager/0.log" Jul 07 11:52:59.493308 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:59.493280 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cz8b2_ac1c0d5f-479c-4324-96e3-adc87401fe4b/node-exporter/0.log" Jul 07 11:52:59.525970 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:59.525910 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cz8b2_ac1c0d5f-479c-4324-96e3-adc87401fe4b/kube-rbac-proxy/0.log" Jul 07 11:52:59.565101 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:52:59.565063 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cz8b2_ac1c0d5f-479c-4324-96e3-adc87401fe4b/init-textfile/0.log" Jul 07 11:53:00.144358 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:00.144330 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-fpp8s_ed391f3a-9f7b-44c0-bd4f-a6362de9d7ce/prometheus-operator-admission-webhook/0.log" Jul 07 11:53:00.854375 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:00.854337 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67"] Jul 07 11:53:00.859096 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:00.859069 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:00.869979 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:00.869951 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67"] Jul 07 11:53:00.972003 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:00.971963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9735d92-48fb-435e-92d4-d535c9b29116-sys\") pod \"perf-node-gather-daemonset-k8l67\" (UID: \"d9735d92-48fb-435e-92d4-d535c9b29116\") " pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:00.972193 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:00.972023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9735d92-48fb-435e-92d4-d535c9b29116-podres\") pod \"perf-node-gather-daemonset-k8l67\" (UID: \"d9735d92-48fb-435e-92d4-d535c9b29116\") " pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:00.972193 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:00.972067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzt6k\" (UniqueName: \"kubernetes.io/projected/d9735d92-48fb-435e-92d4-d535c9b29116-kube-api-access-zzt6k\") pod \"perf-node-gather-daemonset-k8l67\" (UID: \"d9735d92-48fb-435e-92d4-d535c9b29116\") " pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:00.972193 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:00.972168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9735d92-48fb-435e-92d4-d535c9b29116-proc\") pod \"perf-node-gather-daemonset-k8l67\" (UID: \"d9735d92-48fb-435e-92d4-d535c9b29116\") " pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:00.972370 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:00.972209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9735d92-48fb-435e-92d4-d535c9b29116-lib-modules\") pod \"perf-node-gather-daemonset-k8l67\" (UID: \"d9735d92-48fb-435e-92d4-d535c9b29116\") " pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:01.073529 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:01.073461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9735d92-48fb-435e-92d4-d535c9b29116-proc\") pod \"perf-node-gather-daemonset-k8l67\" (UID: \"d9735d92-48fb-435e-92d4-d535c9b29116\") " pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:01.073529 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:01.073537 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9735d92-48fb-435e-92d4-d535c9b29116-lib-modules\") pod \"perf-node-gather-daemonset-k8l67\" (UID: \"d9735d92-48fb-435e-92d4-d535c9b29116\") " pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:01.073783 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:01.073488 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9735d92-48fb-435e-92d4-d535c9b29116-proc\") pod \"perf-node-gather-daemonset-k8l67\" (UID: \"d9735d92-48fb-435e-92d4-d535c9b29116\") " pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:01.073783 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:01.073650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9735d92-48fb-435e-92d4-d535c9b29116-sys\") pod \"perf-node-gather-daemonset-k8l67\" (UID: \"d9735d92-48fb-435e-92d4-d535c9b29116\") " pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:01.073783 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:01.073685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9735d92-48fb-435e-92d4-d535c9b29116-podres\") pod \"perf-node-gather-daemonset-k8l67\" (UID: \"d9735d92-48fb-435e-92d4-d535c9b29116\") " pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:01.073783 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:01.073715 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9735d92-48fb-435e-92d4-d535c9b29116-lib-modules\") pod \"perf-node-gather-daemonset-k8l67\" (UID: \"d9735d92-48fb-435e-92d4-d535c9b29116\") " pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:01.073986 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:01.073789 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9735d92-48fb-435e-92d4-d535c9b29116-sys\") pod \"perf-node-gather-daemonset-k8l67\" (UID: \"d9735d92-48fb-435e-92d4-d535c9b29116\") " pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:01.073986 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:01.073890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9735d92-48fb-435e-92d4-d535c9b29116-podres\") pod \"perf-node-gather-daemonset-k8l67\" (UID: \"d9735d92-48fb-435e-92d4-d535c9b29116\") " pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:01.073986 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:01.073919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzt6k\" (UniqueName: \"kubernetes.io/projected/d9735d92-48fb-435e-92d4-d535c9b29116-kube-api-access-zzt6k\") pod \"perf-node-gather-daemonset-k8l67\" (UID: \"d9735d92-48fb-435e-92d4-d535c9b29116\") " pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:01.083341 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:01.083304 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzt6k\" (UniqueName: \"kubernetes.io/projected/d9735d92-48fb-435e-92d4-d535c9b29116-kube-api-access-zzt6k\") pod \"perf-node-gather-daemonset-k8l67\" (UID: \"d9735d92-48fb-435e-92d4-d535c9b29116\") " pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:01.171297 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:01.171267 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:01.339850 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:01.339816 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67"] Jul 07 11:53:01.341043 ip-10-0-137-8 kubenswrapper[2576]: W0707 11:53:01.341003 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd9735d92_48fb_435e_92d4_d535c9b29116.slice/crio-8313cfdc9fe722c11a17ceb99799b3e5a0ed421773eb68f239e6a0a1ffacaa04 WatchSource:0}: Error finding container 8313cfdc9fe722c11a17ceb99799b3e5a0ed421773eb68f239e6a0a1ffacaa04: Status 404 returned error can't find the container with id 8313cfdc9fe722c11a17ceb99799b3e5a0ed421773eb68f239e6a0a1ffacaa04 Jul 07 11:53:02.163909 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:02.163874 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" event={"ID":"d9735d92-48fb-435e-92d4-d535c9b29116","Type":"ContainerStarted","Data":"f781d15a99f992e21bdf2b3e1859773d8222e20920ef040e0410c614834f4c3a"} Jul 07 11:53:02.164320 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:02.163936 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" event={"ID":"d9735d92-48fb-435e-92d4-d535c9b29116","Type":"ContainerStarted","Data":"8313cfdc9fe722c11a17ceb99799b3e5a0ed421773eb68f239e6a0a1ffacaa04"} Jul 07 11:53:02.164320 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:02.164030 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:02.181477 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:02.181382 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" podStartSLOduration=2.181362806 podStartE2EDuration="2.181362806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:53:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:53:02.180486733 +0000 UTC m=+2526.657144695" watchObservedRunningTime="2026-07-07 11:53:02.181362806 +0000 UTC m=+2526.658020767" Jul 07 11:53:02.609825 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:02.609759 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-766f56dff9-slnct_9879d388-7022-49db-92b9-867f88254cf3/console/0.log" Jul 07 11:53:04.241544 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:04.241503 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5h9rt_a8b7f788-470c-4494-9a49-491222a25879/dns/0.log" Jul 07 11:53:04.264809 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:04.264780 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5h9rt_a8b7f788-470c-4494-9a49-491222a25879/kube-rbac-proxy/0.log" Jul 07 11:53:04.423360 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:04.423336 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-87rvw_7ad4910d-9603-4c7c-8955-6629120e2c70/dns-node-resolver/0.log" Jul 07 11:53:04.990900 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:04.990868 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-568b5bc9b4-n8hcv_adde301b-7bda-4097-9ee5-69bbfda2aefe/registry/0.log" Jul 07 11:53:05.040244 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:05.040218 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-st4qc_3080673e-c2c6-416d-8f5f-dee0e93de1b5/node-ca/0.log" Jul 07 11:53:06.115388 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:06.115358 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42p6hz_0c7a195e-3e93-46f5-b22d-a9bd05fa460e/istio-proxy/0.log" Jul 07 11:53:06.262929 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:06.262896 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kb4t9_387bde3b-2aa7-4e0b-9714-f40f1500c301/discovery/0.log" Jul 07 11:53:06.351961 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:06.351932 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5df5f4cc47-vbxbx_6e87dafe-49d0-426a-9c58-6220a6cb9ec7/kube-auth-proxy/0.log" Jul 07 11:53:06.400058 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:06.399977 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vd55d_c26b065b-9fa4-43b2-8803-e57c245ca099/istio-proxy/0.log" Jul 07 11:53:06.436203 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:06.436176 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vd55d_c26b065b-9fa4-43b2-8803-e57c245ca099/istio-proxy/1.log" Jul 07 11:53:07.332262 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:07.332228 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5mnfm_d320459c-a431-4b6e-9ce6-8081cb31087b/serve-healthcheck-canary/0.log" Jul 07 11:53:08.134450 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:08.134422 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dg7s8_efd30219-18cc-478b-ac1e-d013112f11ee/kube-rbac-proxy/0.log" Jul 07 11:53:08.161693 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:08.161670 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dg7s8_efd30219-18cc-478b-ac1e-d013112f11ee/exporter/0.log" Jul 07 11:53:08.179916 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:08.179869 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rl7lp/perf-node-gather-daemonset-k8l67" Jul 07 11:53:08.186416 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:08.186374 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dg7s8_efd30219-18cc-478b-ac1e-d013112f11ee/extractor/0.log" Jul 07 11:53:10.856791 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:10.856710 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723730-978l4_dc7f3a54-b535-465a-84df-ad11996f6179/cleanup/0.log" Jul 07 11:53:11.027176 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:11.027138 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tdpw6_93317f79-bc39-4dda-aa71-de6124939709/server/0.log" Jul 07 11:53:11.175478 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:11.175451 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm_296d6f28-dc03-4019-a541-cca4f0ca91ab/manager/0.log" Jul 07 11:53:11.196357 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:11.196331 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc7dd79cd-fgjsm_296d6f28-dc03-4019-a541-cca4f0ca91ab/copy-manifests/0.log" Jul 07 11:53:11.323582 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:11.323558 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-nlthq_ca36cdf7-bb96-4e2a-a426-73b24c5c6467/postgres/0.log" Jul 07 11:53:11.446068 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:11.446002 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42p6hz_0c7a195e-3e93-46f5-b22d-a9bd05fa460e/istio-proxy/0.log" Jul 07 11:53:11.553546 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:11.553515 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kb4t9_387bde3b-2aa7-4e0b-9714-f40f1500c301/discovery/0.log" Jul 07 11:53:11.586291 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:11.586265 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5df5f4cc47-vbxbx_6e87dafe-49d0-426a-9c58-6220a6cb9ec7/kube-auth-proxy/0.log" Jul 07 11:53:11.611543 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:11.611511 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vd55d_c26b065b-9fa4-43b2-8803-e57c245ca099/istio-proxy/0.log" Jul 07 11:53:11.656081 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:11.656047 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vd55d_c26b065b-9fa4-43b2-8803-e57c245ca099/istio-proxy/1.log" Jul 07 11:53:12.890855 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:12.890758 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42p6hz_0c7a195e-3e93-46f5-b22d-a9bd05fa460e/istio-proxy/0.log" Jul 07 11:53:12.902361 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:12.902333 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-p2tf7_34ce3f60-f4ff-45e2-b92a-ce13c3f0e2ed/openshift-lws-operator/0.log" Jul 07 11:53:13.024256 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:13.024227 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kb4t9_387bde3b-2aa7-4e0b-9714-f40f1500c301/discovery/0.log" Jul 07 11:53:13.053891 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:13.053864 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5df5f4cc47-vbxbx_6e87dafe-49d0-426a-9c58-6220a6cb9ec7/kube-auth-proxy/0.log" Jul 07 11:53:13.076176 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:13.076144 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vd55d_c26b065b-9fa4-43b2-8803-e57c245ca099/istio-proxy/0.log" Jul 07 11:53:13.112487 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:13.112456 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vd55d_c26b065b-9fa4-43b2-8803-e57c245ca099/istio-proxy/1.log" Jul 07 11:53:17.662377 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:17.662350 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-nkgjz_28eb1119-0a4f-4231-a052-47e23675bfe8/migrator/0.log" Jul 07 11:53:17.685821 ip-10-0-137-8 kubenswrapper[2576]: I0707 11:53:17.685788 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-nkgjz_28eb1119-0a4f-4231-a052-47e23675bfe8/graceful-termination/0.log"