Jul 17 17:28:54.210781 ip-10-0-130-245 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 17 17:28:54.210790 ip-10-0-130-245 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 17 17:28:54.210797 ip-10-0-130-245 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 17 17:28:54.211022 ip-10-0-130-245 systemd[1]: Failed to start Kubernetes Kubelet. Jul 17 17:29:03.761872 ip-10-0-130-245 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 17 17:29:03.761888 ip-10-0-130-245 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 67d628586bd9484e9ad8517c038a8ea6 -- Jul 17 17:30:31.255944 ip-10-0-130-245 systemd[1]: Starting Kubernetes Kubelet... Jul 17 17:30:32.001257 ip-10-0-130-245 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 17:30:32.001257 ip-10-0-130-245 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 17:30:32.001257 ip-10-0-130-245 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 17:30:32.001257 ip-10-0-130-245 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 17:30:32.001257 ip-10-0-130-245 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 17:30:32.001257 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.716562 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 17:30:32.001257 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723231 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:30:32.001257 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723248 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:30:32.001257 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723252 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:30:32.001257 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723256 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:30:32.001257 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723258 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:30:32.001257 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723261 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:30:32.001257 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723264 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:30:32.001257 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723267 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723275 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723279 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723282 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723286 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723289 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723291 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723294 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723297 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723300 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723303 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723305 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723309 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723311 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723314 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723317 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723319 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723322 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723325 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:30:32.011810 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723329 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:30:31.796747 ip-10-0-130-245 systemd[1]: Started Kubernetes Kubelet. Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723333 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723336 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723339 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723341 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723344 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723347 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723349 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723352 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723355 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723358 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723360 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723363 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723371 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723374 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723377 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723380 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723383 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723386 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723389 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:30:32.013215 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723391 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723394 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723396 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723399 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723401 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723404 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723406 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723409 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723411 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723413 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723416 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723419 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723421 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723424 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723426 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723429 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723431 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723433 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723436 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:30:32.014384 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723438 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723441 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723443 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723446 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723449 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723451 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723454 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723464 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723467 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723470 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723472 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723475 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723477 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723480 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723482 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723487 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723490 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723493 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723496 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723498 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:30:32.015000 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723501 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723503 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723506 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723508 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723511 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723514 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723518 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723520 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723523 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723526 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723529 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723532 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723535 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.723538 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724322 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724330 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724334 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724337 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724340 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:30:32.016075 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724342 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724351 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724354 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724357 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724360 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724362 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724365 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724368 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724370 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724373 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724375 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724378 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724380 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724383 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724385 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724388 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724391 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724395 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724397 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724400 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:30:32.016728 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724402 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724405 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724408 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724410 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724412 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724416 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724419 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724422 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724424 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724427 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724429 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724432 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724434 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724436 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724445 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724447 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724450 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724453 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724455 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724458 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:30:32.017562 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724461 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724463 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724466 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724469 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724472 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724474 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724477 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724479 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724482 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724484 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724487 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724490 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724492 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724495 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724497 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724500 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724502 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724505 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724509 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724511 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:30:32.018163 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724514 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724516 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724519 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724522 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724524 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724527 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724529 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724537 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724540 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724545 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724549 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724552 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724555 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724558 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724561 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724565 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724567 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724571 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724574 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:30:32.018986 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724577 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724580 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724582 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724585 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724588 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724590 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724593 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724596 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724598 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724600 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724603 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724605 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724608 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724611 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.724613 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725040 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725045 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725049 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725052 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725055 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:30:32.019622 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725058 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725061 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725063 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725066 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725068 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725071 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725074 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725076 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725081 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725084 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725087 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725089 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725091 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725094 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725097 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725100 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725102 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725105 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725108 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725111 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:30:32.020545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725113 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725116 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725118 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725121 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725124 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725126 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725129 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725131 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725134 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725136 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725139 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725141 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725144 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725146 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725149 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725152 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725154 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725156 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725159 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725161 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:30:32.022361 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725165 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725168 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725170 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725174 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725177 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725179 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725181 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725184 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725186 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725189 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725192 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725195 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725198 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725200 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725203 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725205 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725207 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725210 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725214 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725218 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:30:32.024098 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725221 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725223 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725228 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725231 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725235 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725237 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725240 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725243 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725245 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725248 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725250 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725253 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725258 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725260 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725265 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725270 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725272 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725275 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725278 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:30:32.026342 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725281 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725283 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725286 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725288 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725291 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725293 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725296 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725298 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725301 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725303 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725306 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725308 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725311 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725313 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.725316 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725382 2557 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725389 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725395 2557 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725400 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725403 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725407 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 17:30:32.027160 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725411 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725416 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725419 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725422 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725427 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725430 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725433 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725438 2557 flags.go:64] FLAG: --cgroup-root="" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725441 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725444 2557 flags.go:64] FLAG: --client-ca-file="" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725446 2557 flags.go:64] FLAG: --cloud-provider="external" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725449 2557 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725453 2557 flags.go:64] FLAG: --cluster-domain="" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725456 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725459 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725462 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725466 2557 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725469 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725472 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725475 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725479 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725481 2557 flags.go:64] FLAG: --contention-profiling="false" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725485 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725487 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 17:30:32.028018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725490 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725493 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725497 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725500 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725503 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725506 2557 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725509 2557 flags.go:64] FLAG: --enable-server="true" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725512 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725516 2557 flags.go:64] FLAG: --event-burst="100" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725519 2557 flags.go:64] FLAG: --event-qps="50" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725522 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725525 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725530 2557 flags.go:64] FLAG: --eviction-hard="" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725533 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725536 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725540 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725543 2557 flags.go:64] FLAG: --eviction-soft="" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725547 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725549 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725552 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725555 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725558 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725561 2557 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725564 2557 flags.go:64] FLAG: --feature-gates="" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725568 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 17:30:32.030016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725571 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725574 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725577 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725580 2557 flags.go:64] FLAG: --healthz-port="10248" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725583 2557 flags.go:64] FLAG: --help="false" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725586 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725589 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725592 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725595 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725598 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725602 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725605 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725607 2557 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725610 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725613 2557 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725616 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725620 2557 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725622 2557 flags.go:64] FLAG: --kube-reserved="" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725625 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725629 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725632 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725635 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725639 2557 flags.go:64] FLAG: --lock-file="" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725642 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 17:30:32.030844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725645 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725648 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725654 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725656 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725659 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725662 2557 flags.go:64] FLAG: --logging-format="text" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725665 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725668 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725671 2557 flags.go:64] FLAG: --manifest-url="" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725674 2557 flags.go:64] FLAG: --manifest-url-header="" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725691 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725699 2557 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725703 2557 flags.go:64] FLAG: --max-pods="110" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725707 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725710 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725712 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725715 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725718 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725721 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725724 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725731 2557 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725734 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725737 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 17:30:32.032387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725741 2557 flags.go:64] FLAG: --pod-cidr="" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725744 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725749 2557 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725752 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725755 2557 flags.go:64] FLAG: --pods-per-core="0" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725760 2557 flags.go:64] FLAG: --port="10250" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725762 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725767 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a4d9d41392467485" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725770 2557 flags.go:64] FLAG: --qos-reserved="" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725773 2557 flags.go:64] FLAG: --read-only-port="10255" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725776 2557 flags.go:64] FLAG: --register-node="true" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725779 2557 flags.go:64] FLAG: --register-with-taints="" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725782 2557 flags.go:64] FLAG: --registry-burst="10" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725785 2557 flags.go:64] FLAG: --registry-qps="5" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725788 2557 flags.go:64] FLAG: --reserved-cpus="" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725791 2557 flags.go:64] FLAG: --reserved-memory="" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725795 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725798 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725800 2557 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725803 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725806 2557 flags.go:64] FLAG: --runonce="false" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725809 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725812 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725815 2557 flags.go:64] FLAG: --seccomp-default="false" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725817 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 17:30:32.042948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725820 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725823 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725826 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725829 2557 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725832 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725835 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725837 2557 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725841 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725843 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725846 2557 flags.go:64] FLAG: --system-cgroups="" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725849 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725855 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725859 2557 flags.go:64] FLAG: --tls-cert-file="" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725862 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725867 2557 flags.go:64] FLAG: --tls-min-version="" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725870 2557 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725873 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725876 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725879 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725882 2557 flags.go:64] FLAG: --v="2" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725886 2557 flags.go:64] FLAG: --version="false" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725890 2557 flags.go:64] FLAG: --vmodule="" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725893 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.725896 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726012 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:30:32.045044 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726016 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726019 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726022 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726025 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726028 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726030 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726033 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726036 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726038 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726041 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726043 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726046 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726048 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726051 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726053 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726056 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726058 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726061 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726064 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726068 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:30:32.058027 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726071 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726075 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726077 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726080 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726084 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726087 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726090 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726093 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726096 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726098 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726101 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726103 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726106 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726110 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726113 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726116 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726119 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726121 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726124 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:30:32.058641 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726127 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726129 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726132 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726134 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726137 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726139 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726142 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726144 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726147 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726149 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726152 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726154 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726158 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726161 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726165 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726167 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726170 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726172 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726175 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726177 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:30:32.059275 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726180 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726183 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726185 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726188 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726190 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726193 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726195 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726198 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726200 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726203 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726205 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726208 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726210 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726213 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726215 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726217 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726220 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726223 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726225 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:30:32.059906 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726228 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726230 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726233 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726235 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726238 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726242 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726246 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726251 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726254 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726256 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726259 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726262 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726265 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726268 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726271 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726274 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726276 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726280 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726282 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:30:32.060521 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.726285 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:30:32.061154 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.727013 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 17:30:32.061154 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.739118 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 17:30:32.061154 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.739134 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 17:30:32.061154 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.739157 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 17:30:32.061154 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.739164 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 17:30:32.061154 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739220 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:30:32.061154 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739226 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:30:32.061154 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739231 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:30:32.061154 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739235 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:30:32.061154 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739238 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:30:32.061154 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739241 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:30:32.061154 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739244 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:30:32.061154 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739247 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:30:32.061154 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739251 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739255 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739258 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739261 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739264 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739267 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739270 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739272 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739275 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739278 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739280 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739283 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739285 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739291 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739295 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739298 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739301 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739304 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739307 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739310 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:30:32.061583 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739313 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739317 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739319 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739322 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739325 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739327 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739330 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739332 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739335 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739337 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739340 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739342 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739345 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739348 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739350 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739353 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739355 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739358 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739360 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739363 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:30:32.062170 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739366 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739368 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739371 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739373 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739376 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739381 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739383 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739386 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739389 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739391 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739394 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739396 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739399 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739402 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739405 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739408 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739411 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739413 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739416 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739419 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:30:32.062722 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739421 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739424 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739427 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739429 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739432 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739434 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739437 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739440 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739443 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739445 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739448 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739451 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739454 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739457 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739459 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739461 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739464 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739468 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739472 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739475 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:30:32.063591 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739478 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:30:32.064161 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739480 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:30:32.064161 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739483 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:30:32.064161 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739485 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:30:32.064161 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739488 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:30:32.064161 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739490 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:30:32.064161 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739493 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:30:32.064161 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739495 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:30:32.064161 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739498 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:30:32.064161 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739501 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:30:32.064161 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739503 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:30:32.064161 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.739509 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 17:30:32.064161 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739629 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:30:32.064161 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739634 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:30:32.064161 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739637 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739640 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739643 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739646 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739650 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739654 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739658 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739662 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739665 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739668 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739671 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739690 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739695 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739698 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739701 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739705 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739708 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739712 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739715 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:30:32.064629 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739717 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739720 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739722 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739725 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739728 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739730 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739733 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739736 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739738 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739741 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739743 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739746 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739748 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739751 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739754 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739756 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739758 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739761 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739763 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739766 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:30:32.065197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739768 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739771 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739773 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739776 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739780 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739782 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739785 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739787 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739793 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739796 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739800 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739802 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739805 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739808 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739810 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739813 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739815 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739818 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739820 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739823 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:30:32.065792 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739825 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739828 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739830 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739833 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739835 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739838 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739840 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739843 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739845 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739848 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739850 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739853 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739855 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739859 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739862 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739866 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739868 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739871 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739874 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739876 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:30:32.066322 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739880 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739883 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739887 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739889 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739892 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739894 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739897 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739899 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739902 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739905 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739907 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739910 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739912 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739915 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739918 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739920 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739923 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:30:32.066951 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:31.739925 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:30:32.067406 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.739930 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 17:30:32.067406 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.740048 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 17:30:32.067406 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.742404 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 17:30:32.067406 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.744171 2557 server.go:1019] "Starting client certificate rotation" Jul 17 17:30:32.067406 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.744267 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 17:30:32.067406 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.744302 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 17:30:32.067406 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.747060 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 17:30:32.067406 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.748246 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 17:30:32.067406 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.757639 2557 log.go:25] "Validated CRI v1 runtime API" Jul 17 17:30:32.067406 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.760030 2557 log.go:25] "Validated CRI v1 image API" Jul 17 17:30:32.067406 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.762874 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 17:30:32.067406 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.766263 2557 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7f55013e-1d96-48dd-b43c-37dd9e21b2a6:/dev/nvme0n1p4 d473efc6-ef37-4306-8b92-8db1de0df851:/dev/nvme0n1p3] Jul 17 17:30:32.067810 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.766284 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 17:30:32.067876 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.772469 2557 manager.go:216] Machine: {Timestamp:2026-07-17 17:30:31.772001269 +0000 UTC m=+0.382670641 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099737 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec299e998992afd896f84040b94e2f47 SystemUUID:ec299e99-8992-afd8-96f8-4040b94e2f47 BootID:67d62858-6bd9-484e-9ad8-517c038a8ea6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:06:e1:dd:83:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:06:e1:dd:83:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:02:42:c4:95:98 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 17:30:32.067876 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.772593 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 17:30:32.067876 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.772672 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 17:30:32.067876 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.776399 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 17:30:32.067876 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.776559 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 17:30:32.067876 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.776426 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-245.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 17:30:32.067876 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.777387 2557 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.777400 2557 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.777408 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.777424 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.779358 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.784555 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.784696 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.784726 2557 kubelet.go:486] "Attempting to sync node with API server" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.784740 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.784762 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.784772 2557 kubelet.go:398] "Adding apiserver pod source" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.784783 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.785210 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.785226 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.787482 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.790063 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.790090 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.791506 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.791519 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.791525 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.791531 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.791540 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.791546 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.791554 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.791559 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.791567 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.791572 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.791585 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.791591 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.792446 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.792454 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.795485 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-245.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:31.795531 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:31.795555 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.795822 2557 server.go:1268] "Started kubelet" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.796105 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.796206 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.797082 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.798227 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 17:30:32.068155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.799235 2557 server.go:310] "Adding debug handlers to kubelet server" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:31.802745 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-245.ec2.internal.18c323f97b8ebf1d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-245.ec2.internal,UID:ip-10-0-130-245.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-245.ec2.internal,},FirstTimestamp:2026-07-17 17:30:31.795629853 +0000 UTC m=+0.406299225,LastTimestamp:2026-07-17 17:30:31.795629853 +0000 UTC m=+0.406299225,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-245.ec2.internal,}" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:31.804151 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.808503 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.808510 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:31.808580 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-245.ec2.internal\" not found" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.809234 2557 factory.go:55] Registering systemd factory Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.809254 2557 factory.go:223] Registration of the systemd container factory successfully Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.809299 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.809302 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.809325 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.809447 2557 reconstruct.go:97] "Volume reconstruction finished" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.809466 2557 reconciler.go:29] "Reconciler: start to sync state" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.809548 2557 factory.go:153] Registering CRI-O factory Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.809564 2557 factory.go:223] Registration of the crio container factory successfully Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.809897 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.809934 2557 factory.go:103] Registering Raw factory Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.809952 2557 manager.go:1196] Started watching for new ooms in manager Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.810424 2557 manager.go:349] Starting recovery of all containers Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:31.810928 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:31.811089 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.824221 2557 manager.go:354] Recovery completed Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.824908 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5mzwr" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.829099 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.830221 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5mzwr" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.831241 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.831265 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.831276 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.831872 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.831885 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.831894 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.831902 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 17 17:30:32.069448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.832607 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.832632 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.832646 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.834188 2557 policy_none.go:49] "None policy: Start" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.834207 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.834223 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.836489 2557 policy_none.go:47] "Start" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.870319 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.871406 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.871441 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.871462 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:31.871498 2557 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.873329 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.873342 2557 manager.go:337] "Starting Device Plugin manager" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:31.873380 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.873393 2557 server.go:87] "Starting device plugin registration server" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.873699 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.873710 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.873852 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.873916 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.873924 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:31.874370 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:31.874423 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-245.ec2.internal\" not found" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.971863 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-245.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal"] Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.971950 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.974313 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.975398 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.975425 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.975436 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.975435 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.975587 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.975616 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.975647 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.977816 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.977968 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.977999 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.978717 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.978738 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:30:32.070365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.978750 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.978785 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.978806 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.978818 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.980981 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.981008 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.984520 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:31.984561 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-245.ec2.internal\": node \"ip-10-0-130-245.ec2.internal\" not found" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.985979 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.986015 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:31.986033 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:32.008303 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-245.ec2.internal\" not found" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:32.021751 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-245.ec2.internal\" not found" node="ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:32.030189 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-245.ec2.internal\" not found" node="ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:32.108650 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-245.ec2.internal\" not found" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.110865 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2d08157d5f37b263915c19440df08566-config\") pod \"kube-apiserver-proxy-ip-10-0-130-245.ec2.internal\" (UID: \"2d08157d5f37b263915c19440df08566\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.110897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20e594a88314b0ddf3e6949e6d352f72-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal\" (UID: \"20e594a88314b0ddf3e6949e6d352f72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.110915 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20e594a88314b0ddf3e6949e6d352f72-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal\" (UID: \"20e594a88314b0ddf3e6949e6d352f72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:32.209012 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-245.ec2.internal\" not found" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.211197 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2d08157d5f37b263915c19440df08566-config\") pod \"kube-apiserver-proxy-ip-10-0-130-245.ec2.internal\" (UID: \"2d08157d5f37b263915c19440df08566\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.211222 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20e594a88314b0ddf3e6949e6d352f72-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal\" (UID: \"20e594a88314b0ddf3e6949e6d352f72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.217580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.211238 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20e594a88314b0ddf3e6949e6d352f72-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal\" (UID: \"20e594a88314b0ddf3e6949e6d352f72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.218367 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.211258 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2d08157d5f37b263915c19440df08566-config\") pod \"kube-apiserver-proxy-ip-10-0-130-245.ec2.internal\" (UID: \"2d08157d5f37b263915c19440df08566\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.218367 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.211272 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20e594a88314b0ddf3e6949e6d352f72-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal\" (UID: \"20e594a88314b0ddf3e6949e6d352f72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.218367 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.211323 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20e594a88314b0ddf3e6949e6d352f72-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal\" (UID: \"20e594a88314b0ddf3e6949e6d352f72\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.378907 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:32.309703 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-245.ec2.internal\" not found" Jul 17 17:30:32.378907 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.326044 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.378907 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.334165 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal" Jul 17 17:30:32.553568 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:32.410066 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-245.ec2.internal\" not found" Jul 17 17:30:32.553568 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:32.510468 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-245.ec2.internal\" not found" Jul 17 17:30:32.728808 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:32.610936 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-245.ec2.internal\" not found" Jul 17 17:30:32.728808 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.649437 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:30:32.728808 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:32.711418 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-245.ec2.internal\" not found" Jul 17 17:30:32.871539 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.743802 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 17:30:32.871539 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.743939 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 17:30:32.871539 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.743962 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 17:30:32.871539 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:32.812184 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-245.ec2.internal\" not found" Jul 17 17:30:32.871539 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.836561 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 17:25:32 +0000 UTC" deadline="2028-02-06 01:37:44.79202992 +0000 UTC" Jul 17 17:30:32.871539 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.836596 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13640h7m11.955437289s" Jul 17 17:30:33.002039 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:32.912237 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-245.ec2.internal\" not found" Jul 17 17:30:33.002039 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:32.915899 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:30:33.144418 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:33.012402 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-245.ec2.internal\" not found" Jul 17 17:30:33.144418 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.017288 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:30:33.144418 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.114018 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal" Jul 17 17:30:33.144418 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.129229 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 17:30:33.144418 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.130422 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-245.ec2.internal" Jul 17 17:30:33.144418 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.138842 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 17:30:33.331056 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:33.154950 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e594a88314b0ddf3e6949e6d352f72.slice/crio-c45fe4b533bef984a3376f689585445d69417f01044905ea6b3cab0274f37e8b WatchSource:0}: Error finding container c45fe4b533bef984a3376f689585445d69417f01044905ea6b3cab0274f37e8b: Status 404 returned error can't find the container with id c45fe4b533bef984a3376f689585445d69417f01044905ea6b3cab0274f37e8b Jul 17 17:30:33.331056 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:33.155396 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d08157d5f37b263915c19440df08566.slice/crio-d63ad3c62b21ae694c95845d7504530bbd4d9e7989399754237d14b26a7e1646 WatchSource:0}: Error finding container d63ad3c62b21ae694c95845d7504530bbd4d9e7989399754237d14b26a7e1646: Status 404 returned error can't find the container with id d63ad3c62b21ae694c95845d7504530bbd4d9e7989399754237d14b26a7e1646 Jul 17 17:30:33.331056 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.166497 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 17:30:33.724024 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.580663 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.785860 2557 apiserver.go:52] "Watching apiserver" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.791424 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.791795 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-6bpqj","openshift-network-operator/iptables-alerter-r8947","openshift-ovn-kubernetes/ovnkube-node-tccgv","kube-system/global-pull-secret-syncer-xb5jt","kube-system/konnectivity-agent-d4j6d","kube-system/kube-apiserver-proxy-ip-10-0-130-245.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb","openshift-cluster-node-tuning-operator/tuned-frksq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal","openshift-multus/network-metrics-daemon-v76hr","openshift-network-diagnostics/network-check-target-6xtwg","openshift-dns/node-resolver-lk5gp","openshift-image-registry/node-ca-mpdl4","openshift-multus/multus-5f57h"] Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.798311 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.798648 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mpdl4" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.800597 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.800858 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.800862 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4pt9v\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.801157 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.801198 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.801201 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.802659 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.802800 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4f94m\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.803224 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.803657 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:33.803775 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.804374 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.804545 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.804674 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.804949 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7g7l7\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.804956 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.805124 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.806217 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.806478 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d4j6d" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.808629 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.808953 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 17:30:33.896618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.808963 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.808975 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cllkj\"" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.809008 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.811167 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.811518 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r9rvw\"" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.811843 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.811867 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.811921 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lk5gp" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.811921 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.814075 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dsnk7\"" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.814212 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.814272 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.814290 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.816440 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r8947" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.817157 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.817251 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-df4xv\"" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.817265 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.818659 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59876b7a-57d9-4692-be8d-2a279ee9b885-agent-certs\") pod \"konnectivity-agent-d4j6d\" (UID: \"59876b7a-57d9-4692-be8d-2a279ee9b885\") " pod="kube-system/konnectivity-agent-d4j6d" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.818688 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-cni-bin\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.818715 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-etc-kubernetes\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.818723 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.818740 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.818784 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95be5822-5b78-4e56-aae0-9c8ad4a8ecd7-host\") pod \"node-ca-mpdl4\" (UID: \"95be5822-5b78-4e56-aae0-9c8ad4a8ecd7\") " pod="openshift-image-registry/node-ca-mpdl4" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:33.818808 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:30:33.898593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.818814 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4efbec79-5861-4615-8730-b4941f001ef2-env-overrides\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.818859 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-os-release\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.818882 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.818886 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-cni-netd\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.818919 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-kubelet\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.818943 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-systemd-units\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.818969 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-run-multus-certs\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819003 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-run-k8s-cni-cncf-io\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819023 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-run-netns\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819038 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819045 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b702b8e-c450-4d9c-b339-6d1f30922e66-kubelet-config\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819076 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819101 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19e37a6a-c87e-4fdc-b7e3-a077511a962e-hosts-file\") pod \"node-resolver-lk5gp\" (UID: \"19e37a6a-c87e-4fdc-b7e3-a077511a962e\") " pod="openshift-dns/node-resolver-lk5gp" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819128 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-system-cni-dir\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819176 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-multus-cni-dir\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819199 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-hostroot\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.899741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819206 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cnm8h\"" Jul 17 17:30:33.900804 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819227 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-registration-dir\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.900804 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819250 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9jbz\" (UniqueName: \"kubernetes.io/projected/95be5822-5b78-4e56-aae0-9c8ad4a8ecd7-kube-api-access-p9jbz\") pod \"node-ca-mpdl4\" (UID: \"95be5822-5b78-4e56-aae0-9c8ad4a8ecd7\") " pod="openshift-image-registry/node-ca-mpdl4" Jul 17 17:30:33.900804 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819266 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-etc-openvswitch\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.900804 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819332 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-node-log\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.900804 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819364 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac867d9e-ba94-420f-aca9-f95f6def7fe0-cni-binary-copy\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.900804 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819390 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-var-lib-kubelet\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.900804 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819418 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9rh6\" (UniqueName: \"kubernetes.io/projected/a4be4e35-28f5-440b-8820-64fec4fa4ad0-kube-api-access-j9rh6\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.900804 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819448 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-run-openvswitch\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.900804 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819472 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-run-ovn-kubernetes\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.900804 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819517 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.900804 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819548 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cddfk\" (UniqueName: \"kubernetes.io/projected/4efbec79-5861-4615-8730-b4941f001ef2-kube-api-access-cddfk\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.900804 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819573 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.900804 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819597 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-etc-selinux\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.901587 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819631 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-run-ovn\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.901587 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819651 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsd88\" (UniqueName: \"kubernetes.io/projected/ac867d9e-ba94-420f-aca9-f95f6def7fe0-kube-api-access-vsd88\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.901587 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819668 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-run-netns\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.901587 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819700 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-run-systemd\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.901587 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819720 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-log-socket\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.901587 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819735 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-cnibin\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.901587 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819749 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d6gj\" (UniqueName: \"kubernetes.io/projected/19e37a6a-c87e-4fdc-b7e3-a077511a962e-kube-api-access-4d6gj\") pod \"node-resolver-lk5gp\" (UID: \"19e37a6a-c87e-4fdc-b7e3-a077511a962e\") " pod="openshift-dns/node-resolver-lk5gp" Jul 17 17:30:33.901587 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819765 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4efbec79-5861-4615-8730-b4941f001ef2-ovnkube-script-lib\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.901587 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819844 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-device-dir\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.901587 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819888 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-sys-fs\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.901587 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819903 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-slash\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.901587 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819925 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-var-lib-openvswitch\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.901587 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819951 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-var-lib-cni-multus\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.901587 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819967 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-multus-conf-dir\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.819982 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4efbec79-5861-4615-8730-b4941f001ef2-ovnkube-config\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.820027 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4efbec79-5861-4615-8730-b4941f001ef2-ovn-node-metrics-cert\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.820048 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-multus-socket-dir-parent\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.820072 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-socket-dir\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.820091 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95be5822-5b78-4e56-aae0-9c8ad4a8ecd7-serviceca\") pod \"node-ca-mpdl4\" (UID: \"95be5822-5b78-4e56-aae0-9c8ad4a8ecd7\") " pod="openshift-image-registry/node-ca-mpdl4" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.820106 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b702b8e-c450-4d9c-b339-6d1f30922e66-dbus\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.820125 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59876b7a-57d9-4692-be8d-2a279ee9b885-konnectivity-ca\") pod \"konnectivity-agent-d4j6d\" (UID: \"59876b7a-57d9-4692-be8d-2a279ee9b885\") " pod="kube-system/konnectivity-agent-d4j6d" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.820149 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-var-lib-cni-bin\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.820175 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac867d9e-ba94-420f-aca9-f95f6def7fe0-multus-daemon-config\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.820222 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19e37a6a-c87e-4fdc-b7e3-a077511a962e-tmp-dir\") pod \"node-resolver-lk5gp\" (UID: \"19e37a6a-c87e-4fdc-b7e3-a077511a962e\") " pod="openshift-dns/node-resolver-lk5gp" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.821305 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:33.821370 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.821741 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.823736 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.825910 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.826110 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 17:30:33.902446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.826199 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xw4dz\"" Jul 17 17:30:33.903458 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.864695 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6wr2l" Jul 17 17:30:33.903458 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.875195 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6wr2l" Jul 17 17:30:33.903458 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.877288 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-245.ec2.internal" event={"ID":"2d08157d5f37b263915c19440df08566","Type":"ContainerStarted","Data":"d63ad3c62b21ae694c95845d7504530bbd4d9e7989399754237d14b26a7e1646"} Jul 17 17:30:33.903458 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.878838 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal" event={"ID":"20e594a88314b0ddf3e6949e6d352f72","Type":"ContainerStarted","Data":"c45fe4b533bef984a3376f689585445d69417f01044905ea6b3cab0274f37e8b"} Jul 17 17:30:33.910940 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.910912 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 17:30:33.920832 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.920666 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-kubelet\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.920832 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.920723 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-systemd-units\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.920832 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.920750 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-run-multus-certs\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.920832 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.920781 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b87ed784-588a-4ce5-b2c0-1c17e62d34cb-iptables-alerter-script\") pod \"iptables-alerter-r8947\" (UID: \"b87ed784-588a-4ce5-b2c0-1c17e62d34cb\") " pod="openshift-network-operator/iptables-alerter-r8947" Jul 17 17:30:33.920832 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.920786 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-kubelet\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.920832 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.920809 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:33.920832 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.920834 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-systemd\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:33.921467 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.920855 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-systemd-units\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.921467 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.920862 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-run-k8s-cni-cncf-io\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.921467 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.920910 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-run-multus-certs\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.921467 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.920889 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-run-netns\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.921467 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.920963 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-run\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:33.921467 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.920970 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-run-netns\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.921467 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921002 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b702b8e-c450-4d9c-b339-6d1f30922e66-kubelet-config\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:33.921467 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921012 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-run-k8s-cni-cncf-io\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.921467 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921050 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:33.921467 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921077 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19e37a6a-c87e-4fdc-b7e3-a077511a962e-hosts-file\") pod \"node-resolver-lk5gp\" (UID: \"19e37a6a-c87e-4fdc-b7e3-a077511a962e\") " pod="openshift-dns/node-resolver-lk5gp" Jul 17 17:30:33.921467 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921158 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b702b8e-c450-4d9c-b339-6d1f30922e66-kubelet-config\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:33.921467 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921174 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-system-cni-dir\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.921467 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921177 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19e37a6a-c87e-4fdc-b7e3-a077511a962e-hosts-file\") pod \"node-resolver-lk5gp\" (UID: \"19e37a6a-c87e-4fdc-b7e3-a077511a962e\") " pod="openshift-dns/node-resolver-lk5gp" Jul 17 17:30:33.921467 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:33.921191 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:30:33.921467 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921229 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-multus-cni-dir\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.922291 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921241 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-system-cni-dir\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.922291 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:33.921278 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret podName:6b702b8e-c450-4d9c-b339-6d1f30922e66 nodeName:}" failed. No retries permitted until 2026-07-17 17:30:34.421235212 +0000 UTC m=+3.031904596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret") pod "global-pull-secret-syncer-xb5jt" (UID: "6b702b8e-c450-4d9c-b339-6d1f30922e66") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:30:33.922291 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921375 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6926\" (UniqueName: \"kubernetes.io/projected/082d287c-1c8d-4d2f-adb5-82d542c434b8-kube-api-access-w6926\") pod \"network-metrics-daemon-v76hr\" (UID: \"082d287c-1c8d-4d2f-adb5-82d542c434b8\") " pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:33.922291 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921410 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-system-cni-dir\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:33.922291 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921434 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-sys\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:33.922291 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921463 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-hostroot\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.922291 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921475 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-multus-cni-dir\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.922291 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921491 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-registration-dir\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.922291 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921520 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9jbz\" (UniqueName: \"kubernetes.io/projected/95be5822-5b78-4e56-aae0-9c8ad4a8ecd7-kube-api-access-p9jbz\") pod \"node-ca-mpdl4\" (UID: \"95be5822-5b78-4e56-aae0-9c8ad4a8ecd7\") " pod="openshift-image-registry/node-ca-mpdl4" Jul 17 17:30:33.922291 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921529 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-hostroot\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.922291 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921547 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-etc-openvswitch\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.922291 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921572 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-node-log\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.922291 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921587 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-registration-dir\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.922291 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921596 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac867d9e-ba94-420f-aca9-f95f6def7fe0-cni-binary-copy\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.923002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921649 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-etc-openvswitch\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.923002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921662 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-var-lib-kubelet\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.923002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921667 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-node-log\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.923002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921689 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9rh6\" (UniqueName: \"kubernetes.io/projected/a4be4e35-28f5-440b-8820-64fec4fa4ad0-kube-api-access-j9rh6\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.923002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921730 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-run-openvswitch\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.923002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921739 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-var-lib-kubelet\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.923002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921756 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-run-ovn-kubernetes\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.923002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921782 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.923002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921909 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.923002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921870 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-run-ovn-kubernetes\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.923002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921928 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cddfk\" (UniqueName: \"kubernetes.io/projected/4efbec79-5861-4615-8730-b4941f001ef2-kube-api-access-cddfk\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.923002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921835 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-run-openvswitch\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.923002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921955 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.923002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.921981 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-etc-selinux\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.923628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922005 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b87ed784-588a-4ce5-b2c0-1c17e62d34cb-host-slash\") pod \"iptables-alerter-r8947\" (UID: \"b87ed784-588a-4ce5-b2c0-1c17e62d34cb\") " pod="openshift-network-operator/iptables-alerter-r8947" Jul 17 17:30:33.923628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922028 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-run-ovn\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.923628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922054 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsd88\" (UniqueName: \"kubernetes.io/projected/ac867d9e-ba94-420f-aca9-f95f6def7fe0-kube-api-access-vsd88\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.923628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922081 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-cnibin\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:33.923628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922106 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-sysconfig\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:33.923628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922128 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-kubernetes\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:33.923628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922149 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.923628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922171 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-sysctl-conf\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:33.923628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922206 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-lib-modules\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:33.923628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922215 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-run-ovn\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.923628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922232 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-run-netns\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.923628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922258 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-run-systemd\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.923628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922259 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-etc-selinux\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.923628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922301 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-run-netns\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.924249 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922304 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-run-systemd\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.924249 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922321 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-log-socket\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.924249 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922372 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-cnibin\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.924249 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922319 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac867d9e-ba94-420f-aca9-f95f6def7fe0-cni-binary-copy\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.924249 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922394 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-log-socket\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.924249 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922444 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-cnibin\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.924249 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922444 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d6gj\" (UniqueName: \"kubernetes.io/projected/19e37a6a-c87e-4fdc-b7e3-a077511a962e-kube-api-access-4d6gj\") pod \"node-resolver-lk5gp\" (UID: \"19e37a6a-c87e-4fdc-b7e3-a077511a962e\") " pod="openshift-dns/node-resolver-lk5gp" Jul 17 17:30:33.924249 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922564 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9c8v\" (UniqueName: \"kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v\") pod \"network-check-target-6xtwg\" (UID: \"db938228-2485-4dc7-9a83-d5af8652ad4d\") " pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:33.924249 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922594 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-host\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:33.924249 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922620 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-tuned\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:33.924249 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922648 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4efbec79-5861-4615-8730-b4941f001ef2-ovnkube-script-lib\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.924249 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922674 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-device-dir\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.924249 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922724 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-sys-fs\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.924249 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922752 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k82z\" (UniqueName: \"kubernetes.io/projected/f5c908e1-54ef-490c-b596-3b158896ae0f-kube-api-access-4k82z\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:33.924863 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922778 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-slash\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.924863 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922798 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-device-dir\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.924863 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922805 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-var-lib-openvswitch\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.924863 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922834 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-var-lib-cni-multus\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.924863 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922857 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-multus-conf-dir\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.924863 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922877 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-sys-fs\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.924863 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922884 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:33.924863 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922926 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-var-lib-openvswitch\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.924863 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922941 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-var-lib-cni-multus\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.924863 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922956 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4efbec79-5861-4615-8730-b4941f001ef2-ovnkube-config\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.924863 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922984 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4efbec79-5861-4615-8730-b4941f001ef2-ovn-node-metrics-cert\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.924863 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.922987 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-multus-conf-dir\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.924863 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923015 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-multus-socket-dir-parent\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.924863 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923041 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-socket-dir\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.925522 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923082 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-os-release\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:33.925522 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923083 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-slash\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.925522 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923153 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:33.925522 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923188 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4zr5\" (UniqueName: \"kubernetes.io/projected/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-kube-api-access-k4zr5\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:33.925522 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923216 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4be4e35-28f5-440b-8820-64fec4fa4ad0-socket-dir\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.925522 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923218 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-var-lib-kubelet\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:33.925522 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923251 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95be5822-5b78-4e56-aae0-9c8ad4a8ecd7-serviceca\") pod \"node-ca-mpdl4\" (UID: \"95be5822-5b78-4e56-aae0-9c8ad4a8ecd7\") " pod="openshift-image-registry/node-ca-mpdl4" Jul 17 17:30:33.925522 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923276 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b702b8e-c450-4d9c-b339-6d1f30922e66-dbus\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:33.925522 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923279 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-multus-socket-dir-parent\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.925522 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923321 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59876b7a-57d9-4692-be8d-2a279ee9b885-konnectivity-ca\") pod \"konnectivity-agent-d4j6d\" (UID: \"59876b7a-57d9-4692-be8d-2a279ee9b885\") " pod="kube-system/konnectivity-agent-d4j6d" Jul 17 17:30:33.925522 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923335 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4efbec79-5861-4615-8730-b4941f001ef2-ovnkube-script-lib\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.925522 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923346 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-var-lib-cni-bin\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.925522 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923408 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-host-var-lib-cni-bin\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.925522 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923471 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b702b8e-c450-4d9c-b339-6d1f30922e66-dbus\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:33.926156 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923614 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 17:30:33.926156 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924225 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac867d9e-ba94-420f-aca9-f95f6def7fe0-multus-daemon-config\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.926156 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923801 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac867d9e-ba94-420f-aca9-f95f6def7fe0-multus-daemon-config\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.926156 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.923777 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95be5822-5b78-4e56-aae0-9c8ad4a8ecd7-serviceca\") pod \"node-ca-mpdl4\" (UID: \"95be5822-5b78-4e56-aae0-9c8ad4a8ecd7\") " pod="openshift-image-registry/node-ca-mpdl4" Jul 17 17:30:33.926156 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924286 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19e37a6a-c87e-4fdc-b7e3-a077511a962e-tmp-dir\") pod \"node-resolver-lk5gp\" (UID: \"19e37a6a-c87e-4fdc-b7e3-a077511a962e\") " pod="openshift-dns/node-resolver-lk5gp" Jul 17 17:30:33.926156 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924182 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4efbec79-5861-4615-8730-b4941f001ef2-ovnkube-config\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.926156 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924114 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59876b7a-57d9-4692-be8d-2a279ee9b885-konnectivity-ca\") pod \"konnectivity-agent-d4j6d\" (UID: \"59876b7a-57d9-4692-be8d-2a279ee9b885\") " pod="kube-system/konnectivity-agent-d4j6d" Jul 17 17:30:33.926156 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924309 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-sysctl-d\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:33.926156 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924351 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59876b7a-57d9-4692-be8d-2a279ee9b885-agent-certs\") pod \"konnectivity-agent-d4j6d\" (UID: \"59876b7a-57d9-4692-be8d-2a279ee9b885\") " pod="kube-system/konnectivity-agent-d4j6d" Jul 17 17:30:33.926156 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924381 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-cni-bin\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.926156 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924406 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-etc-kubernetes\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.926156 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924436 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l84r\" (UniqueName: \"kubernetes.io/projected/b87ed784-588a-4ce5-b2c0-1c17e62d34cb-kube-api-access-7l84r\") pod \"iptables-alerter-r8947\" (UID: \"b87ed784-588a-4ce5-b2c0-1c17e62d34cb\") " pod="openshift-network-operator/iptables-alerter-r8947" Jul 17 17:30:33.926156 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924467 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5c908e1-54ef-490c-b596-3b158896ae0f-tmp\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:33.926156 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924473 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-etc-kubernetes\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.926156 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924439 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-cni-bin\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.926861 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924492 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95be5822-5b78-4e56-aae0-9c8ad4a8ecd7-host\") pod \"node-ca-mpdl4\" (UID: \"95be5822-5b78-4e56-aae0-9c8ad4a8ecd7\") " pod="openshift-image-registry/node-ca-mpdl4" Jul 17 17:30:33.926861 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924532 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4efbec79-5861-4615-8730-b4941f001ef2-env-overrides\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.926861 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924535 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95be5822-5b78-4e56-aae0-9c8ad4a8ecd7-host\") pod \"node-ca-mpdl4\" (UID: \"95be5822-5b78-4e56-aae0-9c8ad4a8ecd7\") " pod="openshift-image-registry/node-ca-mpdl4" Jul 17 17:30:33.926861 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924558 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-os-release\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.926861 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924588 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs\") pod \"network-metrics-daemon-v76hr\" (UID: \"082d287c-1c8d-4d2f-adb5-82d542c434b8\") " pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:33.926861 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924615 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:33.926861 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924639 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-modprobe-d\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:33.926861 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924650 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19e37a6a-c87e-4fdc-b7e3-a077511a962e-tmp-dir\") pod \"node-resolver-lk5gp\" (UID: \"19e37a6a-c87e-4fdc-b7e3-a077511a962e\") " pod="openshift-dns/node-resolver-lk5gp" Jul 17 17:30:33.926861 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924667 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-cni-netd\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.926861 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924704 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac867d9e-ba94-420f-aca9-f95f6def7fe0-os-release\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.926861 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924769 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4efbec79-5861-4615-8730-b4941f001ef2-host-cni-netd\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.926861 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.924943 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4efbec79-5861-4615-8730-b4941f001ef2-env-overrides\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.928396 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.928369 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4efbec79-5861-4615-8730-b4941f001ef2-ovn-node-metrics-cert\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.928523 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.928503 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59876b7a-57d9-4692-be8d-2a279ee9b885-agent-certs\") pod \"konnectivity-agent-d4j6d\" (UID: \"59876b7a-57d9-4692-be8d-2a279ee9b885\") " pod="kube-system/konnectivity-agent-d4j6d" Jul 17 17:30:33.932137 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.932110 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9jbz\" (UniqueName: \"kubernetes.io/projected/95be5822-5b78-4e56-aae0-9c8ad4a8ecd7-kube-api-access-p9jbz\") pod \"node-ca-mpdl4\" (UID: \"95be5822-5b78-4e56-aae0-9c8ad4a8ecd7\") " pod="openshift-image-registry/node-ca-mpdl4" Jul 17 17:30:33.932874 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.932850 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cddfk\" (UniqueName: \"kubernetes.io/projected/4efbec79-5861-4615-8730-b4941f001ef2-kube-api-access-cddfk\") pod \"ovnkube-node-tccgv\" (UID: \"4efbec79-5861-4615-8730-b4941f001ef2\") " pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:33.933839 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.933817 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsd88\" (UniqueName: \"kubernetes.io/projected/ac867d9e-ba94-420f-aca9-f95f6def7fe0-kube-api-access-vsd88\") pod \"multus-5f57h\" (UID: \"ac867d9e-ba94-420f-aca9-f95f6def7fe0\") " pod="openshift-multus/multus-5f57h" Jul 17 17:30:33.933950 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.933899 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9rh6\" (UniqueName: \"kubernetes.io/projected/a4be4e35-28f5-440b-8820-64fec4fa4ad0-kube-api-access-j9rh6\") pod \"aws-ebs-csi-driver-node-jgzzb\" (UID: \"a4be4e35-28f5-440b-8820-64fec4fa4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:33.934320 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:33.934299 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d6gj\" (UniqueName: \"kubernetes.io/projected/19e37a6a-c87e-4fdc-b7e3-a077511a962e-kube-api-access-4d6gj\") pod \"node-resolver-lk5gp\" (UID: \"19e37a6a-c87e-4fdc-b7e3-a077511a962e\") " pod="openshift-dns/node-resolver-lk5gp" Jul 17 17:30:34.025186 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025100 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b87ed784-588a-4ce5-b2c0-1c17e62d34cb-host-slash\") pod \"iptables-alerter-r8947\" (UID: \"b87ed784-588a-4ce5-b2c0-1c17e62d34cb\") " pod="openshift-network-operator/iptables-alerter-r8947" Jul 17 17:30:34.025186 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025146 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-cnibin\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.025186 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025176 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-sysconfig\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026081 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025203 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-kubernetes\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026081 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025228 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-sysctl-conf\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026081 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025238 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b87ed784-588a-4ce5-b2c0-1c17e62d34cb-host-slash\") pod \"iptables-alerter-r8947\" (UID: \"b87ed784-588a-4ce5-b2c0-1c17e62d34cb\") " pod="openshift-network-operator/iptables-alerter-r8947" Jul 17 17:30:34.026081 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025251 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-cnibin\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.026081 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025256 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-lib-modules\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026081 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025306 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-sysconfig\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026081 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025314 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9c8v\" (UniqueName: \"kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v\") pod \"network-check-target-6xtwg\" (UID: \"db938228-2485-4dc7-9a83-d5af8652ad4d\") " pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:34.026081 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025338 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-host\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026081 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025350 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-kubernetes\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026081 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025359 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-tuned\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026081 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025374 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-lib-modules\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026081 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025386 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k82z\" (UniqueName: \"kubernetes.io/projected/f5c908e1-54ef-490c-b596-3b158896ae0f-kube-api-access-4k82z\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026081 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025416 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.026081 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025446 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-os-release\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.026852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025455 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-host\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025474 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-sysctl-conf\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025477 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.026852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025533 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-os-release\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.026852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025566 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4zr5\" (UniqueName: \"kubernetes.io/projected/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-kube-api-access-k4zr5\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.026852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025596 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-var-lib-kubelet\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025627 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-sysctl-d\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025658 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l84r\" (UniqueName: \"kubernetes.io/projected/b87ed784-588a-4ce5-b2c0-1c17e62d34cb-kube-api-access-7l84r\") pod \"iptables-alerter-r8947\" (UID: \"b87ed784-588a-4ce5-b2c0-1c17e62d34cb\") " pod="openshift-network-operator/iptables-alerter-r8947" Jul 17 17:30:34.026852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025683 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5c908e1-54ef-490c-b596-3b158896ae0f-tmp\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025742 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-var-lib-kubelet\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025784 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs\") pod \"network-metrics-daemon-v76hr\" (UID: \"082d287c-1c8d-4d2f-adb5-82d542c434b8\") " pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:34.026852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025812 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-sysctl-d\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.026852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025815 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.026852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025843 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-modprobe-d\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.027532 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025875 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b87ed784-588a-4ce5-b2c0-1c17e62d34cb-iptables-alerter-script\") pod \"iptables-alerter-r8947\" (UID: \"b87ed784-588a-4ce5-b2c0-1c17e62d34cb\") " pod="openshift-network-operator/iptables-alerter-r8947" Jul 17 17:30:34.027532 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:34.025898 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:30:34.027532 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025901 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.027532 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025927 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-systemd\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.027532 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:34.025956 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs podName:082d287c-1c8d-4d2f-adb5-82d542c434b8 nodeName:}" failed. No retries permitted until 2026-07-17 17:30:34.525934173 +0000 UTC m=+3.136603535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs") pod "network-metrics-daemon-v76hr" (UID: "082d287c-1c8d-4d2f-adb5-82d542c434b8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:30:34.027532 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.025984 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-run\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.027532 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.026044 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6926\" (UniqueName: \"kubernetes.io/projected/082d287c-1c8d-4d2f-adb5-82d542c434b8-kube-api-access-w6926\") pod \"network-metrics-daemon-v76hr\" (UID: \"082d287c-1c8d-4d2f-adb5-82d542c434b8\") " pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:34.027532 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.026072 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-system-cni-dir\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.027532 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.026095 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-sys\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.030133 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.030100 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-sys\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.030667 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.030460 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.030667 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.030548 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.030667 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.030594 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.033096 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.031683 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5c908e1-54ef-490c-b596-3b158896ae0f-tmp\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.033096 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.031851 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-modprobe-d\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.033096 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.032123 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b87ed784-588a-4ce5-b2c0-1c17e62d34cb-iptables-alerter-script\") pod \"iptables-alerter-r8947\" (UID: \"b87ed784-588a-4ce5-b2c0-1c17e62d34cb\") " pod="openshift-network-operator/iptables-alerter-r8947" Jul 17 17:30:34.033351 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.033107 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-run\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.033469 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.033416 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-system-cni-dir\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.033564 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.033541 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-systemd\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.033671 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.030054 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f5c908e1-54ef-490c-b596-3b158896ae0f-etc-tuned\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.033739 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.033663 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.037889 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:34.037119 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:30:34.037889 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:34.037142 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:30:34.037889 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:34.037157 2557 projected.go:196] Error preparing data for projected volume kube-api-access-l9c8v for pod openshift-network-diagnostics/network-check-target-6xtwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:30:34.037889 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:34.037217 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v podName:db938228-2485-4dc7-9a83-d5af8652ad4d nodeName:}" failed. No retries permitted until 2026-07-17 17:30:34.537198253 +0000 UTC m=+3.147867618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l9c8v" (UniqueName: "kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v") pod "network-check-target-6xtwg" (UID: "db938228-2485-4dc7-9a83-d5af8652ad4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:30:34.038166 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.037954 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l84r\" (UniqueName: \"kubernetes.io/projected/b87ed784-588a-4ce5-b2c0-1c17e62d34cb-kube-api-access-7l84r\") pod \"iptables-alerter-r8947\" (UID: \"b87ed784-588a-4ce5-b2c0-1c17e62d34cb\") " pod="openshift-network-operator/iptables-alerter-r8947" Jul 17 17:30:34.039690 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.039664 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k82z\" (UniqueName: \"kubernetes.io/projected/f5c908e1-54ef-490c-b596-3b158896ae0f-kube-api-access-4k82z\") pod \"tuned-frksq\" (UID: \"f5c908e1-54ef-490c-b596-3b158896ae0f\") " pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.042150 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.042109 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4zr5\" (UniqueName: \"kubernetes.io/projected/6ce16731-5297-45af-9b0e-9aaf4a8dedb4-kube-api-access-k4zr5\") pod \"multus-additional-cni-plugins-6bpqj\" (UID: \"6ce16731-5297-45af-9b0e-9aaf4a8dedb4\") " pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.044944 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.044897 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6926\" (UniqueName: \"kubernetes.io/projected/082d287c-1c8d-4d2f-adb5-82d542c434b8-kube-api-access-w6926\") pod \"network-metrics-daemon-v76hr\" (UID: \"082d287c-1c8d-4d2f-adb5-82d542c434b8\") " pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:34.110012 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.109976 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" Jul 17 17:30:34.123119 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.123096 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mpdl4" Jul 17 17:30:34.127545 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:34.125746 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4be4e35_28f5_440b_8820_64fec4fa4ad0.slice/crio-46ef602bc552ec1c53e33b127c49c1f67de9d90d3951aa6a52c716d6a5969b28 WatchSource:0}: Error finding container 46ef602bc552ec1c53e33b127c49c1f67de9d90d3951aa6a52c716d6a5969b28: Status 404 returned error can't find the container with id 46ef602bc552ec1c53e33b127c49c1f67de9d90d3951aa6a52c716d6a5969b28 Jul 17 17:30:34.136963 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.135791 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:30:34.137340 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:34.137225 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95be5822_5b78_4e56_aae0_9c8ad4a8ecd7.slice/crio-e9cbd9c97704af9d7c6efc868a8f4421229dd1df28199ade845e4b45825997e6 WatchSource:0}: Error finding container e9cbd9c97704af9d7c6efc868a8f4421229dd1df28199ade845e4b45825997e6: Status 404 returned error can't find the container with id e9cbd9c97704af9d7c6efc868a8f4421229dd1df28199ade845e4b45825997e6 Jul 17 17:30:34.139305 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.138681 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d4j6d" Jul 17 17:30:34.145340 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.145197 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5f57h" Jul 17 17:30:34.147448 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:34.147424 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4efbec79_5861_4615_8730_b4941f001ef2.slice/crio-a36ab11208052db91470738eaaae51c8cf2c71a7b176e6a0b048d1df3881e394 WatchSource:0}: Error finding container a36ab11208052db91470738eaaae51c8cf2c71a7b176e6a0b048d1df3881e394: Status 404 returned error can't find the container with id a36ab11208052db91470738eaaae51c8cf2c71a7b176e6a0b048d1df3881e394 Jul 17 17:30:34.149946 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:34.149925 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59876b7a_57d9_4692_be8d_2a279ee9b885.slice/crio-e2e9bf0cb9a3cc92f084d3858e0945db89a4cac03d8955d7ea53fd51735509bf WatchSource:0}: Error finding container e2e9bf0cb9a3cc92f084d3858e0945db89a4cac03d8955d7ea53fd51735509bf: Status 404 returned error can't find the container with id e2e9bf0cb9a3cc92f084d3858e0945db89a4cac03d8955d7ea53fd51735509bf Jul 17 17:30:34.151201 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.151030 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lk5gp" Jul 17 17:30:34.156862 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.156840 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6bpqj" Jul 17 17:30:34.163481 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:34.163461 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac867d9e_ba94_420f_aca9_f95f6def7fe0.slice/crio-77020900283f753df62fd4daecd89372e4f05fb0b628d461bee429c18664ebd6 WatchSource:0}: Error finding container 77020900283f753df62fd4daecd89372e4f05fb0b628d461bee429c18664ebd6: Status 404 returned error can't find the container with id 77020900283f753df62fd4daecd89372e4f05fb0b628d461bee429c18664ebd6 Jul 17 17:30:34.164941 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.164909 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r8947" Jul 17 17:30:34.169802 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.169674 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-frksq" Jul 17 17:30:34.179162 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:34.179128 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87ed784_588a_4ce5_b2c0_1c17e62d34cb.slice/crio-503a6d92a0ada10fc802bb785e3d9392ae8948e79dd1daf8171f17a30b93b0a6 WatchSource:0}: Error finding container 503a6d92a0ada10fc802bb785e3d9392ae8948e79dd1daf8171f17a30b93b0a6: Status 404 returned error can't find the container with id 503a6d92a0ada10fc802bb785e3d9392ae8948e79dd1daf8171f17a30b93b0a6 Jul 17 17:30:34.181047 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:34.180997 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce16731_5297_45af_9b0e_9aaf4a8dedb4.slice/crio-1c26fdd8ddee8231152808ee649a9104f812d859a089774be603cdac7a6ca92f WatchSource:0}: Error finding container 1c26fdd8ddee8231152808ee649a9104f812d859a089774be603cdac7a6ca92f: Status 404 returned error can't find the container with id 1c26fdd8ddee8231152808ee649a9104f812d859a089774be603cdac7a6ca92f Jul 17 17:30:34.185197 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:30:34.185136 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c908e1_54ef_490c_b596_3b158896ae0f.slice/crio-46b81142aaee64bd485eb1d2306835b9ff50a172a4462e53a235837011800a8e WatchSource:0}: Error finding container 46b81142aaee64bd485eb1d2306835b9ff50a172a4462e53a235837011800a8e: Status 404 returned error can't find the container with id 46b81142aaee64bd485eb1d2306835b9ff50a172a4462e53a235837011800a8e Jul 17 17:30:34.428718 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.428624 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:34.428889 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:34.428806 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:30:34.428889 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:34.428881 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret podName:6b702b8e-c450-4d9c-b339-6d1f30922e66 nodeName:}" failed. No retries permitted until 2026-07-17 17:30:35.428862606 +0000 UTC m=+4.039531968 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret") pod "global-pull-secret-syncer-xb5jt" (UID: "6b702b8e-c450-4d9c-b339-6d1f30922e66") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:30:34.529837 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.529793 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs\") pod \"network-metrics-daemon-v76hr\" (UID: \"082d287c-1c8d-4d2f-adb5-82d542c434b8\") " pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:34.530040 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:34.530019 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:30:34.530120 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:34.530094 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs podName:082d287c-1c8d-4d2f-adb5-82d542c434b8 nodeName:}" failed. No retries permitted until 2026-07-17 17:30:35.53007534 +0000 UTC m=+4.140744707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs") pod "network-metrics-daemon-v76hr" (UID: "082d287c-1c8d-4d2f-adb5-82d542c434b8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:30:34.631090 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.631047 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9c8v\" (UniqueName: \"kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v\") pod \"network-check-target-6xtwg\" (UID: \"db938228-2485-4dc7-9a83-d5af8652ad4d\") " pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:34.631257 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:34.631206 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:30:34.631257 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:34.631239 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:30:34.631257 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:34.631253 2557 projected.go:196] Error preparing data for projected volume kube-api-access-l9c8v for pod openshift-network-diagnostics/network-check-target-6xtwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:30:34.631406 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:34.631317 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v podName:db938228-2485-4dc7-9a83-d5af8652ad4d nodeName:}" failed. No retries permitted until 2026-07-17 17:30:35.631296946 +0000 UTC m=+4.241966314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9c8v" (UniqueName: "kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v") pod "network-check-target-6xtwg" (UID: "db938228-2485-4dc7-9a83-d5af8652ad4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:30:34.879715 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.879603 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 17:25:34 +0000 UTC" deadline="2028-03-07 00:58:33.766642928 +0000 UTC" Jul 17 17:30:34.879715 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.879641 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14359h27m58.88700664s" Jul 17 17:30:34.882482 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.882444 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bpqj" event={"ID":"6ce16731-5297-45af-9b0e-9aaf4a8dedb4","Type":"ContainerStarted","Data":"1c26fdd8ddee8231152808ee649a9104f812d859a089774be603cdac7a6ca92f"} Jul 17 17:30:34.883874 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.883798 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lk5gp" event={"ID":"19e37a6a-c87e-4fdc-b7e3-a077511a962e","Type":"ContainerStarted","Data":"ab7cf9eafc7a7a00129abab20419a3288210680990907fd8c027d6cc82b6e387"} Jul 17 17:30:34.885296 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.885257 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mpdl4" event={"ID":"95be5822-5b78-4e56-aae0-9c8ad4a8ecd7","Type":"ContainerStarted","Data":"e9cbd9c97704af9d7c6efc868a8f4421229dd1df28199ade845e4b45825997e6"} Jul 17 17:30:34.886520 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.886493 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-frksq" event={"ID":"f5c908e1-54ef-490c-b596-3b158896ae0f","Type":"ContainerStarted","Data":"46b81142aaee64bd485eb1d2306835b9ff50a172a4462e53a235837011800a8e"} Jul 17 17:30:34.889104 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.889067 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r8947" event={"ID":"b87ed784-588a-4ce5-b2c0-1c17e62d34cb","Type":"ContainerStarted","Data":"503a6d92a0ada10fc802bb785e3d9392ae8948e79dd1daf8171f17a30b93b0a6"} Jul 17 17:30:34.891146 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.891116 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5f57h" event={"ID":"ac867d9e-ba94-420f-aca9-f95f6def7fe0","Type":"ContainerStarted","Data":"77020900283f753df62fd4daecd89372e4f05fb0b628d461bee429c18664ebd6"} Jul 17 17:30:34.893086 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.893053 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d4j6d" event={"ID":"59876b7a-57d9-4692-be8d-2a279ee9b885","Type":"ContainerStarted","Data":"e2e9bf0cb9a3cc92f084d3858e0945db89a4cac03d8955d7ea53fd51735509bf"} Jul 17 17:30:34.894432 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.894406 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" event={"ID":"4efbec79-5861-4615-8730-b4941f001ef2","Type":"ContainerStarted","Data":"a36ab11208052db91470738eaaae51c8cf2c71a7b176e6a0b048d1df3881e394"} Jul 17 17:30:34.896145 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.896123 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" event={"ID":"a4be4e35-28f5-440b-8820-64fec4fa4ad0","Type":"ContainerStarted","Data":"46ef602bc552ec1c53e33b127c49c1f67de9d90d3951aa6a52c716d6a5969b28"} Jul 17 17:30:34.918049 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:34.918023 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:30:35.437537 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:35.437492 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:35.438291 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:35.437693 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:30:35.438291 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:35.437781 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret podName:6b702b8e-c450-4d9c-b339-6d1f30922e66 nodeName:}" failed. No retries permitted until 2026-07-17 17:30:37.437759144 +0000 UTC m=+6.048428506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret") pod "global-pull-secret-syncer-xb5jt" (UID: "6b702b8e-c450-4d9c-b339-6d1f30922e66") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:30:35.538728 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:35.538675 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs\") pod \"network-metrics-daemon-v76hr\" (UID: \"082d287c-1c8d-4d2f-adb5-82d542c434b8\") " pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:35.538946 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:35.538879 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:30:35.539034 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:35.538952 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs podName:082d287c-1c8d-4d2f-adb5-82d542c434b8 nodeName:}" failed. No retries permitted until 2026-07-17 17:30:37.538928943 +0000 UTC m=+6.149598306 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs") pod "network-metrics-daemon-v76hr" (UID: "082d287c-1c8d-4d2f-adb5-82d542c434b8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:30:35.640034 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:35.639993 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9c8v\" (UniqueName: \"kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v\") pod \"network-check-target-6xtwg\" (UID: \"db938228-2485-4dc7-9a83-d5af8652ad4d\") " pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:35.640255 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:35.640232 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:30:35.640335 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:35.640260 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:30:35.640335 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:35.640277 2557 projected.go:196] Error preparing data for projected volume kube-api-access-l9c8v for pod openshift-network-diagnostics/network-check-target-6xtwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:30:35.640451 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:35.640344 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v podName:db938228-2485-4dc7-9a83-d5af8652ad4d nodeName:}" failed. No retries permitted until 2026-07-17 17:30:37.640322873 +0000 UTC m=+6.250992256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9c8v" (UniqueName: "kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v") pod "network-check-target-6xtwg" (UID: "db938228-2485-4dc7-9a83-d5af8652ad4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:30:35.882650 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:35.881935 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:35.882650 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:35.882088 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 17:25:34 +0000 UTC" deadline="2028-01-21 07:54:59.771903775 +0000 UTC" Jul 17 17:30:35.882650 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:35.882137 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13262h24m23.889771229s" Jul 17 17:30:35.882650 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:35.882129 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:30:35.882650 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:35.882175 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:35.882650 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:35.881934 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:35.882650 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:35.882345 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:30:35.882650 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:35.882455 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:30:37.455135 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:37.455095 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:37.455639 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:37.455262 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:30:37.455639 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:37.455334 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret podName:6b702b8e-c450-4d9c-b339-6d1f30922e66 nodeName:}" failed. No retries permitted until 2026-07-17 17:30:41.45531454 +0000 UTC m=+10.065983924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret") pod "global-pull-secret-syncer-xb5jt" (UID: "6b702b8e-c450-4d9c-b339-6d1f30922e66") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:30:37.555808 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:37.555770 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs\") pod \"network-metrics-daemon-v76hr\" (UID: \"082d287c-1c8d-4d2f-adb5-82d542c434b8\") " pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:37.556006 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:37.555966 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:30:37.556066 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:37.556050 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs podName:082d287c-1c8d-4d2f-adb5-82d542c434b8 nodeName:}" failed. No retries permitted until 2026-07-17 17:30:41.556026199 +0000 UTC m=+10.166695584 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs") pod "network-metrics-daemon-v76hr" (UID: "082d287c-1c8d-4d2f-adb5-82d542c434b8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:30:37.656740 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:37.656641 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9c8v\" (UniqueName: \"kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v\") pod \"network-check-target-6xtwg\" (UID: \"db938228-2485-4dc7-9a83-d5af8652ad4d\") " pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:37.656932 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:37.656888 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:30:37.656932 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:37.656914 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:30:37.656932 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:37.656928 2557 projected.go:196] Error preparing data for projected volume kube-api-access-l9c8v for pod openshift-network-diagnostics/network-check-target-6xtwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:30:37.657104 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:37.656990 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v podName:db938228-2485-4dc7-9a83-d5af8652ad4d nodeName:}" failed. No retries permitted until 2026-07-17 17:30:41.656970042 +0000 UTC m=+10.267639418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9c8v" (UniqueName: "kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v") pod "network-check-target-6xtwg" (UID: "db938228-2485-4dc7-9a83-d5af8652ad4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:30:37.875155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:37.875120 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:37.875311 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:37.875274 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:30:37.875699 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:37.875677 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:37.875821 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:37.875801 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:30:37.875897 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:37.875860 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:37.875968 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:37.875943 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:30:39.873005 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:39.872265 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:39.873005 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:39.872403 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:30:39.873005 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:39.872840 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:39.873005 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:39.872955 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:30:39.873656 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:39.873052 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:39.873656 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:39.873163 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:30:41.490015 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:41.489718 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:41.490015 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:41.489850 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:30:41.490015 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:41.489917 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret podName:6b702b8e-c450-4d9c-b339-6d1f30922e66 nodeName:}" failed. No retries permitted until 2026-07-17 17:30:49.489898876 +0000 UTC m=+18.100568247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret") pod "global-pull-secret-syncer-xb5jt" (UID: "6b702b8e-c450-4d9c-b339-6d1f30922e66") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:30:41.590872 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:41.590832 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs\") pod \"network-metrics-daemon-v76hr\" (UID: \"082d287c-1c8d-4d2f-adb5-82d542c434b8\") " pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:41.591031 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:41.591005 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:30:41.591097 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:41.591084 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs podName:082d287c-1c8d-4d2f-adb5-82d542c434b8 nodeName:}" failed. No retries permitted until 2026-07-17 17:30:49.591063097 +0000 UTC m=+18.201732461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs") pod "network-metrics-daemon-v76hr" (UID: "082d287c-1c8d-4d2f-adb5-82d542c434b8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:30:41.691640 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:41.691544 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9c8v\" (UniqueName: \"kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v\") pod \"network-check-target-6xtwg\" (UID: \"db938228-2485-4dc7-9a83-d5af8652ad4d\") " pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:41.691839 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:41.691658 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:30:41.691839 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:41.691697 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:30:41.691839 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:41.691710 2557 projected.go:196] Error preparing data for projected volume kube-api-access-l9c8v for pod openshift-network-diagnostics/network-check-target-6xtwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:30:41.691839 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:41.691767 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v podName:db938228-2485-4dc7-9a83-d5af8652ad4d nodeName:}" failed. No retries permitted until 2026-07-17 17:30:49.691747128 +0000 UTC m=+18.302416499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9c8v" (UniqueName: "kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v") pod "network-check-target-6xtwg" (UID: "db938228-2485-4dc7-9a83-d5af8652ad4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:30:41.872627 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:41.872354 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:41.872627 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:41.872463 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:30:41.872889 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:41.872846 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:41.872973 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:41.872944 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:30:41.873110 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:41.873007 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:41.873110 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:41.873102 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:30:43.872297 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:43.872223 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:43.872765 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:43.872378 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:30:43.872860 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:43.872835 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:43.873107 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:43.872933 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:30:43.873107 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:43.872991 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:43.873107 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:43.873057 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:30:45.871721 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:45.871671 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:45.872159 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:45.871811 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:30:45.872159 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:45.871818 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:45.872159 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:45.871692 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:45.872159 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:45.871928 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:30:45.872159 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:45.871997 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:30:47.872790 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:47.872542 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:47.873257 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:47.872542 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:47.873257 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:47.873009 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:30:47.873257 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:47.872895 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:30:47.873257 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:47.872552 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:47.873257 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:47.873156 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:30:49.554731 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:49.554689 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:49.555211 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:49.554819 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:30:49.555211 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:49.554893 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret podName:6b702b8e-c450-4d9c-b339-6d1f30922e66 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:05.554873715 +0000 UTC m=+34.165543092 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret") pod "global-pull-secret-syncer-xb5jt" (UID: "6b702b8e-c450-4d9c-b339-6d1f30922e66") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:30:49.655754 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:49.655723 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs\") pod \"network-metrics-daemon-v76hr\" (UID: \"082d287c-1c8d-4d2f-adb5-82d542c434b8\") " pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:49.655899 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:49.655874 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:30:49.655944 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:49.655934 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs podName:082d287c-1c8d-4d2f-adb5-82d542c434b8 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:05.655919675 +0000 UTC m=+34.266589036 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs") pod "network-metrics-daemon-v76hr" (UID: "082d287c-1c8d-4d2f-adb5-82d542c434b8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:30:49.757568 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:49.756952 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9c8v\" (UniqueName: \"kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v\") pod \"network-check-target-6xtwg\" (UID: \"db938228-2485-4dc7-9a83-d5af8652ad4d\") " pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:49.757568 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:49.757175 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:30:49.757568 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:49.757194 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:30:49.757568 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:49.757206 2557 projected.go:196] Error preparing data for projected volume kube-api-access-l9c8v for pod openshift-network-diagnostics/network-check-target-6xtwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:30:49.757568 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:49.757260 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v podName:db938228-2485-4dc7-9a83-d5af8652ad4d nodeName:}" failed. No retries permitted until 2026-07-17 17:31:05.757242925 +0000 UTC m=+34.367912291 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9c8v" (UniqueName: "kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v") pod "network-check-target-6xtwg" (UID: "db938228-2485-4dc7-9a83-d5af8652ad4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:30:49.872658 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:49.872526 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:49.872658 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:49.872558 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:49.872658 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:49.872573 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:49.872923 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:49.872666 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:30:49.872923 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:49.872776 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:30:49.872923 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:49.872844 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:30:51.872853 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:51.872791 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:51.873354 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:51.872912 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:30:51.873354 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:51.872930 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:51.873354 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:51.873027 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:30:51.873354 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:51.873072 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:51.873354 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:51.873139 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:30:53.872037 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:53.871998 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:53.872506 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:53.871998 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:53.872506 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:53.872223 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:30:53.872506 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:53.872101 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:30:53.872506 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:53.871999 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:53.872506 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:53.872338 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:30:54.944706 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:54.944236 2557 generic.go:356] "Generic (PLEG): container finished" podID="6ce16731-5297-45af-9b0e-9aaf4a8dedb4" containerID="617fe459e5bbc2c9ca563584318fb7b6012dea0ed877cdb021219dbbf5186c2f" exitCode=0 Jul 17 17:30:54.945425 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:54.944703 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bpqj" event={"ID":"6ce16731-5297-45af-9b0e-9aaf4a8dedb4","Type":"ContainerDied","Data":"617fe459e5bbc2c9ca563584318fb7b6012dea0ed877cdb021219dbbf5186c2f"} Jul 17 17:30:54.946662 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:54.946638 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lk5gp" event={"ID":"19e37a6a-c87e-4fdc-b7e3-a077511a962e","Type":"ContainerStarted","Data":"4c0723bcca8ae33f6b564486adbe39f61ffc8521e627e8c03bec5bd6c457a32c"} Jul 17 17:30:54.948223 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:54.948203 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mpdl4" event={"ID":"95be5822-5b78-4e56-aae0-9c8ad4a8ecd7","Type":"ContainerStarted","Data":"59e4f30f3dd50543bac0368b3c40a472807c0593dbcfe462e2c60d136580d33d"} Jul 17 17:30:54.949840 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:54.949818 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-frksq" event={"ID":"f5c908e1-54ef-490c-b596-3b158896ae0f","Type":"ContainerStarted","Data":"ee29d521a7238014a3b7b6905fb7906008a33739d414003b066ccd8d6eaa9cdd"} Jul 17 17:30:54.951252 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:54.951229 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5f57h" event={"ID":"ac867d9e-ba94-420f-aca9-f95f6def7fe0","Type":"ContainerStarted","Data":"705ade0be2a1a373ae7a6ed612bef49361cb064f9839e106a87f4efd1dae3a53"} Jul 17 17:30:54.952843 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:54.952817 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d4j6d" event={"ID":"59876b7a-57d9-4692-be8d-2a279ee9b885","Type":"ContainerStarted","Data":"e41472134266668ffd1593216c0157e8d53b4028cb5ae0d211f492128a314d3e"} Jul 17 17:30:54.955529 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:54.955505 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" event={"ID":"4efbec79-5861-4615-8730-b4941f001ef2","Type":"ContainerStarted","Data":"b8d7b2264853a6805522719ccb5ee1d7277b84f3bc54f230303b063ae623b109"} Jul 17 17:30:54.955608 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:54.955575 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" event={"ID":"4efbec79-5861-4615-8730-b4941f001ef2","Type":"ContainerStarted","Data":"8d0f81cf07dd6cbb87b28b57635a585915e381262e492952630bca78820aceb0"} Jul 17 17:30:54.955651 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:54.955610 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" event={"ID":"4efbec79-5861-4615-8730-b4941f001ef2","Type":"ContainerStarted","Data":"128ba8265b44a62689397cf36041d3fafa0a629644816d202c8a026e57743443"} Jul 17 17:30:54.955651 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:54.955641 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" event={"ID":"4efbec79-5861-4615-8730-b4941f001ef2","Type":"ContainerStarted","Data":"8bb44fa06d43158690a5d05598feb088f07880ec2f26c169cded76415489aabf"} Jul 17 17:30:54.956724 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:54.956704 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" event={"ID":"a4be4e35-28f5-440b-8820-64fec4fa4ad0","Type":"ContainerStarted","Data":"d65fd6023e219806b67017bc37711b83ecf100cad2b11a547b7839870a2775c1"} Jul 17 17:30:54.958648 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:54.958631 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-245.ec2.internal" event={"ID":"2d08157d5f37b263915c19440df08566","Type":"ContainerStarted","Data":"5e5650e13f99e1984b70120b33a5a4d07bc52729780f07dd3d021ceb7d9dfa29"} Jul 17 17:30:54.959968 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:54.959946 2557 generic.go:356] "Generic (PLEG): container finished" podID="20e594a88314b0ddf3e6949e6d352f72" containerID="6d8c8af075950951d1f74aa149776a421fb09b72bfe3932448499bedfcc4834f" exitCode=0 Jul 17 17:30:54.960057 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:54.959975 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal" event={"ID":"20e594a88314b0ddf3e6949e6d352f72","Type":"ContainerDied","Data":"6d8c8af075950951d1f74aa149776a421fb09b72bfe3932448499bedfcc4834f"} Jul 17 17:30:55.009453 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.009178 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d4j6d" podStartSLOduration=7.429430422 podStartE2EDuration="23.00915698s" totalImagesPullingTime="15.579726558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:55.008855212 +0000 UTC m=+23.619524818" watchObservedRunningTime="2026-07-17 17:30:55.00915698 +0000 UTC m=+23.619826363" Jul 17 17:30:55.009975 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.009935 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mpdl4" podStartSLOduration=3.227812953 podStartE2EDuration="23.00991902s" totalImagesPullingTime="19.782106067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:54.994761038 +0000 UTC m=+23.605430419" watchObservedRunningTime="2026-07-17 17:30:55.00991902 +0000 UTC m=+23.620588403" Jul 17 17:30:55.026110 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.026068 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lk5gp" podStartSLOduration=3.022237914 podStartE2EDuration="23.026054829s" totalImagesPullingTime="20.003816915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:55.025943084 +0000 UTC m=+23.636612466" watchObservedRunningTime="2026-07-17 17:30:55.026054829 +0000 UTC m=+23.636724207" Jul 17 17:30:55.047031 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.046989 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-frksq" podStartSLOduration=2.018102927 podStartE2EDuration="22.046974033s" totalImagesPullingTime="20.028871106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:30:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:55.046353176 +0000 UTC m=+23.657022557" watchObservedRunningTime="2026-07-17 17:30:55.046974033 +0000 UTC m=+23.657643415" Jul 17 17:30:55.058443 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.058407 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-245.ec2.internal" podStartSLOduration=22.058392901 podStartE2EDuration="22.058392901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:55.058302678 +0000 UTC m=+23.668972059" watchObservedRunningTime="2026-07-17 17:30:55.058392901 +0000 UTC m=+23.669062296" Jul 17 17:30:55.086948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.086895 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5f57h" podStartSLOduration=3.02036847 podStartE2EDuration="23.086880861s" totalImagesPullingTime="20.066512391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:55.086393906 +0000 UTC m=+23.697063285" watchObservedRunningTime="2026-07-17 17:30:55.086880861 +0000 UTC m=+23.697550242" Jul 17 17:30:55.545700 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.545609 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d4j6d" Jul 17 17:30:55.546220 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.546199 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d4j6d" Jul 17 17:30:55.872365 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.872287 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:55.872537 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.872287 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:55.872537 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:55.872423 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:30:55.872537 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.872427 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:55.872706 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:55.872534 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:30:55.872706 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:55.872624 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:30:55.963726 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.963673 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r8947" event={"ID":"b87ed784-588a-4ce5-b2c0-1c17e62d34cb","Type":"ContainerStarted","Data":"4f1a7fb953ba976e3e407a0dd0c63d0c0e35b132e89b64229da77f1af7128673"} Jul 17 17:30:55.967059 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.967027 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" event={"ID":"4efbec79-5861-4615-8730-b4941f001ef2","Type":"ContainerStarted","Data":"7fffd3739dad59d3c2977ac93ef57c672f6ab8be0b06996e107d66bcce8f2d02"} Jul 17 17:30:55.967195 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.967108 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" event={"ID":"4efbec79-5861-4615-8730-b4941f001ef2","Type":"ContainerStarted","Data":"16bfffbf9208903763841eeff35d63d23ae2bc707593ff402f97aca5b29fee5f"} Jul 17 17:30:55.968847 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.968820 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal" event={"ID":"20e594a88314b0ddf3e6949e6d352f72","Type":"ContainerStarted","Data":"ed97164772f3876ed7bd03366009d21ab1e1c01a90233ad32654a4f8a6fed358"} Jul 17 17:30:55.979951 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.979898 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r8947" podStartSLOduration=3.944293408 podStartE2EDuration="23.979881273s" totalImagesPullingTime="20.035587865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:55.979746927 +0000 UTC m=+24.590416362" watchObservedRunningTime="2026-07-17 17:30:55.979881273 +0000 UTC m=+24.590550657" Jul 17 17:30:55.995331 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:55.995293 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-245.ec2.internal" podStartSLOduration=22.995276954 podStartE2EDuration="22.995276954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:55.994733969 +0000 UTC m=+24.605403350" watchObservedRunningTime="2026-07-17 17:30:55.995276954 +0000 UTC m=+24.605946335" Jul 17 17:30:56.385953 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:56.385932 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 17:30:56.893657 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:56.893559 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T17:30:56.385947229Z","UUID":"289e5604-1046-46e7-a2c3-19faa3db0b18","Handler":null,"Name":"","Endpoint":""} Jul 17 17:30:56.895126 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:56.895103 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 17:30:56.895262 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:56.895148 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 17:30:56.972487 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:56.972443 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" event={"ID":"a4be4e35-28f5-440b-8820-64fec4fa4ad0","Type":"ContainerStarted","Data":"ebb9cb37e580158adc9f8bf96185d7ae8d102298533bb6d6af6755d8f43dce21"} Jul 17 17:30:56.972880 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:56.972865 2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 17 17:30:57.872528 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:57.872498 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:57.872708 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:57.872492 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:57.872708 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:57.872598 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:30:57.872708 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:57.872662 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:30:57.872708 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:57.872493 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:57.872849 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:57.872787 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:30:57.978185 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:57.978100 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" event={"ID":"4efbec79-5861-4615-8730-b4941f001ef2","Type":"ContainerStarted","Data":"25b6413912d87b9869102befa06d350d5e9e3dd29858407db7b0af6f5f35c85d"} Jul 17 17:30:57.980179 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:57.980145 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" event={"ID":"a4be4e35-28f5-440b-8820-64fec4fa4ad0","Type":"ContainerStarted","Data":"799c61d962cf5c438431a0c33aa13ba12c79d45d9b708aa9bade4fcca13c6418"} Jul 17 17:30:57.997900 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:57.997851 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgzzb" podStartSLOduration=2.970001493 podStartE2EDuration="25.997837219s" totalImagesPullingTime="23.027835726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:30:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:57.997658419 +0000 UTC m=+26.608327803" watchObservedRunningTime="2026-07-17 17:30:57.997837219 +0000 UTC m=+26.608506758" Jul 17 17:30:59.872615 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:59.872581 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:30:59.873119 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:59.872588 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:30:59.873119 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:59.872737 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:30:59.873119 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:30:59.872594 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:30:59.873119 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:59.872768 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:30:59.873119 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:30:59.872866 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:31:00.777850 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:00.777654 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d4j6d" Jul 17 17:31:00.777999 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:00.777987 2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 17 17:31:00.778280 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:00.778244 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d4j6d" Jul 17 17:31:00.991475 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:00.991444 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" event={"ID":"4efbec79-5861-4615-8730-b4941f001ef2","Type":"ContainerStarted","Data":"4b9f947a1e404e86f9777f4f733f3c4ac6655c94d851361bdb221f6ab54eb1d4"} Jul 17 17:31:00.992323 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:00.991672 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:31:00.993263 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:00.993237 2557 generic.go:356] "Generic (PLEG): container finished" podID="6ce16731-5297-45af-9b0e-9aaf4a8dedb4" containerID="cf7115b2339bc7e0bd162d1242387a56017591d1da0c5ae0661118e3e8f42bda" exitCode=0 Jul 17 17:31:00.993378 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:00.993322 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bpqj" event={"ID":"6ce16731-5297-45af-9b0e-9aaf4a8dedb4","Type":"ContainerDied","Data":"cf7115b2339bc7e0bd162d1242387a56017591d1da0c5ae0661118e3e8f42bda"} Jul 17 17:31:01.007448 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:01.007425 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:31:01.016080 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:01.016041 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" podStartSLOduration=8.785133847 podStartE2EDuration="29.016027799s" totalImagesPullingTime="20.230893952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:01.015486358 +0000 UTC m=+29.626155731" watchObservedRunningTime="2026-07-17 17:31:01.016027799 +0000 UTC m=+29.626697198" Jul 17 17:31:01.873177 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:01.873142 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:31:01.873411 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:01.873185 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:31:01.873411 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:01.873271 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:31:01.873411 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:01.873289 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:31:01.873411 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:01.873350 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:31:01.873612 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:01.873433 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:31:01.996307 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:01.996165 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:31:01.996702 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:01.996408 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:31:02.011260 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:02.011236 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:31:02.570359 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:02.570286 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xb5jt"] Jul 17 17:31:02.570515 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:02.570401 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:31:02.570515 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:02.570486 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:31:02.574018 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:02.573988 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6xtwg"] Jul 17 17:31:02.574142 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:02.574116 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:31:02.574225 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:02.574204 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:31:02.574726 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:02.574701 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v76hr"] Jul 17 17:31:02.574832 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:02.574805 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:31:02.574927 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:02.574896 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:31:02.999454 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:02.999423 2557 generic.go:356] "Generic (PLEG): container finished" podID="6ce16731-5297-45af-9b0e-9aaf4a8dedb4" containerID="3802e164c254cfb6e40d540a595a2c9e14151fee106b253ac36711e237a8b35d" exitCode=0 Jul 17 17:31:02.999454 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:02.999456 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bpqj" event={"ID":"6ce16731-5297-45af-9b0e-9aaf4a8dedb4","Type":"ContainerDied","Data":"3802e164c254cfb6e40d540a595a2c9e14151fee106b253ac36711e237a8b35d"} Jul 17 17:31:03.872600 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:03.872568 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:31:03.872777 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:03.872718 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:31:04.004592 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:04.004564 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bpqj" event={"ID":"6ce16731-5297-45af-9b0e-9aaf4a8dedb4","Type":"ContainerStarted","Data":"ff12d35fbc1bb48018219b51c68cf10d289f58ff63330c323ba5acbddfb2db82"} Jul 17 17:31:04.871826 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:04.871777 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:31:04.871826 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:04.871811 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:31:04.872014 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:04.871901 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:31:04.872014 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:04.872005 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:31:05.008721 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:05.008672 2557 generic.go:356] "Generic (PLEG): container finished" podID="6ce16731-5297-45af-9b0e-9aaf4a8dedb4" containerID="ff12d35fbc1bb48018219b51c68cf10d289f58ff63330c323ba5acbddfb2db82" exitCode=0 Jul 17 17:31:05.008721 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:05.008711 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bpqj" event={"ID":"6ce16731-5297-45af-9b0e-9aaf4a8dedb4","Type":"ContainerDied","Data":"ff12d35fbc1bb48018219b51c68cf10d289f58ff63330c323ba5acbddfb2db82"} Jul 17 17:31:05.577743 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:05.577649 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:31:05.577907 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:05.577785 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:31:05.577907 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:05.577862 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret podName:6b702b8e-c450-4d9c-b339-6d1f30922e66 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:37.577840389 +0000 UTC m=+66.188509980 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret") pod "global-pull-secret-syncer-xb5jt" (UID: "6b702b8e-c450-4d9c-b339-6d1f30922e66") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:31:05.678446 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:05.678410 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs\") pod \"network-metrics-daemon-v76hr\" (UID: \"082d287c-1c8d-4d2f-adb5-82d542c434b8\") " pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:31:05.678595 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:05.678560 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:31:05.678638 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:05.678624 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs podName:082d287c-1c8d-4d2f-adb5-82d542c434b8 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:37.678606539 +0000 UTC m=+66.289275899 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs") pod "network-metrics-daemon-v76hr" (UID: "082d287c-1c8d-4d2f-adb5-82d542c434b8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:31:05.779253 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:05.779219 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9c8v\" (UniqueName: \"kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v\") pod \"network-check-target-6xtwg\" (UID: \"db938228-2485-4dc7-9a83-d5af8652ad4d\") " pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:31:05.779420 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:05.779336 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:31:05.779420 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:05.779353 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:31:05.779420 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:05.779363 2557 projected.go:196] Error preparing data for projected volume kube-api-access-l9c8v for pod openshift-network-diagnostics/network-check-target-6xtwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:31:05.779420 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:05.779410 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v podName:db938228-2485-4dc7-9a83-d5af8652ad4d nodeName:}" failed. No retries permitted until 2026-07-17 17:31:37.77939717 +0000 UTC m=+66.390066531 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9c8v" (UniqueName: "kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v") pod "network-check-target-6xtwg" (UID: "db938228-2485-4dc7-9a83-d5af8652ad4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:31:05.871930 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:05.871904 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:31:05.872077 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:05.872032 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xb5jt" podUID="6b702b8e-c450-4d9c-b339-6d1f30922e66" Jul 17 17:31:06.872610 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:06.872573 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:31:06.872982 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:06.872613 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:31:06.872982 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:06.872696 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xtwg" podUID="db938228-2485-4dc7-9a83-d5af8652ad4d" Jul 17 17:31:06.872982 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:06.872799 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v76hr" podUID="082d287c-1c8d-4d2f-adb5-82d542c434b8" Jul 17 17:31:07.210453 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.210429 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-245.ec2.internal" event="NodeReady" Jul 17 17:31:07.210609 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.210547 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 17:31:07.247951 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.247917 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2"] Jul 17 17:31:07.252220 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.252182 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-644dd77dcb-5d5fk"] Jul 17 17:31:07.252462 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.252318 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" Jul 17 17:31:07.255418 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.255399 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 17 17:31:07.255883 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.255863 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:31:07.255985 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.255880 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 17 17:31:07.256253 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.256234 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mzn7n\"" Jul 17 17:31:07.257019 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.257001 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-qlvv2"] Jul 17 17:31:07.257141 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.257123 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.260739 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.260719 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56bc46498-h9pbn"] Jul 17 17:31:07.260821 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.260742 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 17 17:31:07.260821 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.260810 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 17 17:31:07.261635 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.261118 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qgkjr\"" Jul 17 17:31:07.261635 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.261142 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.261635 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.261321 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 17 17:31:07.264551 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.264527 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-qq5gg"] Jul 17 17:31:07.265131 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.264752 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.266447 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.266425 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 17:31:07.267154 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.267139 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-55d8p\"" Jul 17 17:31:07.267238 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.267196 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 17:31:07.267301 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.267242 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 17 17:31:07.267301 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.267195 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 17 17:31:07.268041 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.268024 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z"] Jul 17 17:31:07.268417 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.268398 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:07.269065 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.268938 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 17 17:31:07.269065 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.269033 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 17 17:31:07.269978 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.269128 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 17 17:31:07.269978 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.269867 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 17 17:31:07.270130 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.270114 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xlgfp\"" Jul 17 17:31:07.270359 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.270341 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 17 17:31:07.270420 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.270365 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 17 17:31:07.271882 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.271860 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fn5j9\"" Jul 17 17:31:07.271986 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.271896 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 17 17:31:07.271986 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.271941 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 17 17:31:07.272535 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.272514 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-n4qth"] Jul 17 17:31:07.273566 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.273042 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:07.279900 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.279876 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:31:07.280423 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.280400 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 17 17:31:07.281564 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.281538 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vfmzw\"" Jul 17 17:31:07.282075 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.281892 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 17 17:31:07.285612 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.285586 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 17:31:07.286244 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.286221 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 17:31:07.286373 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.286357 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 17 17:31:07.288387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.288363 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 17 17:31:07.289002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.288970 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 17 17:31:07.290203 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.290183 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 17 17:31:07.293637 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.293619 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt"] Jul 17 17:31:07.294492 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.294471 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-n4qth" Jul 17 17:31:07.297741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.297720 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fz84l\"" Jul 17 17:31:07.297837 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.297810 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d"] Jul 17 17:31:07.298001 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.297957 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 17:31:07.298234 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.298215 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 17:31:07.298622 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.298603 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" Jul 17 17:31:07.301345 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.301324 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 17 17:31:07.301504 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.301347 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5xl4b\"" Jul 17 17:31:07.301639 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.301621 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:31:07.301788 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.301764 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ghg86"] Jul 17 17:31:07.302544 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.301938 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" Jul 17 17:31:07.302544 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.301997 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 17 17:31:07.302544 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.302248 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 17 17:31:07.304716 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.304387 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 17 17:31:07.304716 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.304501 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:31:07.304716 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.304521 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 17 17:31:07.304716 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.304600 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zrlj9\"" Jul 17 17:31:07.304958 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.304751 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 17 17:31:07.305577 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.305558 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-854d76f6cf-grgqm"] Jul 17 17:31:07.305815 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.305795 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ghg86" Jul 17 17:31:07.309736 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.308927 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:31:07.309736 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.309032 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2zhrq\"" Jul 17 17:31:07.309736 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.309104 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 17 17:31:07.310014 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.309996 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2"] Jul 17 17:31:07.310070 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.310033 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-n4qth"] Jul 17 17:31:07.310070 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.310054 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-qlvv2"] Jul 17 17:31:07.310165 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.310124 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.310165 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.310158 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-qq5gg"] Jul 17 17:31:07.310256 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.310186 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-644dd77dcb-5d5fk"] Jul 17 17:31:07.310256 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.310205 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56bc46498-h9pbn"] Jul 17 17:31:07.310374 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.310336 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d"] Jul 17 17:31:07.310427 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.310394 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt"] Jul 17 17:31:07.310427 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.310417 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ghg86"] Jul 17 17:31:07.310518 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.310475 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-79kq8"] Jul 17 17:31:07.318075 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.318051 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qb5g6"] Jul 17 17:31:07.318870 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.318850 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:07.321515 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.321491 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 17:31:07.321609 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.321544 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 17:31:07.321727 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.321708 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c4wmq\"" Jul 17 17:31:07.322899 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.322880 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-854d76f6cf-grgqm"] Jul 17 17:31:07.322999 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.322915 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z"] Jul 17 17:31:07.322999 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.322928 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-79kq8"] Jul 17 17:31:07.322999 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.322969 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qb5g6"] Jul 17 17:31:07.323210 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.323027 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qb5g6" Jul 17 17:31:07.325562 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.325542 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 17:31:07.325668 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.325569 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dpl9j\"" Jul 17 17:31:07.325818 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.325803 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 17:31:07.325818 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.325818 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 17:31:07.388830 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.388806 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccfd68b0-0222-4940-9793-f503e6edc300-service-ca-bundle\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.388969 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.388836 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4cfa3866-cee4-4677-b24c-97c3b7839334-serving-cert\") pod \"service-ca-operator-5bcbc94c78-5g8wt\" (UID: \"4cfa3866-cee4-4677-b24c-97c3b7839334\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" Jul 17 17:31:07.388969 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.388858 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gdq5z\" (UID: \"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:07.388969 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.388881 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccfd68b0-0222-4940-9793-f503e6edc300-serving-cert\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.388969 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.388906 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-trusted-ca\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.388969 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.388930 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-certificates\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.388969 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.388953 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.389274 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.388991 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgcdr\" (UniqueName: \"kubernetes.io/projected/fb8b4834-5dba-4cce-b4f7-60407b1b05cc-kube-api-access-cgcdr\") pod \"console-operator-565b7b569d-qq5gg\" (UID: \"fb8b4834-5dba-4cce-b4f7-60407b1b05cc\") " pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:07.389274 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389021 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-image-registry-private-configuration\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.389274 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389038 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-bound-sa-token\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.389274 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389056 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-stats-auth\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.389274 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389102 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-ca-trust-extracted\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.389274 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389129 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z29hg\" (UniqueName: \"kubernetes.io/projected/6d78bf45-20a3-493b-bf56-0a4d930b8bb7-kube-api-access-z29hg\") pod \"volume-data-source-validator-78cf4c6f6-ghg86\" (UID: \"6d78bf45-20a3-493b-bf56-0a4d930b8bb7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ghg86" Jul 17 17:31:07.389274 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389162 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-ca-trust-extracted\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.389274 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389182 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-trusted-ca\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.389274 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389200 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwlwd\" (UniqueName: \"kubernetes.io/projected/4cfa3866-cee4-4677-b24c-97c3b7839334-kube-api-access-xwlwd\") pod \"service-ca-operator-5bcbc94c78-5g8wt\" (UID: \"4cfa3866-cee4-4677-b24c-97c3b7839334\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" Jul 17 17:31:07.389274 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389222 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-757xm\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-kube-api-access-757xm\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.389274 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389252 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4h9k2\" (UID: \"5cb507b3-c5cf-4cef-a3c3-d0168e3660da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" Jul 17 17:31:07.389769 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389329 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-image-registry-private-configuration\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.389769 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389357 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.389769 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389382 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg7vx\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-kube-api-access-dg7vx\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.389769 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389430 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-certificates\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.389769 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389458 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xbsv\" (UniqueName: \"kubernetes.io/projected/3398a5d5-1531-4672-906c-ce042e4d7eef-kube-api-access-4xbsv\") pod \"kube-storage-version-migrator-operator-7658d9b749-6jr7d\" (UID: \"3398a5d5-1531-4672-906c-ce042e4d7eef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" Jul 17 17:31:07.389769 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389487 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-bound-sa-token\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.389769 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389507 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-gdq5z\" (UID: \"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:07.389769 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389524 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tzcp\" (UniqueName: \"kubernetes.io/projected/ccfd68b0-0222-4940-9793-f503e6edc300-kube-api-access-9tzcp\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.389769 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389544 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3398a5d5-1531-4672-906c-ce042e4d7eef-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-6jr7d\" (UID: \"3398a5d5-1531-4672-906c-ce042e4d7eef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" Jul 17 17:31:07.389769 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389601 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb8b4834-5dba-4cce-b4f7-60407b1b05cc-config\") pod \"console-operator-565b7b569d-qq5gg\" (UID: \"fb8b4834-5dba-4cce-b4f7-60407b1b05cc\") " pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:07.389769 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389643 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.389769 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389701 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v947z\" (UniqueName: \"kubernetes.io/projected/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-kube-api-access-v947z\") pod \"cluster-samples-operator-79b7c55f87-4h9k2\" (UID: \"5cb507b3-c5cf-4cef-a3c3-d0168e3660da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" Jul 17 17:31:07.390234 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389753 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb8b4834-5dba-4cce-b4f7-60407b1b05cc-trusted-ca\") pod \"console-operator-565b7b569d-qq5gg\" (UID: \"fb8b4834-5dba-4cce-b4f7-60407b1b05cc\") " pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:07.390234 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389778 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-default-certificate\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.390234 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389814 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4hk5\" (UniqueName: \"kubernetes.io/projected/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-kube-api-access-l4hk5\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.390234 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389851 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ccfd68b0-0222-4940-9793-f503e6edc300-snapshots\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.390234 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389892 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccfd68b0-0222-4940-9793-f503e6edc300-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.390234 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389973 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-installation-pull-secrets\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.390234 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.389999 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.390234 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.390023 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtdk5\" (UniqueName: \"kubernetes.io/projected/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-kube-api-access-jtdk5\") pod \"cluster-monitoring-operator-76cf8966f8-gdq5z\" (UID: \"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:07.390234 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.390040 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wnck\" (UniqueName: \"kubernetes.io/projected/9ad046ee-5c2f-446b-b876-fa87394b9ed9-kube-api-access-5wnck\") pod \"network-check-source-7bc5b6bf85-n4qth\" (UID: \"9ad046ee-5c2f-446b-b876-fa87394b9ed9\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-n4qth" Jul 17 17:31:07.390234 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.390089 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb8b4834-5dba-4cce-b4f7-60407b1b05cc-serving-cert\") pod \"console-operator-565b7b569d-qq5gg\" (UID: \"fb8b4834-5dba-4cce-b4f7-60407b1b05cc\") " pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:07.390234 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.390144 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3398a5d5-1531-4672-906c-ce042e4d7eef-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-6jr7d\" (UID: \"3398a5d5-1531-4672-906c-ce042e4d7eef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" Jul 17 17:31:07.390234 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.390172 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-installation-pull-secrets\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.390583 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.390199 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4cfa3866-cee4-4677-b24c-97c3b7839334-config\") pod \"service-ca-operator-5bcbc94c78-5g8wt\" (UID: \"4cfa3866-cee4-4677-b24c-97c3b7839334\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" Jul 17 17:31:07.390583 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.390232 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccfd68b0-0222-4940-9793-f503e6edc300-tmp\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.491092 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491013 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wnck\" (UniqueName: \"kubernetes.io/projected/9ad046ee-5c2f-446b-b876-fa87394b9ed9-kube-api-access-5wnck\") pod \"network-check-source-7bc5b6bf85-n4qth\" (UID: \"9ad046ee-5c2f-446b-b876-fa87394b9ed9\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-n4qth" Jul 17 17:31:07.491092 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491048 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb8b4834-5dba-4cce-b4f7-60407b1b05cc-serving-cert\") pod \"console-operator-565b7b569d-qq5gg\" (UID: \"fb8b4834-5dba-4cce-b4f7-60407b1b05cc\") " pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:07.491092 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491072 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3398a5d5-1531-4672-906c-ce042e4d7eef-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-6jr7d\" (UID: \"3398a5d5-1531-4672-906c-ce042e4d7eef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" Jul 17 17:31:07.491092 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491090 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-installation-pull-secrets\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.491350 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491106 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4cfa3866-cee4-4677-b24c-97c3b7839334-config\") pod \"service-ca-operator-5bcbc94c78-5g8wt\" (UID: \"4cfa3866-cee4-4677-b24c-97c3b7839334\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" Jul 17 17:31:07.491350 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491125 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b79c6\" (UniqueName: \"kubernetes.io/projected/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-kube-api-access-b79c6\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:07.491350 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491173 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccfd68b0-0222-4940-9793-f503e6edc300-tmp\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.491350 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491199 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccfd68b0-0222-4940-9793-f503e6edc300-service-ca-bundle\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.491350 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491220 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4cfa3866-cee4-4677-b24c-97c3b7839334-serving-cert\") pod \"service-ca-operator-5bcbc94c78-5g8wt\" (UID: \"4cfa3866-cee4-4677-b24c-97c3b7839334\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" Jul 17 17:31:07.491350 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491252 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gdq5z\" (UID: \"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:07.491350 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491275 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccfd68b0-0222-4940-9793-f503e6edc300-serving-cert\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.491350 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491309 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-trusted-ca\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.491350 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491332 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-certificates\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.491627 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491369 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.491627 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491395 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgcdr\" (UniqueName: \"kubernetes.io/projected/fb8b4834-5dba-4cce-b4f7-60407b1b05cc-kube-api-access-cgcdr\") pod \"console-operator-565b7b569d-qq5gg\" (UID: \"fb8b4834-5dba-4cce-b4f7-60407b1b05cc\") " pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:07.491627 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491421 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-image-registry-private-configuration\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.491627 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491455 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-bound-sa-token\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.491627 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491479 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-stats-auth\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.491627 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491508 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-ca-trust-extracted\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.491627 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491538 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z29hg\" (UniqueName: \"kubernetes.io/projected/6d78bf45-20a3-493b-bf56-0a4d930b8bb7-kube-api-access-z29hg\") pod \"volume-data-source-validator-78cf4c6f6-ghg86\" (UID: \"6d78bf45-20a3-493b-bf56-0a4d930b8bb7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ghg86" Jul 17 17:31:07.491627 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491563 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:07.491627 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491588 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-ca-trust-extracted\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.491627 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491613 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-trusted-ca\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.492053 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491640 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwlwd\" (UniqueName: \"kubernetes.io/projected/4cfa3866-cee4-4677-b24c-97c3b7839334-kube-api-access-xwlwd\") pod \"service-ca-operator-5bcbc94c78-5g8wt\" (UID: \"4cfa3866-cee4-4677-b24c-97c3b7839334\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" Jul 17 17:31:07.492053 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491668 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpczh\" (UniqueName: \"kubernetes.io/projected/00e27498-09f4-464c-b08b-45a0b3cb2786-kube-api-access-qpczh\") pod \"ingress-canary-qb5g6\" (UID: \"00e27498-09f4-464c-b08b-45a0b3cb2786\") " pod="openshift-ingress-canary/ingress-canary-qb5g6" Jul 17 17:31:07.492053 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491719 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-757xm\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-kube-api-access-757xm\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.492053 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491747 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4h9k2\" (UID: \"5cb507b3-c5cf-4cef-a3c3-d0168e3660da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" Jul 17 17:31:07.492053 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491771 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3398a5d5-1531-4672-906c-ce042e4d7eef-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-6jr7d\" (UID: \"3398a5d5-1531-4672-906c-ce042e4d7eef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" Jul 17 17:31:07.492053 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491784 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4cfa3866-cee4-4677-b24c-97c3b7839334-config\") pod \"service-ca-operator-5bcbc94c78-5g8wt\" (UID: \"4cfa3866-cee4-4677-b24c-97c3b7839334\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" Jul 17 17:31:07.492053 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491795 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-image-registry-private-configuration\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.492053 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.491863 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccfd68b0-0222-4940-9793-f503e6edc300-service-ca-bundle\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.492437 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.492089 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccfd68b0-0222-4940-9793-f503e6edc300-tmp\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.492437 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.492246 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:31:07.492437 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.492266 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:31:07.492437 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.492282 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644dd77dcb-5d5fk: secret "image-registry-tls" not found Jul 17 17:31:07.492437 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.492312 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls podName:5cb507b3-c5cf-4cef-a3c3-d0168e3660da nodeName:}" failed. No retries permitted until 2026-07-17 17:31:07.992295405 +0000 UTC m=+36.602964786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4h9k2" (UID: "5cb507b3-c5cf-4cef-a3c3-d0168e3660da") : secret "samples-operator-tls" not found Jul 17 17:31:07.492437 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.492311 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-ca-trust-extracted\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.492437 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.492328 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls podName:c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d nodeName:}" failed. No retries permitted until 2026-07-17 17:31:07.992319913 +0000 UTC m=+36.602989295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls") pod "image-registry-644dd77dcb-5d5fk" (UID: "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d") : secret "image-registry-tls" not found Jul 17 17:31:07.492816 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.492754 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.492816 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.492794 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg7vx\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-kube-api-access-dg7vx\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.492919 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.492823 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-config-volume\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:07.492919 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.492852 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-certificates\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.492919 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.492878 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xbsv\" (UniqueName: \"kubernetes.io/projected/3398a5d5-1531-4672-906c-ce042e4d7eef-kube-api-access-4xbsv\") pod \"kube-storage-version-migrator-operator-7658d9b749-6jr7d\" (UID: \"3398a5d5-1531-4672-906c-ce042e4d7eef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" Jul 17 17:31:07.492919 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.492906 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-bound-sa-token\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.493114 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.492914 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-certificates\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.493114 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.492935 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-gdq5z\" (UID: \"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:07.493114 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.492958 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00e27498-09f4-464c-b08b-45a0b3cb2786-cert\") pod \"ingress-canary-qb5g6\" (UID: \"00e27498-09f4-464c-b08b-45a0b3cb2786\") " pod="openshift-ingress-canary/ingress-canary-qb5g6" Jul 17 17:31:07.493114 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.492990 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tzcp\" (UniqueName: \"kubernetes.io/projected/ccfd68b0-0222-4940-9793-f503e6edc300-kube-api-access-9tzcp\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.493114 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.493017 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3398a5d5-1531-4672-906c-ce042e4d7eef-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-6jr7d\" (UID: \"3398a5d5-1531-4672-906c-ce042e4d7eef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" Jul 17 17:31:07.493114 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.493043 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb8b4834-5dba-4cce-b4f7-60407b1b05cc-config\") pod \"console-operator-565b7b569d-qq5gg\" (UID: \"fb8b4834-5dba-4cce-b4f7-60407b1b05cc\") " pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:07.493114 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.493083 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.493114 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.493108 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-trusted-ca\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.493500 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.493111 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v947z\" (UniqueName: \"kubernetes.io/projected/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-kube-api-access-v947z\") pod \"cluster-samples-operator-79b7c55f87-4h9k2\" (UID: \"5cb507b3-c5cf-4cef-a3c3-d0168e3660da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" Jul 17 17:31:07.493500 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.493191 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb8b4834-5dba-4cce-b4f7-60407b1b05cc-trusted-ca\") pod \"console-operator-565b7b569d-qq5gg\" (UID: \"fb8b4834-5dba-4cce-b4f7-60407b1b05cc\") " pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:07.493500 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.493222 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-default-certificate\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.493500 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.493264 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-tmp-dir\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:07.493500 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.493293 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4hk5\" (UniqueName: \"kubernetes.io/projected/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-kube-api-access-l4hk5\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.493500 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.493334 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-ca-trust-extracted\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.493500 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.493341 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ccfd68b0-0222-4940-9793-f503e6edc300-snapshots\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.493500 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.493370 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccfd68b0-0222-4940-9793-f503e6edc300-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.493500 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.492761 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:31:07.493500 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.493371 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:31:07.493500 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.493398 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854d76f6cf-grgqm: secret "image-registry-tls" not found Jul 17 17:31:07.493500 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.493454 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-installation-pull-secrets\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.493500 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.493483 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.494137 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.493516 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtdk5\" (UniqueName: \"kubernetes.io/projected/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-kube-api-access-jtdk5\") pod \"cluster-monitoring-operator-76cf8966f8-gdq5z\" (UID: \"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:07.494137 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.494088 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-certificates\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.494589 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.494571 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 17:31:07.494795 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.494779 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs podName:3d528fdc-e45b-40e6-9e43-95633b1fa9d4 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:07.99475887 +0000 UTC m=+36.605428315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs") pod "router-default-56bc46498-h9pbn" (UID: "3d528fdc-e45b-40e6-9e43-95633b1fa9d4") : secret "router-metrics-certs-default" not found Jul 17 17:31:07.494918 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.494573 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-trusted-ca\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.495046 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.495019 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb8b4834-5dba-4cce-b4f7-60407b1b05cc-config\") pod \"console-operator-565b7b569d-qq5gg\" (UID: \"fb8b4834-5dba-4cce-b4f7-60407b1b05cc\") " pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:07.495157 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.495140 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls podName:6334beb9-4604-4aa0-ba7a-5c7d8aca63c7 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:07.99512224 +0000 UTC m=+36.605791669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gdq5z" (UID: "6334beb9-4604-4aa0-ba7a-5c7d8aca63c7") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:31:07.495245 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.495236 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls podName:4090d8a9-64ae-4803-a9ad-0e5eeb8b227b nodeName:}" failed. No retries permitted until 2026-07-17 17:31:07.995223548 +0000 UTC m=+36.605892928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls") pod "image-registry-854d76f6cf-grgqm" (UID: "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b") : secret "image-registry-tls" not found Jul 17 17:31:07.495368 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.495343 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccfd68b0-0222-4940-9793-f503e6edc300-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.497271 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.496190 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-gdq5z\" (UID: \"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:07.497271 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.496487 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ccfd68b0-0222-4940-9793-f503e6edc300-snapshots\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.497271 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.496638 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4cfa3866-cee4-4677-b24c-97c3b7839334-serving-cert\") pod \"service-ca-operator-5bcbc94c78-5g8wt\" (UID: \"4cfa3866-cee4-4677-b24c-97c3b7839334\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" Jul 17 17:31:07.497271 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.496873 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3398a5d5-1531-4672-906c-ce042e4d7eef-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-6jr7d\" (UID: \"3398a5d5-1531-4672-906c-ce042e4d7eef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" Jul 17 17:31:07.497271 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.496988 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle podName:3d528fdc-e45b-40e6-9e43-95633b1fa9d4 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:07.996972057 +0000 UTC m=+36.607641437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle") pod "router-default-56bc46498-h9pbn" (UID: "3d528fdc-e45b-40e6-9e43-95633b1fa9d4") : configmap references non-existent config key: service-ca.crt Jul 17 17:31:07.497271 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.496985 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-image-registry-private-configuration\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.497271 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.497143 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb8b4834-5dba-4cce-b4f7-60407b1b05cc-serving-cert\") pod \"console-operator-565b7b569d-qq5gg\" (UID: \"fb8b4834-5dba-4cce-b4f7-60407b1b05cc\") " pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:07.497710 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.497364 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-image-registry-private-configuration\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.497710 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.497373 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb8b4834-5dba-4cce-b4f7-60407b1b05cc-trusted-ca\") pod \"console-operator-565b7b569d-qq5gg\" (UID: \"fb8b4834-5dba-4cce-b4f7-60407b1b05cc\") " pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:07.498259 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.498234 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-installation-pull-secrets\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.498929 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.498901 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccfd68b0-0222-4940-9793-f503e6edc300-serving-cert\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.499067 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.499050 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-installation-pull-secrets\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.499197 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.499181 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-default-certificate\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.499298 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.499279 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-stats-auth\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.502014 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.501374 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wnck\" (UniqueName: \"kubernetes.io/projected/9ad046ee-5c2f-446b-b876-fa87394b9ed9-kube-api-access-5wnck\") pod \"network-check-source-7bc5b6bf85-n4qth\" (UID: \"9ad046ee-5c2f-446b-b876-fa87394b9ed9\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-n4qth" Jul 17 17:31:07.502321 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.502293 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z29hg\" (UniqueName: \"kubernetes.io/projected/6d78bf45-20a3-493b-bf56-0a4d930b8bb7-kube-api-access-z29hg\") pod \"volume-data-source-validator-78cf4c6f6-ghg86\" (UID: \"6d78bf45-20a3-493b-bf56-0a4d930b8bb7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ghg86" Jul 17 17:31:07.503033 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.502990 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtdk5\" (UniqueName: \"kubernetes.io/projected/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-kube-api-access-jtdk5\") pod \"cluster-monitoring-operator-76cf8966f8-gdq5z\" (UID: \"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:07.503600 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.503573 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4hk5\" (UniqueName: \"kubernetes.io/projected/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-kube-api-access-l4hk5\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.503708 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.503598 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwlwd\" (UniqueName: \"kubernetes.io/projected/4cfa3866-cee4-4677-b24c-97c3b7839334-kube-api-access-xwlwd\") pod \"service-ca-operator-5bcbc94c78-5g8wt\" (UID: \"4cfa3866-cee4-4677-b24c-97c3b7839334\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" Jul 17 17:31:07.504358 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.504333 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v947z\" (UniqueName: \"kubernetes.io/projected/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-kube-api-access-v947z\") pod \"cluster-samples-operator-79b7c55f87-4h9k2\" (UID: \"5cb507b3-c5cf-4cef-a3c3-d0168e3660da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" Jul 17 17:31:07.505007 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.504837 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xbsv\" (UniqueName: \"kubernetes.io/projected/3398a5d5-1531-4672-906c-ce042e4d7eef-kube-api-access-4xbsv\") pod \"kube-storage-version-migrator-operator-7658d9b749-6jr7d\" (UID: \"3398a5d5-1531-4672-906c-ce042e4d7eef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" Jul 17 17:31:07.505106 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.505077 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tzcp\" (UniqueName: \"kubernetes.io/projected/ccfd68b0-0222-4940-9793-f503e6edc300-kube-api-access-9tzcp\") pod \"insights-operator-555d9d7885-qlvv2\" (UID: \"ccfd68b0-0222-4940-9793-f503e6edc300\") " pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.505164 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.505099 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg7vx\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-kube-api-access-dg7vx\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.505491 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.505468 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-bound-sa-token\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.505826 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.505805 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgcdr\" (UniqueName: \"kubernetes.io/projected/fb8b4834-5dba-4cce-b4f7-60407b1b05cc-kube-api-access-cgcdr\") pod \"console-operator-565b7b569d-qq5gg\" (UID: \"fb8b4834-5dba-4cce-b4f7-60407b1b05cc\") " pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:07.506396 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.506372 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-757xm\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-kube-api-access-757xm\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.506511 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.506489 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-bound-sa-token\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.593486 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.593453 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-qlvv2" Jul 17 17:31:07.594769 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.594741 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-tmp-dir\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:07.594916 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.594805 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b79c6\" (UniqueName: \"kubernetes.io/projected/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-kube-api-access-b79c6\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:07.594916 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.594870 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:07.595052 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.595036 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:31:07.595112 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.595101 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-tmp-dir\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:07.595162 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.595126 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls podName:7be1d83f-e7e1-4051-bcbd-7c579ee86cd6 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:08.095105521 +0000 UTC m=+36.705774886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls") pod "dns-default-79kq8" (UID: "7be1d83f-e7e1-4051-bcbd-7c579ee86cd6") : secret "dns-default-metrics-tls" not found Jul 17 17:31:07.595162 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.595147 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpczh\" (UniqueName: \"kubernetes.io/projected/00e27498-09f4-464c-b08b-45a0b3cb2786-kube-api-access-qpczh\") pod \"ingress-canary-qb5g6\" (UID: \"00e27498-09f4-464c-b08b-45a0b3cb2786\") " pod="openshift-ingress-canary/ingress-canary-qb5g6" Jul 17 17:31:07.595262 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.595228 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-config-volume\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:07.595312 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.595268 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00e27498-09f4-464c-b08b-45a0b3cb2786-cert\") pod \"ingress-canary-qb5g6\" (UID: \"00e27498-09f4-464c-b08b-45a0b3cb2786\") " pod="openshift-ingress-canary/ingress-canary-qb5g6" Jul 17 17:31:07.595733 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.595712 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-config-volume\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:07.598161 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.598139 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00e27498-09f4-464c-b08b-45a0b3cb2786-cert\") pod \"ingress-canary-qb5g6\" (UID: \"00e27498-09f4-464c-b08b-45a0b3cb2786\") " pod="openshift-ingress-canary/ingress-canary-qb5g6" Jul 17 17:31:07.603762 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.603739 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b79c6\" (UniqueName: \"kubernetes.io/projected/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-kube-api-access-b79c6\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:07.603947 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.603924 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpczh\" (UniqueName: \"kubernetes.io/projected/00e27498-09f4-464c-b08b-45a0b3cb2786-kube-api-access-qpczh\") pod \"ingress-canary-qb5g6\" (UID: \"00e27498-09f4-464c-b08b-45a0b3cb2786\") " pod="openshift-ingress-canary/ingress-canary-qb5g6" Jul 17 17:31:07.613603 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.613582 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:07.628312 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.628284 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-n4qth" Jul 17 17:31:07.635656 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.635632 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" Jul 17 17:31:07.643301 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.643274 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" Jul 17 17:31:07.649521 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.649494 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ghg86" Jul 17 17:31:07.670808 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.670388 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qb5g6" Jul 17 17:31:07.872060 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.871884 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:31:07.881490 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.876622 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 17:31:07.899487 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.899461 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-qlvv2"] Jul 17 17:31:07.899606 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.899518 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-n4qth"] Jul 17 17:31:07.899606 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.899541 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-qq5gg"] Jul 17 17:31:07.903893 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.903320 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt"] Jul 17 17:31:07.919826 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.919759 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ghg86"] Jul 17 17:31:07.923854 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.923815 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d"] Jul 17 17:31:07.924771 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:31:07.924637 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d78bf45_20a3_493b_bf56_0a4d930b8bb7.slice/crio-f6ddb67b52985b467ffb8d36546ac5f9002ff798adf7eb7da28ceac4bb27faec WatchSource:0}: Error finding container f6ddb67b52985b467ffb8d36546ac5f9002ff798adf7eb7da28ceac4bb27faec: Status 404 returned error can't find the container with id f6ddb67b52985b467ffb8d36546ac5f9002ff798adf7eb7da28ceac4bb27faec Jul 17 17:31:07.928691 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:31:07.928650 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3398a5d5_1531_4672_906c_ce042e4d7eef.slice/crio-2f2055a36692ed28592027a06648535f8ac3136522814b6738693bab033e218a WatchSource:0}: Error finding container 2f2055a36692ed28592027a06648535f8ac3136522814b6738693bab033e218a: Status 404 returned error can't find the container with id 2f2055a36692ed28592027a06648535f8ac3136522814b6738693bab033e218a Jul 17 17:31:07.944100 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.944067 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qb5g6"] Jul 17 17:31:07.946890 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:31:07.946865 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e27498_09f4_464c_b08b_45a0b3cb2786.slice/crio-8ea4b52c4bbbfbfa52d53291e20d03c9ba517a3ea990b04e951fe668b3819ae0 WatchSource:0}: Error finding container 8ea4b52c4bbbfbfa52d53291e20d03c9ba517a3ea990b04e951fe668b3819ae0: Status 404 returned error can't find the container with id 8ea4b52c4bbbfbfa52d53291e20d03c9ba517a3ea990b04e951fe668b3819ae0 Jul 17 17:31:07.998898 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.998811 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.998898 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.998866 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gdq5z\" (UID: \"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:07.999121 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.998905 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:07.999121 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.998952 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4h9k2\" (UID: \"5cb507b3-c5cf-4cef-a3c3-d0168e3660da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" Jul 17 17:31:07.999121 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.998998 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle podName:3d528fdc-e45b-40e6-9e43-95633b1fa9d4 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:08.998976099 +0000 UTC m=+37.609645472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle") pod "router-default-56bc46498-h9pbn" (UID: "3d528fdc-e45b-40e6-9e43-95633b1fa9d4") : configmap references non-existent config key: service-ca.crt Jul 17 17:31:07.999121 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.999029 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:31:07.999121 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.999051 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:31:07.999121 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.999062 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:31:07.999121 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.999050 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:07.999121 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.999084 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644dd77dcb-5d5fk: secret "image-registry-tls" not found Jul 17 17:31:07.999121 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.999107 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:31:07.999121 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.999119 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854d76f6cf-grgqm: secret "image-registry-tls" not found Jul 17 17:31:07.999121 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.999071 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls podName:6334beb9-4604-4aa0-ba7a-5c7d8aca63c7 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:08.999058942 +0000 UTC m=+37.609728323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gdq5z" (UID: "6334beb9-4604-4aa0-ba7a-5c7d8aca63c7") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:31:07.999579 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.999169 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls podName:5cb507b3-c5cf-4cef-a3c3-d0168e3660da nodeName:}" failed. No retries permitted until 2026-07-17 17:31:08.999135783 +0000 UTC m=+37.609805146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4h9k2" (UID: "5cb507b3-c5cf-4cef-a3c3-d0168e3660da") : secret "samples-operator-tls" not found Jul 17 17:31:07.999579 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.999195 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls podName:c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d nodeName:}" failed. No retries permitted until 2026-07-17 17:31:08.999184773 +0000 UTC m=+37.609854138 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls") pod "image-registry-644dd77dcb-5d5fk" (UID: "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d") : secret "image-registry-tls" not found Jul 17 17:31:07.999579 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.999217 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls podName:4090d8a9-64ae-4803-a9ad-0e5eeb8b227b nodeName:}" failed. No retries permitted until 2026-07-17 17:31:08.999208281 +0000 UTC m=+37.609877652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls") pod "image-registry-854d76f6cf-grgqm" (UID: "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b") : secret "image-registry-tls" not found Jul 17 17:31:07.999579 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:07.999274 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:07.999579 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.999316 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 17:31:07.999579 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:07.999364 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs podName:3d528fdc-e45b-40e6-9e43-95633b1fa9d4 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:08.999348794 +0000 UTC m=+37.610018223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs") pod "router-default-56bc46498-h9pbn" (UID: "3d528fdc-e45b-40e6-9e43-95633b1fa9d4") : secret "router-metrics-certs-default" not found Jul 17 17:31:08.016997 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:08.016961 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" event={"ID":"fb8b4834-5dba-4cce-b4f7-60407b1b05cc","Type":"ContainerStarted","Data":"bb041766e46fce54af9adaf5923ea5cfe237d4eedc7678fa6b7500ef43442660"} Jul 17 17:31:08.018241 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:08.018215 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-qlvv2" event={"ID":"ccfd68b0-0222-4940-9793-f503e6edc300","Type":"ContainerStarted","Data":"503a048aae8d6dcc5c5a20352eaa2e43baed5eca10c840962e46b9e4f96b6bed"} Jul 17 17:31:08.019431 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:08.019368 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qb5g6" event={"ID":"00e27498-09f4-464c-b08b-45a0b3cb2786","Type":"ContainerStarted","Data":"8ea4b52c4bbbfbfa52d53291e20d03c9ba517a3ea990b04e951fe668b3819ae0"} Jul 17 17:31:08.020461 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:08.020433 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ghg86" event={"ID":"6d78bf45-20a3-493b-bf56-0a4d930b8bb7","Type":"ContainerStarted","Data":"f6ddb67b52985b467ffb8d36546ac5f9002ff798adf7eb7da28ceac4bb27faec"} Jul 17 17:31:08.021696 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:08.021657 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" event={"ID":"3398a5d5-1531-4672-906c-ce042e4d7eef","Type":"ContainerStarted","Data":"2f2055a36692ed28592027a06648535f8ac3136522814b6738693bab033e218a"} Jul 17 17:31:08.022754 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:08.022707 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" event={"ID":"4cfa3866-cee4-4677-b24c-97c3b7839334","Type":"ContainerStarted","Data":"5675d7d75196d7bc108f9eda720c88335cda2792c2e5237c61d7d87421c212af"} Jul 17 17:31:08.023819 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:08.023801 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-n4qth" event={"ID":"9ad046ee-5c2f-446b-b876-fa87394b9ed9","Type":"ContainerStarted","Data":"2a7c52a95541ddd312f86e174a1868443a34bc5348cc1bbfecd05cd7bce7c2a0"} Jul 17 17:31:08.100236 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:08.100201 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:08.100430 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:08.100321 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:31:08.100430 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:08.100389 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls podName:7be1d83f-e7e1-4051-bcbd-7c579ee86cd6 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:09.100370265 +0000 UTC m=+37.711039628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls") pod "dns-default-79kq8" (UID: "7be1d83f-e7e1-4051-bcbd-7c579ee86cd6") : secret "dns-default-metrics-tls" not found Jul 17 17:31:08.871978 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:08.871941 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:31:08.872431 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:08.872410 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:31:08.876992 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:08.876500 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 17:31:08.879619 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:08.879198 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fwmkw\"" Jul 17 17:31:08.879619 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:08.879443 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lgt4f\"" Jul 17 17:31:09.011275 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:09.009624 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:09.011275 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:09.009737 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:09.011275 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:09.009791 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gdq5z\" (UID: \"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:09.011275 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:09.009825 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:09.011275 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:09.009876 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4h9k2\" (UID: \"5cb507b3-c5cf-4cef-a3c3-d0168e3660da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" Jul 17 17:31:09.011275 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:09.009935 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:09.011275 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:09.010083 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:31:09.011275 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:09.010097 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854d76f6cf-grgqm: secret "image-registry-tls" not found Jul 17 17:31:09.011275 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:09.010153 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls podName:4090d8a9-64ae-4803-a9ad-0e5eeb8b227b nodeName:}" failed. No retries permitted until 2026-07-17 17:31:11.010133784 +0000 UTC m=+39.620803148 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls") pod "image-registry-854d76f6cf-grgqm" (UID: "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b") : secret "image-registry-tls" not found Jul 17 17:31:09.011275 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:09.010224 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 17:31:09.011275 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:09.010260 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs podName:3d528fdc-e45b-40e6-9e43-95633b1fa9d4 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:11.010248741 +0000 UTC m=+39.620918105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs") pod "router-default-56bc46498-h9pbn" (UID: "3d528fdc-e45b-40e6-9e43-95633b1fa9d4") : secret "router-metrics-certs-default" not found Jul 17 17:31:09.011275 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:09.010347 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle podName:3d528fdc-e45b-40e6-9e43-95633b1fa9d4 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:11.01032322 +0000 UTC m=+39.620992586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle") pod "router-default-56bc46498-h9pbn" (UID: "3d528fdc-e45b-40e6-9e43-95633b1fa9d4") : configmap references non-existent config key: service-ca.crt Jul 17 17:31:09.011275 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:09.010406 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:31:09.012309 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:09.010436 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls podName:6334beb9-4604-4aa0-ba7a-5c7d8aca63c7 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:11.010427577 +0000 UTC m=+39.621096940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gdq5z" (UID: "6334beb9-4604-4aa0-ba7a-5c7d8aca63c7") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:31:09.012309 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:09.010492 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:31:09.012309 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:09.010503 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644dd77dcb-5d5fk: secret "image-registry-tls" not found Jul 17 17:31:09.012309 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:09.010529 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls podName:c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d nodeName:}" failed. No retries permitted until 2026-07-17 17:31:11.010519958 +0000 UTC m=+39.621189324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls") pod "image-registry-644dd77dcb-5d5fk" (UID: "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d") : secret "image-registry-tls" not found Jul 17 17:31:09.012309 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:09.010580 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:31:09.012309 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:09.010610 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls podName:5cb507b3-c5cf-4cef-a3c3-d0168e3660da nodeName:}" failed. No retries permitted until 2026-07-17 17:31:11.010601314 +0000 UTC m=+39.621270679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4h9k2" (UID: "5cb507b3-c5cf-4cef-a3c3-d0168e3660da") : secret "samples-operator-tls" not found Jul 17 17:31:09.111352 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:09.111307 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:09.111670 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:09.111633 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:31:09.111778 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:09.111713 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls podName:7be1d83f-e7e1-4051-bcbd-7c579ee86cd6 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:11.111693286 +0000 UTC m=+39.722362713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls") pod "dns-default-79kq8" (UID: "7be1d83f-e7e1-4051-bcbd-7c579ee86cd6") : secret "dns-default-metrics-tls" not found Jul 17 17:31:11.032778 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:11.032653 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:11.032778 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:11.032738 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gdq5z\" (UID: \"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:11.033245 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:11.032875 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:31:11.033245 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:11.032951 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls podName:6334beb9-4604-4aa0-ba7a-5c7d8aca63c7 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:15.03293025 +0000 UTC m=+43.643599628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gdq5z" (UID: "6334beb9-4604-4aa0-ba7a-5c7d8aca63c7") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:31:11.033245 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:11.033047 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle podName:3d528fdc-e45b-40e6-9e43-95633b1fa9d4 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:15.033025653 +0000 UTC m=+43.643695032 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle") pod "router-default-56bc46498-h9pbn" (UID: "3d528fdc-e45b-40e6-9e43-95633b1fa9d4") : configmap references non-existent config key: service-ca.crt Jul 17 17:31:11.033245 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:11.033093 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:11.033245 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:11.033153 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4h9k2\" (UID: \"5cb507b3-c5cf-4cef-a3c3-d0168e3660da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" Jul 17 17:31:11.033245 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:11.033199 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:31:11.033245 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:11.033218 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644dd77dcb-5d5fk: secret "image-registry-tls" not found Jul 17 17:31:11.033564 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:11.033259 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls podName:c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d nodeName:}" failed. No retries permitted until 2026-07-17 17:31:15.033246423 +0000 UTC m=+43.643915789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls") pod "image-registry-644dd77dcb-5d5fk" (UID: "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d") : secret "image-registry-tls" not found Jul 17 17:31:11.033564 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:11.033200 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:11.033564 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:11.033280 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:31:11.033564 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:11.033293 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854d76f6cf-grgqm: secret "image-registry-tls" not found Jul 17 17:31:11.033564 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:11.033326 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:11.033564 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:11.033338 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls podName:4090d8a9-64ae-4803-a9ad-0e5eeb8b227b nodeName:}" failed. No retries permitted until 2026-07-17 17:31:15.033315592 +0000 UTC m=+43.643984959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls") pod "image-registry-854d76f6cf-grgqm" (UID: "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b") : secret "image-registry-tls" not found Jul 17 17:31:11.033564 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:11.033352 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:31:11.033564 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:11.033392 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 17:31:11.033564 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:11.033394 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls podName:5cb507b3-c5cf-4cef-a3c3-d0168e3660da nodeName:}" failed. No retries permitted until 2026-07-17 17:31:15.033381749 +0000 UTC m=+43.644051115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4h9k2" (UID: "5cb507b3-c5cf-4cef-a3c3-d0168e3660da") : secret "samples-operator-tls" not found Jul 17 17:31:11.033564 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:11.033438 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs podName:3d528fdc-e45b-40e6-9e43-95633b1fa9d4 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:15.033426849 +0000 UTC m=+43.644096212 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs") pod "router-default-56bc46498-h9pbn" (UID: "3d528fdc-e45b-40e6-9e43-95633b1fa9d4") : secret "router-metrics-certs-default" not found Jul 17 17:31:11.134215 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:11.134160 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:11.134515 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:11.134477 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:31:11.134641 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:11.134596 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls podName:7be1d83f-e7e1-4051-bcbd-7c579ee86cd6 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:15.134573679 +0000 UTC m=+43.745243044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls") pod "dns-default-79kq8" (UID: "7be1d83f-e7e1-4051-bcbd-7c579ee86cd6") : secret "dns-default-metrics-tls" not found Jul 17 17:31:12.442756 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:12.442664 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:12.537348 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:12.537315 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:15.071856 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:15.071821 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4h9k2\" (UID: \"5cb507b3-c5cf-4cef-a3c3-d0168e3660da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" Jul 17 17:31:15.072314 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:15.071877 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:15.072314 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:15.071911 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:15.072314 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:15.071961 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:15.072314 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:15.071978 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:31:15.072314 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:15.071993 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gdq5z\" (UID: \"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:15.072314 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:15.072020 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:15.072314 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:15.072058 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls podName:5cb507b3-c5cf-4cef-a3c3-d0168e3660da nodeName:}" failed. No retries permitted until 2026-07-17 17:31:23.072035258 +0000 UTC m=+51.682704617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4h9k2" (UID: "5cb507b3-c5cf-4cef-a3c3-d0168e3660da") : secret "samples-operator-tls" not found Jul 17 17:31:15.072314 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:15.072068 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 17:31:15.072314 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:15.072106 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:31:15.072314 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:15.072112 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:31:15.072314 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:15.072072 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:31:15.072314 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:15.072163 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854d76f6cf-grgqm: secret "image-registry-tls" not found Jul 17 17:31:15.072314 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:15.072107 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle podName:3d528fdc-e45b-40e6-9e43-95633b1fa9d4 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:23.072094816 +0000 UTC m=+51.682764191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle") pod "router-default-56bc46498-h9pbn" (UID: "3d528fdc-e45b-40e6-9e43-95633b1fa9d4") : configmap references non-existent config key: service-ca.crt Jul 17 17:31:15.072314 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:15.072118 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644dd77dcb-5d5fk: secret "image-registry-tls" not found Jul 17 17:31:15.072314 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:15.072234 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs podName:3d528fdc-e45b-40e6-9e43-95633b1fa9d4 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:23.072197109 +0000 UTC m=+51.682866475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs") pod "router-default-56bc46498-h9pbn" (UID: "3d528fdc-e45b-40e6-9e43-95633b1fa9d4") : secret "router-metrics-certs-default" not found Jul 17 17:31:15.072822 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:15.072260 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls podName:6334beb9-4604-4aa0-ba7a-5c7d8aca63c7 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:23.072250069 +0000 UTC m=+51.682919434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gdq5z" (UID: "6334beb9-4604-4aa0-ba7a-5c7d8aca63c7") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:31:15.072822 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:15.072275 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls podName:4090d8a9-64ae-4803-a9ad-0e5eeb8b227b nodeName:}" failed. No retries permitted until 2026-07-17 17:31:23.072267891 +0000 UTC m=+51.682937256 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls") pod "image-registry-854d76f6cf-grgqm" (UID: "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b") : secret "image-registry-tls" not found Jul 17 17:31:15.072822 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:15.072289 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls podName:c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d nodeName:}" failed. No retries permitted until 2026-07-17 17:31:23.072281695 +0000 UTC m=+51.682951055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls") pod "image-registry-644dd77dcb-5d5fk" (UID: "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d") : secret "image-registry-tls" not found Jul 17 17:31:15.172887 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:15.172850 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:15.173042 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:15.173016 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:31:15.173123 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:15.173107 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls podName:7be1d83f-e7e1-4051-bcbd-7c579ee86cd6 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:23.173069225 +0000 UTC m=+51.783738601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls") pod "dns-default-79kq8" (UID: "7be1d83f-e7e1-4051-bcbd-7c579ee86cd6") : secret "dns-default-metrics-tls" not found Jul 17 17:31:18.060620 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.059986 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qb5g6" event={"ID":"00e27498-09f4-464c-b08b-45a0b3cb2786","Type":"ContainerStarted","Data":"4aeb3ba380c6b36b08d09081105e5507496c4f6a760473efc07e34a690998ae8"} Jul 17 17:31:18.063224 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.062779 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ghg86" event={"ID":"6d78bf45-20a3-493b-bf56-0a4d930b8bb7","Type":"ContainerStarted","Data":"fe8dfdbdc2ce5ee25d1c9170e9d04162a9513f840634dbb7c90622f19da68ebc"} Jul 17 17:31:18.066708 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.066600 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" event={"ID":"3398a5d5-1531-4672-906c-ce042e4d7eef","Type":"ContainerStarted","Data":"cf5c1eb5a1f97e7c14a32342c4e721ab08c7e43d0b62cdfd806496a5fa81f9a3"} Jul 17 17:31:18.070778 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.070334 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" event={"ID":"4cfa3866-cee4-4677-b24c-97c3b7839334","Type":"ContainerStarted","Data":"f7ea8405bd899efaabed0ce8f7acb762d8ab787e171666afa409c03dbca988b6"} Jul 17 17:31:18.072866 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.072459 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-n4qth" event={"ID":"9ad046ee-5c2f-446b-b876-fa87394b9ed9","Type":"ContainerStarted","Data":"85460427e7fe0ecf87b9190c09e16f59a20c40afef26dab8cb6e1bd4bede5a93"} Jul 17 17:31:18.074954 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.074933 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/0.log" Jul 17 17:31:18.075037 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.074972 2557 generic.go:356] "Generic (PLEG): container finished" podID="fb8b4834-5dba-4cce-b4f7-60407b1b05cc" containerID="66ccf0eeaad1d34b7ec6ce3ede5e4e4a54ecc2c959246cac2afec218165370cb" exitCode=255 Jul 17 17:31:18.075099 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.075044 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" event={"ID":"fb8b4834-5dba-4cce-b4f7-60407b1b05cc","Type":"ContainerDied","Data":"66ccf0eeaad1d34b7ec6ce3ede5e4e4a54ecc2c959246cac2afec218165370cb"} Jul 17 17:31:18.075368 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.075331 2557 scope.go:117] "RemoveContainer" containerID="66ccf0eeaad1d34b7ec6ce3ede5e4e4a54ecc2c959246cac2afec218165370cb" Jul 17 17:31:18.077706 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.076945 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-qlvv2" event={"ID":"ccfd68b0-0222-4940-9793-f503e6edc300","Type":"ContainerStarted","Data":"68f7f5e3d5f4e44216791e5b423be834f788c0ddacea683b561c6a5234c10de5"} Jul 17 17:31:18.081722 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.079771 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qb5g6" podStartSLOduration=1.444059588 podStartE2EDuration="11.079663972s" totalImagesPullingTime="9.635604384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:18.077616357 +0000 UTC m=+46.688285740" watchObservedRunningTime="2026-07-17 17:31:18.079663972 +0000 UTC m=+46.690333353" Jul 17 17:31:18.084039 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.083443 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bpqj" event={"ID":"6ce16731-5297-45af-9b0e-9aaf4a8dedb4","Type":"ContainerStarted","Data":"3e69fb7f1c538790ac1540dc3e8987fa9332db2cb7d679d7c89ff456ce9184c1"} Jul 17 17:31:18.132425 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.132371 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-n4qth" podStartSLOduration=3.441408925 podStartE2EDuration="13.132353201s" totalImagesPullingTime="9.690944276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:18.098744831 +0000 UTC m=+46.709414215" watchObservedRunningTime="2026-07-17 17:31:18.132353201 +0000 UTC m=+46.743022588" Jul 17 17:31:18.152238 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.152170 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-qlvv2" podStartSLOduration=14.46530888 podStartE2EDuration="24.152148018s" totalImagesPullingTime="9.686839138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:18.133653583 +0000 UTC m=+46.744322957" watchObservedRunningTime="2026-07-17 17:31:18.152148018 +0000 UTC m=+46.762817401" Jul 17 17:31:18.168545 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.168483 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" podStartSLOduration=4.496795701 podStartE2EDuration="14.168468413s" totalImagesPullingTime="9.671672712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:18.167320307 +0000 UTC m=+46.777989691" watchObservedRunningTime="2026-07-17 17:31:18.168468413 +0000 UTC m=+46.779137797" Jul 17 17:31:18.186567 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.185488 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" podStartSLOduration=4.533206259 podStartE2EDuration="14.18546867s" totalImagesPullingTime="9.652262411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:18.184854243 +0000 UTC m=+46.795523626" watchObservedRunningTime="2026-07-17 17:31:18.18546867 +0000 UTC m=+46.796138054" Jul 17 17:31:18.235246 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.234868 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ghg86" podStartSLOduration=9.578313733 podStartE2EDuration="19.234847174s" totalImagesPullingTime="9.656533441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:18.203377362 +0000 UTC m=+46.814046745" watchObservedRunningTime="2026-07-17 17:31:18.234847174 +0000 UTC m=+46.845516558" Jul 17 17:31:18.317929 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.317897 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:18.397920 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:18.397884 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:19.034858 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.034768 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jg62z"] Jul 17 17:31:19.037752 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.037671 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:19.076106 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.076069 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jg62z"] Jul 17 17:31:19.076528 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.076225 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.078280 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.078258 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 17:31:19.078421 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.078347 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 17:31:19.078421 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.078361 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7jwcc\"" Jul 17 17:31:19.089481 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.089455 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 17:31:19.089982 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.089947 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/0.log" Jul 17 17:31:19.090078 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.090008 2557 generic.go:356] "Generic (PLEG): container finished" podID="fb8b4834-5dba-4cce-b4f7-60407b1b05cc" containerID="b682e1576734df3f2854ed12c199256bc8f752e00f69525d6273b7f8b78a3c70" exitCode=255 Jul 17 17:31:19.090144 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.090090 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" event={"ID":"fb8b4834-5dba-4cce-b4f7-60407b1b05cc","Type":"ContainerDied","Data":"b682e1576734df3f2854ed12c199256bc8f752e00f69525d6273b7f8b78a3c70"} Jul 17 17:31:19.090197 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.090141 2557 scope.go:117] "RemoveContainer" containerID="66ccf0eeaad1d34b7ec6ce3ede5e4e4a54ecc2c959246cac2afec218165370cb" Jul 17 17:31:19.090434 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.090417 2557 scope.go:117] "RemoveContainer" containerID="b682e1576734df3f2854ed12c199256bc8f752e00f69525d6273b7f8b78a3c70" Jul 17 17:31:19.090615 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:19.090593 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-qq5gg_openshift-console-operator(fb8b4834-5dba-4cce-b4f7-60407b1b05cc)\"" pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" podUID="fb8b4834-5dba-4cce-b4f7-60407b1b05cc" Jul 17 17:31:19.094814 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.094773 2557 generic.go:356] "Generic (PLEG): container finished" podID="6ce16731-5297-45af-9b0e-9aaf4a8dedb4" containerID="3e69fb7f1c538790ac1540dc3e8987fa9332db2cb7d679d7c89ff456ce9184c1" exitCode=0 Jul 17 17:31:19.094814 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.094802 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bpqj" event={"ID":"6ce16731-5297-45af-9b0e-9aaf4a8dedb4","Type":"ContainerDied","Data":"3e69fb7f1c538790ac1540dc3e8987fa9332db2cb7d679d7c89ff456ce9184c1"} Jul 17 17:31:19.107974 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.107944 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.108184 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.108165 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2fce1ae6-eff2-4165-8a96-d5dc0521d595-crio-socket\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.108406 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.108390 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fce1ae6-eff2-4165-8a96-d5dc0521d595-data-volume\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.108926 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.108889 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.109610 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.109519 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrt9n\" (UniqueName: \"kubernetes.io/projected/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-api-access-jrt9n\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.112584 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.112550 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:19.210027 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.209994 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrt9n\" (UniqueName: \"kubernetes.io/projected/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-api-access-jrt9n\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.210173 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.210114 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.210173 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.210160 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2fce1ae6-eff2-4165-8a96-d5dc0521d595-crio-socket\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.210299 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:19.210272 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 17:31:19.210299 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.210287 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fce1ae6-eff2-4165-8a96-d5dc0521d595-data-volume\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.210393 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.210342 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2fce1ae6-eff2-4165-8a96-d5dc0521d595-crio-socket\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.210393 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:19.210360 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-rbac-proxy-cm podName:2fce1ae6-eff2-4165-8a96-d5dc0521d595 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:19.710339809 +0000 UTC m=+48.321009183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jg62z" (UID: "2fce1ae6-eff2-4165-8a96-d5dc0521d595") : configmap "kube-rbac-proxy" not found Jul 17 17:31:19.210732 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.210567 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.210732 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:19.210715 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:31:19.210865 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:19.210766 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls podName:2fce1ae6-eff2-4165-8a96-d5dc0521d595 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:19.710750524 +0000 UTC m=+48.321419891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jg62z" (UID: "2fce1ae6-eff2-4165-8a96-d5dc0521d595") : secret "insights-runtime-extractor-tls" not found Jul 17 17:31:19.210905 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.210891 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fce1ae6-eff2-4165-8a96-d5dc0521d595-data-volume\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.219324 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.219299 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrt9n\" (UniqueName: \"kubernetes.io/projected/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-api-access-jrt9n\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.347835 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.347806 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:19.406940 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.406905 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrlns"] Jul 17 17:31:19.421227 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.421205 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrlns"] Jul 17 17:31:19.421396 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.421295 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrlns" Jul 17 17:31:19.424152 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.423728 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 17 17:31:19.424152 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.424074 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lf796\"" Jul 17 17:31:19.424339 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.424320 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 17 17:31:19.444336 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.444304 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:19.513363 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.513326 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnmdd\" (UniqueName: \"kubernetes.io/projected/007ed456-188c-4c58-bc14-8e4b0d3806aa-kube-api-access-dnmdd\") pod \"migrator-7cc9c7ffd7-mrlns\" (UID: \"007ed456-188c-4c58-bc14-8e4b0d3806aa\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrlns" Jul 17 17:31:19.541834 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.541794 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:19.614144 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.614116 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnmdd\" (UniqueName: \"kubernetes.io/projected/007ed456-188c-4c58-bc14-8e4b0d3806aa-kube-api-access-dnmdd\") pod \"migrator-7cc9c7ffd7-mrlns\" (UID: \"007ed456-188c-4c58-bc14-8e4b0d3806aa\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrlns" Jul 17 17:31:19.622061 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.622036 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnmdd\" (UniqueName: \"kubernetes.io/projected/007ed456-188c-4c58-bc14-8e4b0d3806aa-kube-api-access-dnmdd\") pod \"migrator-7cc9c7ffd7-mrlns\" (UID: \"007ed456-188c-4c58-bc14-8e4b0d3806aa\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrlns" Jul 17 17:31:19.715463 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.715431 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.715632 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:19.715570 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 17:31:19.715724 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:19.715643 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-rbac-proxy-cm podName:2fce1ae6-eff2-4165-8a96-d5dc0521d595 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:20.71562231 +0000 UTC m=+49.326291683 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jg62z" (UID: "2fce1ae6-eff2-4165-8a96-d5dc0521d595") : configmap "kube-rbac-proxy" not found Jul 17 17:31:19.715800 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.715715 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:19.715853 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:19.715844 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:31:19.715911 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:19.715894 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls podName:2fce1ae6-eff2-4165-8a96-d5dc0521d595 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:20.715880834 +0000 UTC m=+49.326550196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jg62z" (UID: "2fce1ae6-eff2-4165-8a96-d5dc0521d595") : secret "insights-runtime-extractor-tls" not found Jul 17 17:31:19.726190 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.726154 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:19.731801 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.731783 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrlns" Jul 17 17:31:19.830482 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.830375 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:19.883860 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.883792 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrlns"] Jul 17 17:31:19.886775 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:31:19.886733 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod007ed456_188c_4c58_bc14_8e4b0d3806aa.slice/crio-bdbeda24fa7b56f8ae3519e8491e75bbdc8b9666eb6816d9cf60355ea951e4ab WatchSource:0}: Error finding container bdbeda24fa7b56f8ae3519e8491e75bbdc8b9666eb6816d9cf60355ea951e4ab: Status 404 returned error can't find the container with id bdbeda24fa7b56f8ae3519e8491e75bbdc8b9666eb6816d9cf60355ea951e4ab Jul 17 17:31:19.932479 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:19.932446 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:20.039934 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:20.039908 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lk5gp_19e37a6a-c87e-4fdc-b7e3-a077511a962e/dns-node-resolver/0.log" Jul 17 17:31:20.043899 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:20.043873 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:20.099657 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:20.099621 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrlns" event={"ID":"007ed456-188c-4c58-bc14-8e4b0d3806aa","Type":"ContainerStarted","Data":"bdbeda24fa7b56f8ae3519e8491e75bbdc8b9666eb6816d9cf60355ea951e4ab"} Jul 17 17:31:20.101109 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:20.101084 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 17:31:20.101501 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:20.101481 2557 scope.go:117] "RemoveContainer" containerID="b682e1576734df3f2854ed12c199256bc8f752e00f69525d6273b7f8b78a3c70" Jul 17 17:31:20.101703 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:20.101666 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-qq5gg_openshift-console-operator(fb8b4834-5dba-4cce-b4f7-60407b1b05cc)\"" pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" podUID="fb8b4834-5dba-4cce-b4f7-60407b1b05cc" Jul 17 17:31:20.104252 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:20.104229 2557 generic.go:356] "Generic (PLEG): container finished" podID="6ce16731-5297-45af-9b0e-9aaf4a8dedb4" containerID="3b5c19cbd9655fc8cc9bc657b46861e08fdafbbc36edc5ee91d8d5ca26391ea9" exitCode=0 Jul 17 17:31:20.104337 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:20.104275 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bpqj" event={"ID":"6ce16731-5297-45af-9b0e-9aaf4a8dedb4","Type":"ContainerDied","Data":"3b5c19cbd9655fc8cc9bc657b46861e08fdafbbc36edc5ee91d8d5ca26391ea9"} Jul 17 17:31:20.121625 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:20.121601 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:20.186564 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:20.186528 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:20.638925 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:20.638898 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mpdl4_95be5822-5b78-4e56-aae0-9c8ad4a8ecd7/node-ca/0.log" Jul 17 17:31:20.726109 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:20.726068 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:20.726296 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:20.726260 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:31:20.726346 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:20.726298 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:20.726388 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:20.726344 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls podName:2fce1ae6-eff2-4165-8a96-d5dc0521d595 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:22.726324611 +0000 UTC m=+51.336993985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jg62z" (UID: "2fce1ae6-eff2-4165-8a96-d5dc0521d595") : secret "insights-runtime-extractor-tls" not found Jul 17 17:31:20.726543 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:20.726518 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 17:31:20.726709 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:20.726575 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-rbac-proxy-cm podName:2fce1ae6-eff2-4165-8a96-d5dc0521d595 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:22.726562205 +0000 UTC m=+51.337231576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jg62z" (UID: "2fce1ae6-eff2-4165-8a96-d5dc0521d595") : configmap "kube-rbac-proxy" not found Jul 17 17:31:20.818214 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:20.818183 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:20.884155 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:20.884109 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:21.037239 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.037167 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qb5g6_00e27498-09f4-464c-b08b-45a0b3cb2786/serve-healthcheck-canary/0.log" Jul 17 17:31:21.111321 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.111289 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6bpqj" event={"ID":"6ce16731-5297-45af-9b0e-9aaf4a8dedb4","Type":"ContainerStarted","Data":"bc4084f9e0a909aded9886b1dcf51a2c6a10a382af71aef60e6b26dfe2d871c0"} Jul 17 17:31:21.136160 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.136087 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6bpqj" podStartSLOduration=8.890845524 podStartE2EDuration="49.136066622s" totalImagesPullingTime="40.245221098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:30:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:21.13572997 +0000 UTC m=+49.746399352" watchObservedRunningTime="2026-07-17 17:31:21.136066622 +0000 UTC m=+49.746736005" Jul 17 17:31:21.221294 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.221264 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:21.321273 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.321195 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:21.334197 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.334174 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-9h8kn"] Jul 17 17:31:21.347399 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.347368 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-9h8kn"] Jul 17 17:31:21.347518 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.347459 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-9h8kn" Jul 17 17:31:21.352308 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.352288 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 17 17:31:21.352627 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.352593 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-v7jqf\"" Jul 17 17:31:21.352812 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.352797 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 17 17:31:21.353252 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.353234 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 17 17:31:21.362359 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.362340 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 17 17:31:21.433794 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.433759 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f3a7a8a4-d6a2-406b-9d55-40afb270b211-signing-cabundle\") pod \"service-ca-58598695f7-9h8kn\" (UID: \"f3a7a8a4-d6a2-406b-9d55-40afb270b211\") " pod="openshift-service-ca/service-ca-58598695f7-9h8kn" Jul 17 17:31:21.433794 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.433795 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f3a7a8a4-d6a2-406b-9d55-40afb270b211-signing-key\") pod \"service-ca-58598695f7-9h8kn\" (UID: \"f3a7a8a4-d6a2-406b-9d55-40afb270b211\") " pod="openshift-service-ca/service-ca-58598695f7-9h8kn" Jul 17 17:31:21.433987 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.433826 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drz69\" (UniqueName: \"kubernetes.io/projected/f3a7a8a4-d6a2-406b-9d55-40afb270b211-kube-api-access-drz69\") pod \"service-ca-58598695f7-9h8kn\" (UID: \"f3a7a8a4-d6a2-406b-9d55-40afb270b211\") " pod="openshift-service-ca/service-ca-58598695f7-9h8kn" Jul 17 17:31:21.434562 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.434537 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:21.515769 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.515737 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:21.534819 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.534790 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f3a7a8a4-d6a2-406b-9d55-40afb270b211-signing-cabundle\") pod \"service-ca-58598695f7-9h8kn\" (UID: \"f3a7a8a4-d6a2-406b-9d55-40afb270b211\") " pod="openshift-service-ca/service-ca-58598695f7-9h8kn" Jul 17 17:31:21.534819 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.534821 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f3a7a8a4-d6a2-406b-9d55-40afb270b211-signing-key\") pod \"service-ca-58598695f7-9h8kn\" (UID: \"f3a7a8a4-d6a2-406b-9d55-40afb270b211\") " pod="openshift-service-ca/service-ca-58598695f7-9h8kn" Jul 17 17:31:21.534978 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.534850 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drz69\" (UniqueName: \"kubernetes.io/projected/f3a7a8a4-d6a2-406b-9d55-40afb270b211-kube-api-access-drz69\") pod \"service-ca-58598695f7-9h8kn\" (UID: \"f3a7a8a4-d6a2-406b-9d55-40afb270b211\") " pod="openshift-service-ca/service-ca-58598695f7-9h8kn" Jul 17 17:31:21.535610 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.535591 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f3a7a8a4-d6a2-406b-9d55-40afb270b211-signing-cabundle\") pod \"service-ca-58598695f7-9h8kn\" (UID: \"f3a7a8a4-d6a2-406b-9d55-40afb270b211\") " pod="openshift-service-ca/service-ca-58598695f7-9h8kn" Jul 17 17:31:21.537153 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.537136 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f3a7a8a4-d6a2-406b-9d55-40afb270b211-signing-key\") pod \"service-ca-58598695f7-9h8kn\" (UID: \"f3a7a8a4-d6a2-406b-9d55-40afb270b211\") " pod="openshift-service-ca/service-ca-58598695f7-9h8kn" Jul 17 17:31:21.544885 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.544861 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drz69\" (UniqueName: \"kubernetes.io/projected/f3a7a8a4-d6a2-406b-9d55-40afb270b211-kube-api-access-drz69\") pod \"service-ca-58598695f7-9h8kn\" (UID: \"f3a7a8a4-d6a2-406b-9d55-40afb270b211\") " pod="openshift-service-ca/service-ca-58598695f7-9h8kn" Jul 17 17:31:21.657119 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.657081 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-9h8kn" Jul 17 17:31:21.800797 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:21.800773 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-9h8kn"] Jul 17 17:31:21.803389 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:31:21.803362 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a7a8a4_d6a2_406b_9d55_40afb270b211.slice/crio-7ac94567507fa24874f34e9c82feb48588f53e3e0e5dae8bd346a62b8d7e3afb WatchSource:0}: Error finding container 7ac94567507fa24874f34e9c82feb48588f53e3e0e5dae8bd346a62b8d7e3afb: Status 404 returned error can't find the container with id 7ac94567507fa24874f34e9c82feb48588f53e3e0e5dae8bd346a62b8d7e3afb Jul 17 17:31:22.027196 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:22.027162 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:22.116414 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:22.116383 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-9h8kn" event={"ID":"f3a7a8a4-d6a2-406b-9d55-40afb270b211","Type":"ContainerStarted","Data":"a42e430702044ac56de6014c28796b594b406d814368e4471a7690c119f6d2d7"} Jul 17 17:31:22.116871 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:22.116441 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-9h8kn" event={"ID":"f3a7a8a4-d6a2-406b-9d55-40afb270b211","Type":"ContainerStarted","Data":"7ac94567507fa24874f34e9c82feb48588f53e3e0e5dae8bd346a62b8d7e3afb"} Jul 17 17:31:22.118234 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:22.118209 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrlns" event={"ID":"007ed456-188c-4c58-bc14-8e4b0d3806aa","Type":"ContainerStarted","Data":"8a2d1edfd92abf7274d667897f12c059961a428cba5cc0d761d6d3a90527782a"} Jul 17 17:31:22.118353 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:22.118260 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrlns" event={"ID":"007ed456-188c-4c58-bc14-8e4b0d3806aa","Type":"ContainerStarted","Data":"f1cf583bb46f13abff3a4044441faa2c129335067084699225d53f88286ba0fd"} Jul 17 17:31:22.122630 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:22.122598 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:22.134989 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:22.134948 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-9h8kn" podStartSLOduration=1.134930398 podStartE2EDuration="1.134930398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:22.133796108 +0000 UTC m=+50.744465490" watchObservedRunningTime="2026-07-17 17:31:22.134930398 +0000 UTC m=+50.745599758" Jul 17 17:31:22.152981 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:22.152931 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrlns" podStartSLOduration=1.380273772 podStartE2EDuration="3.15291677s" totalImagesPullingTime="1.772642998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:22.151864657 +0000 UTC m=+50.762534040" watchObservedRunningTime="2026-07-17 17:31:22.15291677 +0000 UTC m=+50.763586152" Jul 17 17:31:22.427872 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:22.427825 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:22.505096 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:22.505055 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:22.746432 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:22.746334 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:22.746611 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:22.746450 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:22.746611 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:22.746519 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:31:22.746611 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:22.746546 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 17:31:22.746611 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:22.746599 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls podName:2fce1ae6-eff2-4165-8a96-d5dc0521d595 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:26.74657883 +0000 UTC m=+55.357248196 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jg62z" (UID: "2fce1ae6-eff2-4165-8a96-d5dc0521d595") : secret "insights-runtime-extractor-tls" not found Jul 17 17:31:22.746611 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:22.746615 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-rbac-proxy-cm podName:2fce1ae6-eff2-4165-8a96-d5dc0521d595 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:26.746608446 +0000 UTC m=+55.357277805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jg62z" (UID: "2fce1ae6-eff2-4165-8a96-d5dc0521d595") : configmap "kube-rbac-proxy" not found Jul 17 17:31:23.150566 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:23.150534 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:23.151055 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:23.150590 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:23.151055 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:23.150655 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:23.151055 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:23.150717 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gdq5z\" (UID: \"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:23.151055 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:23.150729 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:31:23.151055 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:23.150745 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854d76f6cf-grgqm: secret "image-registry-tls" not found Jul 17 17:31:23.151055 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:23.150762 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:23.151055 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:23.150787 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 17:31:23.151055 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:23.150812 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls podName:4090d8a9-64ae-4803-a9ad-0e5eeb8b227b nodeName:}" failed. No retries permitted until 2026-07-17 17:31:39.150794113 +0000 UTC m=+67.761463493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls") pod "image-registry-854d76f6cf-grgqm" (UID: "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b") : secret "image-registry-tls" not found Jul 17 17:31:23.151055 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:23.150848 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs podName:3d528fdc-e45b-40e6-9e43-95633b1fa9d4 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:39.150829303 +0000 UTC m=+67.761498679 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs") pod "router-default-56bc46498-h9pbn" (UID: "3d528fdc-e45b-40e6-9e43-95633b1fa9d4") : secret "router-metrics-certs-default" not found Jul 17 17:31:23.151055 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:23.150853 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:31:23.151055 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:23.150865 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644dd77dcb-5d5fk: secret "image-registry-tls" not found Jul 17 17:31:23.151055 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:23.150888 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:31:23.151055 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:23.150896 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls podName:c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d nodeName:}" failed. No retries permitted until 2026-07-17 17:31:39.150885854 +0000 UTC m=+67.761555244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls") pod "image-registry-644dd77dcb-5d5fk" (UID: "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d") : secret "image-registry-tls" not found Jul 17 17:31:23.151055 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:23.150969 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle podName:3d528fdc-e45b-40e6-9e43-95633b1fa9d4 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:39.150953578 +0000 UTC m=+67.761622943 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle") pod "router-default-56bc46498-h9pbn" (UID: "3d528fdc-e45b-40e6-9e43-95633b1fa9d4") : configmap references non-existent config key: service-ca.crt Jul 17 17:31:23.151631 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:23.151008 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls podName:6334beb9-4604-4aa0-ba7a-5c7d8aca63c7 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:39.150983765 +0000 UTC m=+67.761653139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gdq5z" (UID: "6334beb9-4604-4aa0-ba7a-5c7d8aca63c7") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:31:23.151631 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:23.151061 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4h9k2\" (UID: \"5cb507b3-c5cf-4cef-a3c3-d0168e3660da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" Jul 17 17:31:23.151631 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:23.151094 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:31:23.151631 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:23.151129 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls podName:5cb507b3-c5cf-4cef-a3c3-d0168e3660da nodeName:}" failed. No retries permitted until 2026-07-17 17:31:39.151121338 +0000 UTC m=+67.761790698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4h9k2" (UID: "5cb507b3-c5cf-4cef-a3c3-d0168e3660da") : secret "samples-operator-tls" not found Jul 17 17:31:23.252138 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:23.252102 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:23.252329 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:23.252245 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:31:23.252329 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:23.252325 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls podName:7be1d83f-e7e1-4051-bcbd-7c579ee86cd6 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:39.25230493 +0000 UTC m=+67.862974296 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls") pod "dns-default-79kq8" (UID: "7be1d83f-e7e1-4051-bcbd-7c579ee86cd6") : secret "dns-default-metrics-tls" not found Jul 17 17:31:23.728850 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:23.728807 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:23.857981 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:23.857944 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:23.945062 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:23.945005 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:24.049329 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:24.049240 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:24.198910 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:24.198873 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:24.299151 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:24.299109 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:24.371510 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:24.371472 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:24.700044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:24.699925 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:24.846273 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:24.846238 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:25.307770 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:25.307737 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:25.738999 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:25.738950 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:26.097408 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:26.097365 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:26.298973 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:26.298942 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:26.783415 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:26.783382 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:26.783794 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:26.783461 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:26.783794 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:26.783553 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:31:26.783794 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:26.783622 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls podName:2fce1ae6-eff2-4165-8a96-d5dc0521d595 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:34.783606954 +0000 UTC m=+63.394276334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jg62z" (UID: "2fce1ae6-eff2-4165-8a96-d5dc0521d595") : secret "insights-runtime-extractor-tls" not found Jul 17 17:31:26.783941 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:26.783925 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fce1ae6-eff2-4165-8a96-d5dc0521d595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:26.896639 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:26.896604 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:27.300132 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:27.300091 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:27.493340 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:27.493310 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:27.543790 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:27.543751 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:27.614326 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:27.614290 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:27.614532 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:27.614377 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:27.614737 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:27.614724 2557 scope.go:117] "RemoveContainer" containerID="b682e1576734df3f2854ed12c199256bc8f752e00f69525d6273b7f8b78a3c70" Jul 17 17:31:27.614900 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:27.614881 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-qq5gg_openshift-console-operator(fb8b4834-5dba-4cce-b4f7-60407b1b05cc)\"" pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" podUID="fb8b4834-5dba-4cce-b4f7-60407b1b05cc" Jul 17 17:31:28.121908 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:28.121858 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:28.223226 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:28.223189 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:28.496231 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:28.496145 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:28.597198 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:28.597167 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:28.931345 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:28.931295 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:29.300504 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:29.300414 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:29.398400 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:29.398363 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:29.449541 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:29.449506 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:29.511069 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:29.511038 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:29.899137 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:29.899104 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:30.728790 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:30.728755 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:30.909857 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:30.909820 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:31.302509 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:31.302474 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:31.537400 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:31.537368 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:32.098671 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:32.098635 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" limit=1024 Jul 17 17:31:34.014771 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:34.014747 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tccgv" Jul 17 17:31:34.855077 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:34.855049 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:34.857413 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:34.857384 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fce1ae6-eff2-4165-8a96-d5dc0521d595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jg62z\" (UID: \"2fce1ae6-eff2-4165-8a96-d5dc0521d595\") " pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:34.987398 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:34.987363 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7jwcc\"" Jul 17 17:31:34.995364 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:34.995339 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jg62z" Jul 17 17:31:35.121491 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:35.121402 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jg62z"] Jul 17 17:31:35.126321 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:31:35.126293 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fce1ae6_eff2_4165_8a96_d5dc0521d595.slice/crio-a4260be5d4add46091a40125abe281021a4e57e7f46511826a3fc63792f8fb6c WatchSource:0}: Error finding container a4260be5d4add46091a40125abe281021a4e57e7f46511826a3fc63792f8fb6c: Status 404 returned error can't find the container with id a4260be5d4add46091a40125abe281021a4e57e7f46511826a3fc63792f8fb6c Jul 17 17:31:35.163798 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:35.163772 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jg62z" event={"ID":"2fce1ae6-eff2-4165-8a96-d5dc0521d595","Type":"ContainerStarted","Data":"a4260be5d4add46091a40125abe281021a4e57e7f46511826a3fc63792f8fb6c"} Jul 17 17:31:37.579746 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:37.579708 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:31:37.582493 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:37.582469 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 17:31:37.592634 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:37.592609 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b702b8e-c450-4d9c-b339-6d1f30922e66-original-pull-secret\") pod \"global-pull-secret-syncer-xb5jt\" (UID: \"6b702b8e-c450-4d9c-b339-6d1f30922e66\") " pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:31:37.595566 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:37.595541 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xb5jt" Jul 17 17:31:37.680697 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:37.680638 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs\") pod \"network-metrics-daemon-v76hr\" (UID: \"082d287c-1c8d-4d2f-adb5-82d542c434b8\") " pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:31:37.683613 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:37.683585 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 17:31:37.693411 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:37.693380 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/082d287c-1c8d-4d2f-adb5-82d542c434b8-metrics-certs\") pod \"network-metrics-daemon-v76hr\" (UID: \"082d287c-1c8d-4d2f-adb5-82d542c434b8\") " pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:31:37.781718 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:37.781665 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9c8v\" (UniqueName: \"kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v\") pod \"network-check-target-6xtwg\" (UID: \"db938228-2485-4dc7-9a83-d5af8652ad4d\") " pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:31:37.784572 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:37.784542 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9c8v\" (UniqueName: \"kubernetes.io/projected/db938228-2485-4dc7-9a83-d5af8652ad4d-kube-api-access-l9c8v\") pod \"network-check-target-6xtwg\" (UID: \"db938228-2485-4dc7-9a83-d5af8652ad4d\") " pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:31:37.993006 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:37.992974 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lgt4f\"" Jul 17 17:31:38.001054 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:38.001029 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v76hr" Jul 17 17:31:38.001926 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:38.001907 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fwmkw\"" Jul 17 17:31:38.010749 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:38.010722 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:31:39.195241 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.195202 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gdq5z\" (UID: \"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:39.195241 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.195246 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:39.195792 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.195318 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4h9k2\" (UID: \"5cb507b3-c5cf-4cef-a3c3-d0168e3660da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" Jul 17 17:31:39.195792 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.195359 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:39.195792 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.195575 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:39.195792 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.195659 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:39.196486 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.196401 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-service-ca-bundle\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:39.198345 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.198318 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls\") pod \"image-registry-644dd77dcb-5d5fk\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:39.198460 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.198318 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls\") pod \"image-registry-854d76f6cf-grgqm\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:39.198460 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.198396 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6334beb9-4604-4aa0-ba7a-5c7d8aca63c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gdq5z\" (UID: \"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:39.198692 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.198654 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d528fdc-e45b-40e6-9e43-95633b1fa9d4-metrics-certs\") pod \"router-default-56bc46498-h9pbn\" (UID: \"3d528fdc-e45b-40e6-9e43-95633b1fa9d4\") " pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:39.198835 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.198816 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb507b3-c5cf-4cef-a3c3-d0168e3660da-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4h9k2\" (UID: \"5cb507b3-c5cf-4cef-a3c3-d0168e3660da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" Jul 17 17:31:39.296295 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.296253 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:39.298666 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.298631 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7be1d83f-e7e1-4051-bcbd-7c579ee86cd6-metrics-tls\") pod \"dns-default-79kq8\" (UID: \"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6\") " pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:39.369628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.369593 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mzn7n\"" Jul 17 17:31:39.377665 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.377644 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" Jul 17 17:31:39.382631 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.382611 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qgkjr\"" Jul 17 17:31:39.390517 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.390498 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:39.405086 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.405059 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xlgfp\"" Jul 17 17:31:39.413022 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.413004 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:39.424603 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.424585 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vfmzw\"" Jul 17 17:31:39.432561 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.432543 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" Jul 17 17:31:39.457914 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.457798 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:39.467202 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.467182 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c4wmq\"" Jul 17 17:31:39.474522 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:39.474501 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:40.266513 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:40.264818 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xb5jt"] Jul 17 17:31:40.306840 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:40.306788 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v76hr"] Jul 17 17:31:40.355757 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:40.355668 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2"] Jul 17 17:31:40.428113 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:40.428089 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6xtwg"] Jul 17 17:31:40.431278 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:40.431254 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56bc46498-h9pbn"] Jul 17 17:31:40.438219 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:31:40.438194 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb938228_2485_4dc7_9a83_d5af8652ad4d.slice/crio-fb5a0f0f974921977a6c8b678f077c824e594af16a0c1d25f13a633a8115e9df WatchSource:0}: Error finding container fb5a0f0f974921977a6c8b678f077c824e594af16a0c1d25f13a633a8115e9df: Status 404 returned error can't find the container with id fb5a0f0f974921977a6c8b678f077c824e594af16a0c1d25f13a633a8115e9df Jul 17 17:31:40.439518 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:31:40.439452 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d528fdc_e45b_40e6_9e43_95633b1fa9d4.slice/crio-a3ebfcacd7c98f34c44838eb7ed12af2a21604f1b06f05279fb3e2e67fe89be8 WatchSource:0}: Error finding container a3ebfcacd7c98f34c44838eb7ed12af2a21604f1b06f05279fb3e2e67fe89be8: Status 404 returned error can't find the container with id a3ebfcacd7c98f34c44838eb7ed12af2a21604f1b06f05279fb3e2e67fe89be8 Jul 17 17:31:40.468404 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:40.468381 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-854d76f6cf-grgqm"] Jul 17 17:31:40.471538 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:31:40.471508 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4090d8a9_64ae_4803_a9ad_0e5eeb8b227b.slice/crio-1fe7b5061a1577bc13ca82ceb598452b523ba6428a6d1d1fc089236b38664fd2 WatchSource:0}: Error finding container 1fe7b5061a1577bc13ca82ceb598452b523ba6428a6d1d1fc089236b38664fd2: Status 404 returned error can't find the container with id 1fe7b5061a1577bc13ca82ceb598452b523ba6428a6d1d1fc089236b38664fd2 Jul 17 17:31:40.481969 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:40.481944 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z"] Jul 17 17:31:40.485947 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:31:40.485919 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6334beb9_4604_4aa0_ba7a_5c7d8aca63c7.slice/crio-bcbeaaf285921f2025c3f591a12b2ec35df701c82c224dec80edb29e092fab54 WatchSource:0}: Error finding container bcbeaaf285921f2025c3f591a12b2ec35df701c82c224dec80edb29e092fab54: Status 404 returned error can't find the container with id bcbeaaf285921f2025c3f591a12b2ec35df701c82c224dec80edb29e092fab54 Jul 17 17:31:40.633537 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:40.633491 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-644dd77dcb-5d5fk"] Jul 17 17:31:40.634857 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:40.634828 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-79kq8"] Jul 17 17:31:40.637502 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:31:40.637469 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8db9e5a_fb13_4ae5_a1d1_1fa68080c09d.slice/crio-9c4ad4c59d2cb074d7966e59b9d80db6da029a318a4fa24d344e1eddf3142e23 WatchSource:0}: Error finding container 9c4ad4c59d2cb074d7966e59b9d80db6da029a318a4fa24d344e1eddf3142e23: Status 404 returned error can't find the container with id 9c4ad4c59d2cb074d7966e59b9d80db6da029a318a4fa24d344e1eddf3142e23 Jul 17 17:31:40.637911 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:31:40.637874 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be1d83f_e7e1_4051_bcbd_7c579ee86cd6.slice/crio-96ef8cb9c58ed037e83dfb2c45645e7830f0ac64c970050879f8f886a6e40df7 WatchSource:0}: Error finding container 96ef8cb9c58ed037e83dfb2c45645e7830f0ac64c970050879f8f886a6e40df7: Status 404 returned error can't find the container with id 96ef8cb9c58ed037e83dfb2c45645e7830f0ac64c970050879f8f886a6e40df7 Jul 17 17:31:40.872602 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:40.872202 2557 scope.go:117] "RemoveContainer" containerID="b682e1576734df3f2854ed12c199256bc8f752e00f69525d6273b7f8b78a3c70" Jul 17 17:31:41.198928 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.198836 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" event={"ID":"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d","Type":"ContainerStarted","Data":"0169554d492bf806f96bbd9fb85b73468e4a1064f89045452c3c1cab5e07c787"} Jul 17 17:31:41.198928 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.198901 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" event={"ID":"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d","Type":"ContainerStarted","Data":"9c4ad4c59d2cb074d7966e59b9d80db6da029a318a4fa24d344e1eddf3142e23"} Jul 17 17:31:41.199736 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.199698 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:31:41.202263 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.202234 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56bc46498-h9pbn" event={"ID":"3d528fdc-e45b-40e6-9e43-95633b1fa9d4","Type":"ContainerStarted","Data":"c0970aaf3bab97e727832015a61002768368d7fb983a317445b8010fd124fbaa"} Jul 17 17:31:41.202381 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.202268 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56bc46498-h9pbn" event={"ID":"3d528fdc-e45b-40e6-9e43-95633b1fa9d4","Type":"ContainerStarted","Data":"a3ebfcacd7c98f34c44838eb7ed12af2a21604f1b06f05279fb3e2e67fe89be8"} Jul 17 17:31:41.205197 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.205171 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" event={"ID":"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7","Type":"ContainerStarted","Data":"bcbeaaf285921f2025c3f591a12b2ec35df701c82c224dec80edb29e092fab54"} Jul 17 17:31:41.209597 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.209576 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 17:31:41.209727 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.209654 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" event={"ID":"fb8b4834-5dba-4cce-b4f7-60407b1b05cc","Type":"ContainerStarted","Data":"8364c26da66e1a3c9d000fba93189ec1a61803a23ad1e84d55f7694b6e4fa0b8"} Jul 17 17:31:41.210412 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.210393 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:41.213402 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.213317 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jg62z" event={"ID":"2fce1ae6-eff2-4165-8a96-d5dc0521d595","Type":"ContainerStarted","Data":"3e1893e325be54b09e5fcc1854e7577e4de3edaa4cf0b8168cc291c3a425b541"} Jul 17 17:31:41.216488 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.215938 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" event={"ID":"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b","Type":"ContainerStarted","Data":"f09fc3cb1d225aab0a0c878985c6e8c458fbb83cd7ace9d55c8959c5b9975bb5"} Jul 17 17:31:41.216488 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.215975 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" event={"ID":"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b","Type":"ContainerStarted","Data":"1fe7b5061a1577bc13ca82ceb598452b523ba6428a6d1d1fc089236b38664fd2"} Jul 17 17:31:41.216488 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.216436 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:31:41.219017 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.218900 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v76hr" event={"ID":"082d287c-1c8d-4d2f-adb5-82d542c434b8","Type":"ContainerStarted","Data":"3b715ad628a0f4d270f71574c4eabdea738f01628652059e02d02faaaee11a57"} Jul 17 17:31:41.226476 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.225939 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6xtwg" event={"ID":"db938228-2485-4dc7-9a83-d5af8652ad4d","Type":"ContainerStarted","Data":"42bed78357dd7c4a8dbdf88fe7ea6805e84959f4cd34997da11092f8f93458c8"} Jul 17 17:31:41.226476 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.225981 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6xtwg" event={"ID":"db938228-2485-4dc7-9a83-d5af8652ad4d","Type":"ContainerStarted","Data":"fb5a0f0f974921977a6c8b678f077c824e594af16a0c1d25f13a633a8115e9df"} Jul 17 17:31:41.226476 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.226427 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:31:41.229925 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.229903 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-79kq8" event={"ID":"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6","Type":"ContainerStarted","Data":"96ef8cb9c58ed037e83dfb2c45645e7830f0ac64c970050879f8f886a6e40df7"} Jul 17 17:31:41.232043 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.231983 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" event={"ID":"5cb507b3-c5cf-4cef-a3c3-d0168e3660da","Type":"ContainerStarted","Data":"bd521cf0a7c63733e49223abb4d81797e5443aaf1d3eb4e371abe0950b55781f"} Jul 17 17:31:41.235957 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.235891 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xb5jt" event={"ID":"6b702b8e-c450-4d9c-b339-6d1f30922e66","Type":"ContainerStarted","Data":"6fdc0d45f72f7f124a92a675f4d7103b11651a6b01fe5cd797fdd1646aef0545"} Jul 17 17:31:41.245062 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.243562 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" podStartSLOduration=68.243544785 podStartE2EDuration="1m8.243544785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:41.224100156 +0000 UTC m=+69.834769536" watchObservedRunningTime="2026-07-17 17:31:41.243544785 +0000 UTC m=+69.854214169" Jul 17 17:31:41.269869 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.268471 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56bc46498-h9pbn" podStartSLOduration=47.268452174 podStartE2EDuration="47.268452174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:41.245244651 +0000 UTC m=+69.855914035" watchObservedRunningTime="2026-07-17 17:31:41.268452174 +0000 UTC m=+69.879121559" Jul 17 17:31:41.285631 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.285581 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" podStartSLOduration=31.609714803 podStartE2EDuration="41.285563773s" totalImagesPullingTime="9.67584897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:41.28526027 +0000 UTC m=+69.895929652" watchObservedRunningTime="2026-07-17 17:31:41.285563773 +0000 UTC m=+69.896233157" Jul 17 17:31:41.285827 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.285793 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" podStartSLOduration=35.285780538 podStartE2EDuration="35.285780538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:41.269857623 +0000 UTC m=+69.880527005" watchObservedRunningTime="2026-07-17 17:31:41.285780538 +0000 UTC m=+69.896449921" Jul 17 17:31:41.300658 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.300611 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6xtwg" podStartSLOduration=69.300532311 podStartE2EDuration="1m9.300532311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:41.299887778 +0000 UTC m=+69.910557161" watchObservedRunningTime="2026-07-17 17:31:41.300532311 +0000 UTC m=+69.911201709" Jul 17 17:31:41.413879 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.413800 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:41.416775 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.416559 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:41.619829 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:41.619585 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-qq5gg" Jul 17 17:31:42.250358 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.250325 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v76hr" event={"ID":"082d287c-1c8d-4d2f-adb5-82d542c434b8","Type":"ContainerStarted","Data":"b9b76773b602d034cdbf7ea86f61c48b945d86dfe14457f5896be09468fed296"} Jul 17 17:31:42.253715 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.253639 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:42.253839 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.253748 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56bc46498-h9pbn" Jul 17 17:31:42.289217 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.287868 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn"] Jul 17 17:31:42.293650 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.292337 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm"] Jul 17 17:31:42.296742 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.295704 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9"] Jul 17 17:31:42.296742 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.296264 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" Jul 17 17:31:42.297530 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.295704 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn" Jul 17 17:31:42.299560 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.299515 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.299715 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.299585 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 17 17:31:42.300107 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.299919 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 17 17:31:42.300238 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.300219 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 17 17:31:42.300924 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.300668 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 17 17:31:42.301029 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.300976 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vf9vw\"" Jul 17 17:31:42.301283 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.301267 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 17 17:31:42.303691 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.302854 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 17 17:31:42.303691 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.303068 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 17 17:31:42.303853 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.303814 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 17 17:31:42.306153 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.305935 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 17 17:31:42.312869 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.309874 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn"] Jul 17 17:31:42.313285 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.313228 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm"] Jul 17 17:31:42.323379 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.322410 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9"] Jul 17 17:31:42.375040 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.375012 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-wfhtj"] Jul 17 17:31:42.383008 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.382984 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-dpj2s"] Jul 17 17:31:42.384020 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.383248 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wfhtj" Jul 17 17:31:42.387628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.387388 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pb2zr\"" Jul 17 17:31:42.388333 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.387923 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 17 17:31:42.388333 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.388194 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 17 17:31:42.389595 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.389580 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-dpj2s" Jul 17 17:31:42.391148 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.391096 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-wfhtj"] Jul 17 17:31:42.392583 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.392379 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 17 17:31:42.393017 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.392867 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bsg6r\"" Jul 17 17:31:42.393930 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.393767 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 17 17:31:42.395569 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.395511 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-dpj2s"] Jul 17 17:31:42.458317 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.458268 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9f0d55c9-b7e8-4a11-98ef-506ba6726942-klusterlet-config\") pod \"klusterlet-addon-workmgr-8b4d7574-s5vkm\" (UID: \"9f0d55c9-b7e8-4a11-98ef-506ba6726942\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" Jul 17 17:31:42.458632 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.458559 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3b90b56f-9581-4eb6-aace-478e13d7f5a5-ca\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.458840 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.458735 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz9c4\" (UniqueName: \"kubernetes.io/projected/9f0d55c9-b7e8-4a11-98ef-506ba6726942-kube-api-access-vz9c4\") pod \"klusterlet-addon-workmgr-8b4d7574-s5vkm\" (UID: \"9f0d55c9-b7e8-4a11-98ef-506ba6726942\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" Jul 17 17:31:42.458840 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.458952 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3b90b56f-9581-4eb6-aace-478e13d7f5a5-hub\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.458840 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.458998 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f0d55c9-b7e8-4a11-98ef-506ba6726942-tmp\") pod \"klusterlet-addon-workmgr-8b4d7574-s5vkm\" (UID: \"9f0d55c9-b7e8-4a11-98ef-506ba6726942\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" Jul 17 17:31:42.458840 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.459025 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b90b56f-9581-4eb6-aace-478e13d7f5a5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.458840 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.459056 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3b90b56f-9581-4eb6-aace-478e13d7f5a5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.458840 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.459094 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w846t\" (UniqueName: \"kubernetes.io/projected/c30367e7-d1a2-40f9-8765-7ab0fe751b9e-kube-api-access-w846t\") pod \"managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn\" (UID: \"c30367e7-d1a2-40f9-8765-7ab0fe751b9e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn" Jul 17 17:31:42.458840 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.459142 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b90b56f-9581-4eb6-aace-478e13d7f5a5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.458840 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.459201 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c30367e7-d1a2-40f9-8765-7ab0fe751b9e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn\" (UID: \"c30367e7-d1a2-40f9-8765-7ab0fe751b9e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn" Jul 17 17:31:42.458840 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.459229 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k7dw\" (UniqueName: \"kubernetes.io/projected/3b90b56f-9581-4eb6-aace-478e13d7f5a5-kube-api-access-2k7dw\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.559784 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.559723 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c30367e7-d1a2-40f9-8765-7ab0fe751b9e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn\" (UID: \"c30367e7-d1a2-40f9-8765-7ab0fe751b9e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn" Jul 17 17:31:42.561805 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.559797 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k7dw\" (UniqueName: \"kubernetes.io/projected/3b90b56f-9581-4eb6-aace-478e13d7f5a5-kube-api-access-2k7dw\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.561805 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.560980 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9f0d55c9-b7e8-4a11-98ef-506ba6726942-klusterlet-config\") pod \"klusterlet-addon-workmgr-8b4d7574-s5vkm\" (UID: \"9f0d55c9-b7e8-4a11-98ef-506ba6726942\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" Jul 17 17:31:42.561805 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.561013 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4be86d0-8e39-4124-9fd9-3303385a17aa-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wfhtj\" (UID: \"d4be86d0-8e39-4124-9fd9-3303385a17aa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wfhtj" Jul 17 17:31:42.561805 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.561045 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3b90b56f-9581-4eb6-aace-478e13d7f5a5-ca\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.561805 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.561091 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9c4\" (UniqueName: \"kubernetes.io/projected/9f0d55c9-b7e8-4a11-98ef-506ba6726942-kube-api-access-vz9c4\") pod \"klusterlet-addon-workmgr-8b4d7574-s5vkm\" (UID: \"9f0d55c9-b7e8-4a11-98ef-506ba6726942\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" Jul 17 17:31:42.561805 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.561123 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3b90b56f-9581-4eb6-aace-478e13d7f5a5-hub\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.561805 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.561160 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d4be86d0-8e39-4124-9fd9-3303385a17aa-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-wfhtj\" (UID: \"d4be86d0-8e39-4124-9fd9-3303385a17aa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wfhtj" Jul 17 17:31:42.561805 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.561197 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f0d55c9-b7e8-4a11-98ef-506ba6726942-tmp\") pod \"klusterlet-addon-workmgr-8b4d7574-s5vkm\" (UID: \"9f0d55c9-b7e8-4a11-98ef-506ba6726942\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" Jul 17 17:31:42.561805 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.561226 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b90b56f-9581-4eb6-aace-478e13d7f5a5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.561805 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.561259 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3b90b56f-9581-4eb6-aace-478e13d7f5a5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.561805 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.561295 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w846t\" (UniqueName: \"kubernetes.io/projected/c30367e7-d1a2-40f9-8765-7ab0fe751b9e-kube-api-access-w846t\") pod \"managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn\" (UID: \"c30367e7-d1a2-40f9-8765-7ab0fe751b9e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn" Jul 17 17:31:42.561805 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.561336 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b90b56f-9581-4eb6-aace-478e13d7f5a5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.562513 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.561382 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vds5x\" (UniqueName: \"kubernetes.io/projected/8aa582e3-8011-4aa9-962b-d0a75d9f40bc-kube-api-access-vds5x\") pod \"downloads-5bc67dcd46-dpj2s\" (UID: \"8aa582e3-8011-4aa9-962b-d0a75d9f40bc\") " pod="openshift-console/downloads-5bc67dcd46-dpj2s" Jul 17 17:31:42.565417 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.563936 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f0d55c9-b7e8-4a11-98ef-506ba6726942-tmp\") pod \"klusterlet-addon-workmgr-8b4d7574-s5vkm\" (UID: \"9f0d55c9-b7e8-4a11-98ef-506ba6726942\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" Jul 17 17:31:42.565417 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.565099 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b90b56f-9581-4eb6-aace-478e13d7f5a5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.569664 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.569614 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3b90b56f-9581-4eb6-aace-478e13d7f5a5-hub\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.571590 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.571551 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3b90b56f-9581-4eb6-aace-478e13d7f5a5-ca\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.572216 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.572175 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9f0d55c9-b7e8-4a11-98ef-506ba6726942-klusterlet-config\") pod \"klusterlet-addon-workmgr-8b4d7574-s5vkm\" (UID: \"9f0d55c9-b7e8-4a11-98ef-506ba6726942\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" Jul 17 17:31:42.572906 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.572851 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c30367e7-d1a2-40f9-8765-7ab0fe751b9e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn\" (UID: \"c30367e7-d1a2-40f9-8765-7ab0fe751b9e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn" Jul 17 17:31:42.574880 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.574843 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b90b56f-9581-4eb6-aace-478e13d7f5a5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.575739 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.575669 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k7dw\" (UniqueName: \"kubernetes.io/projected/3b90b56f-9581-4eb6-aace-478e13d7f5a5-kube-api-access-2k7dw\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.576288 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.576249 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3b90b56f-9581-4eb6-aace-478e13d7f5a5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5584b58498-8spl9\" (UID: \"3b90b56f-9581-4eb6-aace-478e13d7f5a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.577039 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.577005 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w846t\" (UniqueName: \"kubernetes.io/projected/c30367e7-d1a2-40f9-8765-7ab0fe751b9e-kube-api-access-w846t\") pod \"managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn\" (UID: \"c30367e7-d1a2-40f9-8765-7ab0fe751b9e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn" Jul 17 17:31:42.579079 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.578986 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz9c4\" (UniqueName: \"kubernetes.io/projected/9f0d55c9-b7e8-4a11-98ef-506ba6726942-kube-api-access-vz9c4\") pod \"klusterlet-addon-workmgr-8b4d7574-s5vkm\" (UID: \"9f0d55c9-b7e8-4a11-98ef-506ba6726942\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" Jul 17 17:31:42.620734 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.620704 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" Jul 17 17:31:42.644029 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.643985 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn" Jul 17 17:31:42.652469 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.652442 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" Jul 17 17:31:42.664122 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.662818 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4be86d0-8e39-4124-9fd9-3303385a17aa-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wfhtj\" (UID: \"d4be86d0-8e39-4124-9fd9-3303385a17aa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wfhtj" Jul 17 17:31:42.664122 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.662883 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d4be86d0-8e39-4124-9fd9-3303385a17aa-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-wfhtj\" (UID: \"d4be86d0-8e39-4124-9fd9-3303385a17aa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wfhtj" Jul 17 17:31:42.664122 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.662955 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vds5x\" (UniqueName: \"kubernetes.io/projected/8aa582e3-8011-4aa9-962b-d0a75d9f40bc-kube-api-access-vds5x\") pod \"downloads-5bc67dcd46-dpj2s\" (UID: \"8aa582e3-8011-4aa9-962b-d0a75d9f40bc\") " pod="openshift-console/downloads-5bc67dcd46-dpj2s" Jul 17 17:31:42.664375 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.664355 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d4be86d0-8e39-4124-9fd9-3303385a17aa-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-wfhtj\" (UID: \"d4be86d0-8e39-4124-9fd9-3303385a17aa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wfhtj" Jul 17 17:31:42.669874 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.669812 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4be86d0-8e39-4124-9fd9-3303385a17aa-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wfhtj\" (UID: \"d4be86d0-8e39-4124-9fd9-3303385a17aa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wfhtj" Jul 17 17:31:42.679205 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.679179 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vds5x\" (UniqueName: \"kubernetes.io/projected/8aa582e3-8011-4aa9-962b-d0a75d9f40bc-kube-api-access-vds5x\") pod \"downloads-5bc67dcd46-dpj2s\" (UID: \"8aa582e3-8011-4aa9-962b-d0a75d9f40bc\") " pod="openshift-console/downloads-5bc67dcd46-dpj2s" Jul 17 17:31:42.720909 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.720617 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wfhtj" Jul 17 17:31:42.728200 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:42.727955 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-dpj2s" Jul 17 17:31:43.259840 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:43.259799 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v76hr" event={"ID":"082d287c-1c8d-4d2f-adb5-82d542c434b8","Type":"ContainerStarted","Data":"89a8da0beb71c6d9535ac9c064670bd7ba20984bb6bd370b4b06f69b48abf678"} Jul 17 17:31:43.276456 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:43.276379 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v76hr" podStartSLOduration=69.531168228 podStartE2EDuration="1m11.276359944s" totalImagesPullingTime="1.745191716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:43.27601879 +0000 UTC m=+71.886688173" watchObservedRunningTime="2026-07-17 17:31:43.276359944 +0000 UTC m=+71.887029327" Jul 17 17:31:48.938148 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:48.937926 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm"] Jul 17 17:31:49.001374 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:31:49.001334 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f0d55c9_b7e8_4a11_98ef_506ba6726942.slice/crio-9fb632792b0aa0540749b849dfb5ec33f3d0b9748152a0ca98fdc39a21dfee43 WatchSource:0}: Error finding container 9fb632792b0aa0540749b849dfb5ec33f3d0b9748152a0ca98fdc39a21dfee43: Status 404 returned error can't find the container with id 9fb632792b0aa0540749b849dfb5ec33f3d0b9748152a0ca98fdc39a21dfee43 Jul 17 17:31:49.208218 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.207587 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn"] Jul 17 17:31:49.288014 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.287914 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-79kq8" event={"ID":"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6","Type":"ContainerStarted","Data":"31bcf8184eaaae895b6425aee76629207fb107fa37a904b3249c205120f708c7"} Jul 17 17:31:49.290352 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.290313 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" event={"ID":"5cb507b3-c5cf-4cef-a3c3-d0168e3660da","Type":"ContainerStarted","Data":"f510c6d56a3df107003cdad2b26e6e42e9c810f8521d935b59019a4de1f81387"} Jul 17 17:31:49.293196 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.293140 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xb5jt" event={"ID":"6b702b8e-c450-4d9c-b339-6d1f30922e66","Type":"ContainerStarted","Data":"54e19f141f057534cc53621cbe27394d428f881204faafbaf6fbb8d3308d5850"} Jul 17 17:31:49.294574 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.294538 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" event={"ID":"9f0d55c9-b7e8-4a11-98ef-506ba6726942","Type":"ContainerStarted","Data":"9fb632792b0aa0540749b849dfb5ec33f3d0b9748152a0ca98fdc39a21dfee43"} Jul 17 17:31:49.296997 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.296279 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" event={"ID":"6334beb9-4604-4aa0-ba7a-5c7d8aca63c7","Type":"ContainerStarted","Data":"eeb4acbacbd70b4cea8d3dc7977e855998bec7d0b95a2a4ced8ab003c934d25d"} Jul 17 17:31:49.310655 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.310552 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xb5jt" podStartSLOduration=68.784343111 podStartE2EDuration="1m17.310533793s" totalImagesPullingTime="8.526190682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:49.309123248 +0000 UTC m=+77.919792630" watchObservedRunningTime="2026-07-17 17:31:49.310533793 +0000 UTC m=+77.921203177" Jul 17 17:31:49.325173 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.325099 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gdq5z" podStartSLOduration=47.004984408 podStartE2EDuration="55.325076884s" totalImagesPullingTime="8.320092476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:49.324420574 +0000 UTC m=+77.935089971" watchObservedRunningTime="2026-07-17 17:31:49.325076884 +0000 UTC m=+77.935746268" Jul 17 17:31:49.433593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.433502 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9"] Jul 17 17:31:49.440831 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.440636 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-wfhtj"] Jul 17 17:31:49.449064 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.446954 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-dpj2s"] Jul 17 17:31:49.749737 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.749649 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bwbnd"] Jul 17 17:31:49.770297 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.770262 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bwbnd"] Jul 17 17:31:49.770482 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.770398 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bwbnd" Jul 17 17:31:49.772949 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.772927 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 17 17:31:49.772949 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.772945 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-knb5w\"" Jul 17 17:31:49.812478 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.812435 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/18d7219d-b076-4058-b092-65fd60c11d7f-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-bwbnd\" (UID: \"18d7219d-b076-4058-b092-65fd60c11d7f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bwbnd" Jul 17 17:31:49.913008 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:49.912962 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/18d7219d-b076-4058-b092-65fd60c11d7f-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-bwbnd\" (UID: \"18d7219d-b076-4058-b092-65fd60c11d7f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bwbnd" Jul 17 17:31:49.913161 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:49.913098 2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 17 17:31:49.913234 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:31:49.913163 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d7219d-b076-4058-b092-65fd60c11d7f-tls-certificates podName:18d7219d-b076-4058-b092-65fd60c11d7f nodeName:}" failed. No retries permitted until 2026-07-17 17:31:50.413145073 +0000 UTC m=+79.023814434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/18d7219d-b076-4058-b092-65fd60c11d7f-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-bwbnd" (UID: "18d7219d-b076-4058-b092-65fd60c11d7f") : secret "prometheus-operator-admission-webhook-tls" not found Jul 17 17:31:50.007546 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.006800 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-854d76f6cf-grgqm"] Jul 17 17:31:50.310726 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.309643 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn" event={"ID":"c30367e7-d1a2-40f9-8765-7ab0fe751b9e","Type":"ContainerStarted","Data":"7b3925fb3c044de1114cb735d667c46bb3aa76d57c0b40c66c8a17959a75f93b"} Jul 17 17:31:50.318372 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.318332 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wfhtj" event={"ID":"d4be86d0-8e39-4124-9fd9-3303385a17aa","Type":"ContainerStarted","Data":"a6c5bf2a5c014367b68b5b35cee4e28848c7db1c19e9f3ef52c916907b4ac951"} Jul 17 17:31:50.327727 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.327654 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jg62z" event={"ID":"2fce1ae6-eff2-4165-8a96-d5dc0521d595","Type":"ContainerStarted","Data":"df825bb48ef3618225a72fbe82bd0f91b9910bc09829d00777fd2a91aed9b270"} Jul 17 17:31:50.332744 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.332708 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-dpj2s" event={"ID":"8aa582e3-8011-4aa9-962b-d0a75d9f40bc","Type":"ContainerStarted","Data":"ae2ed0b4cc497def6f5b79d18e62fba25a8d59d457572ff2072890f792881834"} Jul 17 17:31:50.335469 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.334605 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" event={"ID":"3b90b56f-9581-4eb6-aace-478e13d7f5a5","Type":"ContainerStarted","Data":"13349a56204da7c04818a95b1613c6f499d3905cf1ca87fc3dbb873a999ef48a"} Jul 17 17:31:50.339821 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.338985 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-79kq8" event={"ID":"7be1d83f-e7e1-4051-bcbd-7c579ee86cd6","Type":"ContainerStarted","Data":"63b4ab144e8ac4ff0c47d68e09ec6f82608520ee01e483b1cdc73181ccd6726e"} Jul 17 17:31:50.339821 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.339796 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-79kq8" Jul 17 17:31:50.345466 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.345443 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" event={"ID":"5cb507b3-c5cf-4cef-a3c3-d0168e3660da","Type":"ContainerStarted","Data":"0c511c08e51f4496489237635f656922aa6e4584330d8a411d6f690eb9a3bbe1"} Jul 17 17:31:50.358275 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.358220 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-79kq8" podStartSLOduration=34.994737977 podStartE2EDuration="43.358200012s" totalImagesPullingTime="8.363462035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:50.357993617 +0000 UTC m=+78.968663000" watchObservedRunningTime="2026-07-17 17:31:50.358200012 +0000 UTC m=+78.968869396" Jul 17 17:31:50.379973 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.379910 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4h9k2" podStartSLOduration=44.026627804 podStartE2EDuration="52.379888731s" totalImagesPullingTime="8.353260927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:50.378491896 +0000 UTC m=+78.989161281" watchObservedRunningTime="2026-07-17 17:31:50.379888731 +0000 UTC m=+78.990558114" Jul 17 17:31:50.417710 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.417655 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/18d7219d-b076-4058-b092-65fd60c11d7f-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-bwbnd\" (UID: \"18d7219d-b076-4058-b092-65fd60c11d7f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bwbnd" Jul 17 17:31:50.425209 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.425177 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/18d7219d-b076-4058-b092-65fd60c11d7f-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-bwbnd\" (UID: \"18d7219d-b076-4058-b092-65fd60c11d7f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bwbnd" Jul 17 17:31:50.532608 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.531991 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dd4bf87d8-vd929"] Jul 17 17:31:50.551890 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.550792 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd4bf87d8-vd929"] Jul 17 17:31:50.551890 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.550916 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.558455 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.556290 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 17 17:31:50.558455 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.556546 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 17 17:31:50.558455 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.556778 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qd42z\"" Jul 17 17:31:50.558455 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.557007 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 17 17:31:50.558455 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.557207 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 17 17:31:50.558455 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.557388 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 17 17:31:50.620342 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.619981 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dd2f\" (UniqueName: \"kubernetes.io/projected/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-kube-api-access-5dd2f\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.620342 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.620052 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-serving-cert\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.620342 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.620086 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-oauth-serving-cert\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.620342 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.620112 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-oauth-config\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.620342 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.620159 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-config\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.620342 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.620184 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-service-ca\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.683310 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.682911 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bwbnd" Jul 17 17:31:50.721090 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.721039 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dd2f\" (UniqueName: \"kubernetes.io/projected/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-kube-api-access-5dd2f\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.721271 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.721112 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-serving-cert\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.721271 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.721147 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-oauth-serving-cert\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.721271 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.721181 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-oauth-config\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.721271 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.721229 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-config\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.721271 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.721258 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-service-ca\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.722076 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.722019 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-service-ca\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.723940 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.723579 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-oauth-serving-cert\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.724158 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.724137 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-config\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.725877 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.725335 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-serving-cert\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.725877 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.725838 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-oauth-config\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.737925 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.737865 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dd2f\" (UniqueName: \"kubernetes.io/projected/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-kube-api-access-5dd2f\") pod \"console-7dd4bf87d8-vd929\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.880588 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.880048 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:31:50.929857 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:50.929811 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bwbnd"] Jul 17 17:31:51.124315 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:51.124273 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd4bf87d8-vd929"] Jul 17 17:31:51.359066 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:51.358429 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bwbnd" event={"ID":"18d7219d-b076-4058-b092-65fd60c11d7f","Type":"ContainerStarted","Data":"e4cbd5e1a9a00435a25c8f72f0d8f7875c269d135bd52b8249b19178989863d6"} Jul 17 17:31:52.241221 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:31:52.241184 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf02c06_9eb9_4813_a985_bf1ed5eeb23d.slice/crio-09a3f3a637d871d2737f5de533ddf54941dfae18ba36fcdeea159a3759011b76 WatchSource:0}: Error finding container 09a3f3a637d871d2737f5de533ddf54941dfae18ba36fcdeea159a3759011b76: Status 404 returned error can't find the container with id 09a3f3a637d871d2737f5de533ddf54941dfae18ba36fcdeea159a3759011b76 Jul 17 17:31:52.369983 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:52.369945 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd4bf87d8-vd929" event={"ID":"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d","Type":"ContainerStarted","Data":"09a3f3a637d871d2737f5de533ddf54941dfae18ba36fcdeea159a3759011b76"} Jul 17 17:31:59.395960 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:59.395921 2557 patch_prober.go:28] interesting pod/image-registry-644dd77dcb-5d5fk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 17 17:31:59.396381 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:31:59.395981 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" podUID="c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 17:32:00.014590 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:00.014534 2557 patch_prober.go:28] interesting pod/image-registry-854d76f6cf-grgqm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 17 17:32:00.014787 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:00.014600 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" podUID="4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 17:32:01.372892 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.372831 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-79kq8" Jul 17 17:32:01.426964 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.426926 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" event={"ID":"3b90b56f-9581-4eb6-aace-478e13d7f5a5","Type":"ContainerStarted","Data":"d64a4d0fd675b0efd5a9be43ebf9167a941df4fd95b2a06e258af6622f0f175a"} Jul 17 17:32:01.427136 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.426988 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" event={"ID":"3b90b56f-9581-4eb6-aace-478e13d7f5a5","Type":"ContainerStarted","Data":"bfe37bb3873fb156f09e47ef856ddb2abfabc4d36d14f109b96b2f3d63498686"} Jul 17 17:32:01.427136 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.427007 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" event={"ID":"3b90b56f-9581-4eb6-aace-478e13d7f5a5","Type":"ContainerStarted","Data":"155c6b21161b7fa6ad3efc29a64f49b3bf8dea6f3aa82b43e2127b6cdea67b0c"} Jul 17 17:32:01.429167 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.429141 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bwbnd" event={"ID":"18d7219d-b076-4058-b092-65fd60c11d7f","Type":"ContainerStarted","Data":"97a57ad75af0b72397871399a507ccd88383ffbfd9b0ad0afd1ba22346ce6922"} Jul 17 17:32:01.429348 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.429306 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bwbnd" Jul 17 17:32:01.431852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.431825 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" event={"ID":"9f0d55c9-b7e8-4a11-98ef-506ba6726942","Type":"ContainerStarted","Data":"95c177a04f093f82297a06284662dfb85b24bd8e40063ab370e52b4c44380fa0"} Jul 17 17:32:01.432005 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.431971 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" Jul 17 17:32:01.433673 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.433653 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" Jul 17 17:32:01.434159 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.434135 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn" event={"ID":"c30367e7-d1a2-40f9-8765-7ab0fe751b9e","Type":"ContainerStarted","Data":"273bd2b36a2078953a9da4649cbe13a01e3b6a243fc18f0be8f6670e8a3084dd"} Jul 17 17:32:01.435531 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.435512 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bwbnd" Jul 17 17:32:01.436800 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.436775 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd4bf87d8-vd929" event={"ID":"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d","Type":"ContainerStarted","Data":"5c9b31075c2a8adb00fc8bacd637c46a9bc9a8a130a47995f0166ee1bd9a07ba"} Jul 17 17:32:01.438862 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.438835 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wfhtj" event={"ID":"d4be86d0-8e39-4124-9fd9-3303385a17aa","Type":"ContainerStarted","Data":"25effc89598af222345c85469dc11c954070cf974c7f4ab82e24d3aeff83d31a"} Jul 17 17:32:01.441366 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.441341 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jg62z" event={"ID":"2fce1ae6-eff2-4165-8a96-d5dc0521d595","Type":"ContainerStarted","Data":"7fe1e673fc22cc1a576b5ddcde0845791dac99fa414f482fcb52d28f13a676d0"} Jul 17 17:32:01.451149 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.451107 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5584b58498-8spl9" podStartSLOduration=7.879120344 podStartE2EDuration="19.451091484s" totalImagesPullingTime="11.57197114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:01.449284084 +0000 UTC m=+90.059953466" watchObservedRunningTime="2026-07-17 17:32:01.451091484 +0000 UTC m=+90.061760867" Jul 17 17:32:01.473538 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.473487 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jg62z" podStartSLOduration=16.873224302 podStartE2EDuration="42.473471695s" totalImagesPullingTime="25.600247393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:31:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:01.472243063 +0000 UTC m=+90.082912447" watchObservedRunningTime="2026-07-17 17:32:01.473471695 +0000 UTC m=+90.084141077" Jul 17 17:32:01.490383 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.490335 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wfhtj" podStartSLOduration=7.918466145 podStartE2EDuration="19.490319901s" totalImagesPullingTime="11.571853756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:01.489326538 +0000 UTC m=+90.099995923" watchObservedRunningTime="2026-07-17 17:32:01.490319901 +0000 UTC m=+90.100989282" Jul 17 17:32:01.509060 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.508997 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b4d7574-s5vkm" podStartSLOduration=7.489504581 podStartE2EDuration="19.508974552s" totalImagesPullingTime="12.019469971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:01.50839931 +0000 UTC m=+90.119068694" watchObservedRunningTime="2026-07-17 17:32:01.508974552 +0000 UTC m=+90.119643935" Jul 17 17:32:01.524055 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.523995 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bwbnd" podStartSLOduration=2.438127055 podStartE2EDuration="12.523972941s" totalImagesPullingTime="10.085845886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:01.523284769 +0000 UTC m=+90.133954152" watchObservedRunningTime="2026-07-17 17:32:01.523972941 +0000 UTC m=+90.134642324" Jul 17 17:32:01.542769 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.542434 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dd4bf87d8-vd929" podStartSLOduration=2.746522659 podStartE2EDuration="11.542411857s" totalImagesPullingTime="8.795889198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:01.541761998 +0000 UTC m=+90.152431381" watchObservedRunningTime="2026-07-17 17:32:01.542411857 +0000 UTC m=+90.153081240" Jul 17 17:32:01.556462 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:01.556408 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64cd7fd8cd-svvbn" podStartSLOduration=7.923994206 podStartE2EDuration="19.556390167s" totalImagesPullingTime="11.632395961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:01.555759777 +0000 UTC m=+90.166429159" watchObservedRunningTime="2026-07-17 17:32:01.556390167 +0000 UTC m=+90.167059572" Jul 17 17:32:03.264561 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:03.264532 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:32:10.012419 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.012376 2557 patch_prober.go:28] interesting pod/image-registry-854d76f6cf-grgqm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 17 17:32:10.013022 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.012444 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" podUID="4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 17:32:10.214877 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.214829 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7l5mp"] Jul 17 17:32:10.442351 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.442309 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.444746 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.444720 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 17:32:10.445674 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.445651 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 17:32:10.445674 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.445691 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sbz59\"" Jul 17 17:32:10.446002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.445985 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 17:32:10.446475 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.446454 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 17:32:10.509724 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.509693 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.509724 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.509728 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/67e68352-005b-4fc7-8584-8b8246c8ea5b-root\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.509957 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.509746 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67e68352-005b-4fc7-8584-8b8246c8ea5b-sys\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.509957 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.509762 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-accelerators-collector-config\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.509957 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.509829 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67e68352-005b-4fc7-8584-8b8246c8ea5b-metrics-client-ca\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.509957 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.509854 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-wtmp\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.509957 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.509877 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-textfile\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.509957 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.509917 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-tls\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.510308 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.509967 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzg7v\" (UniqueName: \"kubernetes.io/projected/67e68352-005b-4fc7-8584-8b8246c8ea5b-kube-api-access-fzg7v\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.611438 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.611398 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67e68352-005b-4fc7-8584-8b8246c8ea5b-metrics-client-ca\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.611622 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.611449 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-wtmp\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.611622 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.611479 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-textfile\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.611622 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.611529 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-tls\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.611622 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.611567 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzg7v\" (UniqueName: \"kubernetes.io/projected/67e68352-005b-4fc7-8584-8b8246c8ea5b-kube-api-access-fzg7v\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.611839 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.611624 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.611839 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.611650 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/67e68352-005b-4fc7-8584-8b8246c8ea5b-root\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.611839 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.611703 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67e68352-005b-4fc7-8584-8b8246c8ea5b-sys\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.611839 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.611730 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-accelerators-collector-config\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.612533 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.612114 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67e68352-005b-4fc7-8584-8b8246c8ea5b-metrics-client-ca\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.612533 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.612133 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/67e68352-005b-4fc7-8584-8b8246c8ea5b-root\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.612533 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.612187 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67e68352-005b-4fc7-8584-8b8246c8ea5b-sys\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.612533 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.611700 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-wtmp\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.612533 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:32:10.612259 2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 17 17:32:10.612533 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.612271 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-accelerators-collector-config\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.612533 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:32:10.612318 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-tls podName:67e68352-005b-4fc7-8584-8b8246c8ea5b nodeName:}" failed. No retries permitted until 2026-07-17 17:32:11.112300065 +0000 UTC m=+99.722969430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-tls") pod "node-exporter-7l5mp" (UID: "67e68352-005b-4fc7-8584-8b8246c8ea5b") : secret "node-exporter-tls" not found Jul 17 17:32:10.612533 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.612492 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-textfile\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.614920 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.614860 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.624060 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.624035 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzg7v\" (UniqueName: \"kubernetes.io/projected/67e68352-005b-4fc7-8584-8b8246c8ea5b-kube-api-access-fzg7v\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:10.881424 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.881392 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:32:10.881566 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.881458 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:32:10.887724 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:10.887703 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:32:11.116976 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:11.116893 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-tls\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:11.119499 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:11.119469 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/67e68352-005b-4fc7-8584-8b8246c8ea5b-node-exporter-tls\") pod \"node-exporter-7l5mp\" (UID: \"67e68352-005b-4fc7-8584-8b8246c8ea5b\") " pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:11.355382 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:11.355126 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7l5mp" Jul 17 17:32:11.414869 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:32:11.414812 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67e68352_005b_4fc7_8584_8b8246c8ea5b.slice/crio-0cd54690ba6dfa844e6553bc5d257c677af231ba94481f121e4207979688563b WatchSource:0}: Error finding container 0cd54690ba6dfa844e6553bc5d257c677af231ba94481f121e4207979688563b: Status 404 returned error can't find the container with id 0cd54690ba6dfa844e6553bc5d257c677af231ba94481f121e4207979688563b Jul 17 17:32:11.493264 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:11.493217 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-dpj2s" event={"ID":"8aa582e3-8011-4aa9-962b-d0a75d9f40bc","Type":"ContainerStarted","Data":"03552f648be7a20c37eb6a1d751d99c4e0e2882fcc786e404f84a7f0b7580a41"} Jul 17 17:32:11.494465 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:11.494440 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-dpj2s" Jul 17 17:32:11.497139 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:11.497064 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7l5mp" event={"ID":"67e68352-005b-4fc7-8584-8b8246c8ea5b","Type":"ContainerStarted","Data":"0cd54690ba6dfa844e6553bc5d257c677af231ba94481f121e4207979688563b"} Jul 17 17:32:11.501009 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:11.500987 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:32:11.508511 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:11.508485 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-dpj2s" Jul 17 17:32:11.517370 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:11.517321 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-dpj2s" podStartSLOduration=8.110397762 podStartE2EDuration="29.51730742s" totalImagesPullingTime="21.406909658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:11.515097667 +0000 UTC m=+100.125767052" watchObservedRunningTime="2026-07-17 17:32:11.51730742 +0000 UTC m=+100.127976801" Jul 17 17:32:13.263744 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:13.263708 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6xtwg" Jul 17 17:32:13.508978 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:13.508938 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7l5mp" event={"ID":"67e68352-005b-4fc7-8584-8b8246c8ea5b","Type":"ContainerStarted","Data":"a1c08bcccb8e2897fb152e39873d06ad7fa6b0afd76d2b18471864f26e1b47ad"} Jul 17 17:32:14.516020 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:14.515976 2557 generic.go:356] "Generic (PLEG): container finished" podID="67e68352-005b-4fc7-8584-8b8246c8ea5b" containerID="a1c08bcccb8e2897fb152e39873d06ad7fa6b0afd76d2b18471864f26e1b47ad" exitCode=0 Jul 17 17:32:14.516460 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:14.516048 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7l5mp" event={"ID":"67e68352-005b-4fc7-8584-8b8246c8ea5b","Type":"ContainerDied","Data":"a1c08bcccb8e2897fb152e39873d06ad7fa6b0afd76d2b18471864f26e1b47ad"} Jul 17 17:32:15.037782 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.037695 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" podUID="4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" containerName="registry" containerID="cri-o://f09fc3cb1d225aab0a0c878985c6e8c458fbb83cd7ace9d55c8959c5b9975bb5" gracePeriod=30 Jul 17 17:32:15.064558 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.064523 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5466c965b9-bbv7d"] Jul 17 17:32:15.090455 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.090423 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.091082 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.090316 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5466c965b9-bbv7d"] Jul 17 17:32:15.114748 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.114720 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 17 17:32:15.154471 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.154440 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-service-ca\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.154630 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.154499 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-config\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.154630 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.154527 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-trusted-ca-bundle\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.154630 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.154584 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-serving-cert\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.154630 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.154615 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-oauth-config\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.154867 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.154669 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jqqt\" (UniqueName: \"kubernetes.io/projected/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-kube-api-access-8jqqt\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.154867 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.154711 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-oauth-serving-cert\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.256065 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.255980 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jqqt\" (UniqueName: \"kubernetes.io/projected/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-kube-api-access-8jqqt\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.256712 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.256435 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-oauth-serving-cert\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.257252 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.257227 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-oauth-serving-cert\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.257412 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.257392 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-service-ca\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.258053 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.258027 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-service-ca\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.258782 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.258119 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-config\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.258859 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.258805 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-trusted-ca-bundle\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.258899 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.258880 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-serving-cert\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.258932 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.258910 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-oauth-config\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.260083 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.260061 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-trusted-ca-bundle\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.260176 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.258754 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-config\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.267901 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.264767 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-oauth-config\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.267901 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.267731 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-serving-cert\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.271049 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.270994 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jqqt\" (UniqueName: \"kubernetes.io/projected/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-kube-api-access-8jqqt\") pod \"console-5466c965b9-bbv7d\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.342808 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.342771 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:32:15.439491 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.439453 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:15.460958 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.460926 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-ca-trust-extracted\") pod \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " Jul 17 17:32:15.461098 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.460971 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls\") pod \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " Jul 17 17:32:15.461098 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.461059 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-757xm\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-kube-api-access-757xm\") pod \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " Jul 17 17:32:15.461217 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.461109 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-certificates\") pod \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " Jul 17 17:32:15.461217 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.461141 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-installation-pull-secrets\") pod \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " Jul 17 17:32:15.461217 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.461167 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-bound-sa-token\") pod \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " Jul 17 17:32:15.461367 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.461236 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-image-registry-private-configuration\") pod \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " Jul 17 17:32:15.461367 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.461281 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-trusted-ca\") pod \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\" (UID: \"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b\") " Jul 17 17:32:15.461910 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.461850 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" (UID: "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:32:15.462039 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.461924 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" (UID: "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:32:15.464537 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.464485 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" (UID: "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:32:15.465290 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.465169 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" (UID: "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:32:15.465470 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.465433 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" (UID: "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:32:15.467215 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.467185 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-kube-api-access-757xm" (OuterVolumeSpecName: "kube-api-access-757xm") pod "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" (UID: "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b"). InnerVolumeSpecName "kube-api-access-757xm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:32:15.468157 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.468127 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" (UID: "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:32:15.472165 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.472137 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" (UID: "4090d8a9-64ae-4803-a9ad-0e5eeb8b227b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:32:15.527783 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.527534 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7l5mp" event={"ID":"67e68352-005b-4fc7-8584-8b8246c8ea5b","Type":"ContainerStarted","Data":"fc949b2fced136462fcc3123db15be49a13ad03249e61902cc85c761fbaec08b"} Jul 17 17:32:15.527783 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.527597 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7l5mp" event={"ID":"67e68352-005b-4fc7-8584-8b8246c8ea5b","Type":"ContainerStarted","Data":"fc4e324feb49399653a19c8378d65167cdf074bf681f0a1f053f48706835d3ff"} Jul 17 17:32:15.531103 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.529877 2557 generic.go:356] "Generic (PLEG): container finished" podID="4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" containerID="f09fc3cb1d225aab0a0c878985c6e8c458fbb83cd7ace9d55c8959c5b9975bb5" exitCode=0 Jul 17 17:32:15.531103 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.529945 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" event={"ID":"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b","Type":"ContainerDied","Data":"f09fc3cb1d225aab0a0c878985c6e8c458fbb83cd7ace9d55c8959c5b9975bb5"} Jul 17 17:32:15.531103 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.529987 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" event={"ID":"4090d8a9-64ae-4803-a9ad-0e5eeb8b227b","Type":"ContainerDied","Data":"1fe7b5061a1577bc13ca82ceb598452b523ba6428a6d1d1fc089236b38664fd2"} Jul 17 17:32:15.531103 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.530017 2557 scope.go:117] "RemoveContainer" containerID="f09fc3cb1d225aab0a0c878985c6e8c458fbb83cd7ace9d55c8959c5b9975bb5" Jul 17 17:32:15.531103 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.530180 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854d76f6cf-grgqm" Jul 17 17:32:15.552070 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.552038 2557 scope.go:117] "RemoveContainer" containerID="f09fc3cb1d225aab0a0c878985c6e8c458fbb83cd7ace9d55c8959c5b9975bb5" Jul 17 17:32:15.552587 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:32:15.552482 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f09fc3cb1d225aab0a0c878985c6e8c458fbb83cd7ace9d55c8959c5b9975bb5\": container with ID starting with f09fc3cb1d225aab0a0c878985c6e8c458fbb83cd7ace9d55c8959c5b9975bb5 not found: ID does not exist" containerID="f09fc3cb1d225aab0a0c878985c6e8c458fbb83cd7ace9d55c8959c5b9975bb5" Jul 17 17:32:15.552587 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.552528 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09fc3cb1d225aab0a0c878985c6e8c458fbb83cd7ace9d55c8959c5b9975bb5"} err="failed to get container status \"f09fc3cb1d225aab0a0c878985c6e8c458fbb83cd7ace9d55c8959c5b9975bb5\": rpc error: code = NotFound desc = could not find container \"f09fc3cb1d225aab0a0c878985c6e8c458fbb83cd7ace9d55c8959c5b9975bb5\": container with ID starting with f09fc3cb1d225aab0a0c878985c6e8c458fbb83cd7ace9d55c8959c5b9975bb5 not found: ID does not exist" Jul 17 17:32:15.570480 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.570245 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7l5mp" podStartSLOduration=3.554815739 podStartE2EDuration="5.570221049s" totalImagesPullingTime="1.89527384s" totalInitContainerRuntime="120.13147ms" isStatefulPod=true podCreationTimestamp="2026-07-17 17:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:15.568456125 +0000 UTC m=+104.179125521" watchObservedRunningTime="2026-07-17 17:32:15.570221049 +0000 UTC m=+104.180890433" Jul 17 17:32:15.572212 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.572063 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-757xm\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-kube-api-access-757xm\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:15.572212 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.572094 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-certificates\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:15.572212 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.572111 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-installation-pull-secrets\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:15.572212 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.572127 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-bound-sa-token\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:15.572212 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.572144 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-image-registry-private-configuration\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:15.572212 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.572159 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-trusted-ca\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:15.572212 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.572172 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-ca-trust-extracted\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:15.572212 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.572185 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b-registry-tls\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:15.611840 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.611744 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-854d76f6cf-grgqm"] Jul 17 17:32:15.618830 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.618207 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-854d76f6cf-grgqm"] Jul 17 17:32:15.658321 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.658251 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5466c965b9-bbv7d"] Jul 17 17:32:15.660501 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:32:15.660404 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2dbfc96_c62b_426f_bca3_bc71e3bbdf2a.slice/crio-5fdb87da97dcfaddee44596659a246c868ff099d7d93f1041a2ac9a546426c2f WatchSource:0}: Error finding container 5fdb87da97dcfaddee44596659a246c868ff099d7d93f1041a2ac9a546426c2f: Status 404 returned error can't find the container with id 5fdb87da97dcfaddee44596659a246c868ff099d7d93f1041a2ac9a546426c2f Jul 17 17:32:15.697441 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.697410 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-644dd77dcb-5d5fk"] Jul 17 17:32:15.880221 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:15.880186 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" path="/var/lib/kubelet/pods/4090d8a9-64ae-4803-a9ad-0e5eeb8b227b/volumes" Jul 17 17:32:16.538454 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:16.538401 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5466c965b9-bbv7d" event={"ID":"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a","Type":"ContainerStarted","Data":"61d369355e5659b30c4c98f4be1576ce11aee576596349a929d057541a07fa2a"} Jul 17 17:32:16.539044 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:16.538478 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5466c965b9-bbv7d" event={"ID":"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a","Type":"ContainerStarted","Data":"5fdb87da97dcfaddee44596659a246c868ff099d7d93f1041a2ac9a546426c2f"} Jul 17 17:32:16.562309 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:16.562259 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5466c965b9-bbv7d" podStartSLOduration=1.5622399740000001 podStartE2EDuration="1.562239974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:32:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:16.561377331 +0000 UTC m=+105.172046713" watchObservedRunningTime="2026-07-17 17:32:16.562239974 +0000 UTC m=+105.172909359" Jul 17 17:32:20.609755 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.609718 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5466c965b9-bbv7d"] Jul 17 17:32:20.645653 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.645621 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fcf8f4748-wv2jn"] Jul 17 17:32:20.645997 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.645982 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" containerName="registry" Jul 17 17:32:20.646042 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.645999 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" containerName="registry" Jul 17 17:32:20.646075 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.646066 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4090d8a9-64ae-4803-a9ad-0e5eeb8b227b" containerName="registry" Jul 17 17:32:20.680167 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.680134 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fcf8f4748-wv2jn"] Jul 17 17:32:20.680324 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.680275 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.826439 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.826398 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-trusted-ca-bundle\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.826621 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.826448 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-console-config\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.826621 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.826489 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/748e323f-531f-4edd-82fe-f9601e002437-console-serving-cert\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.826621 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.826525 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/748e323f-531f-4edd-82fe-f9601e002437-console-oauth-config\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.826621 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.826604 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-service-ca\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.826799 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.826654 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fwrh\" (UniqueName: \"kubernetes.io/projected/748e323f-531f-4edd-82fe-f9601e002437-kube-api-access-9fwrh\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.826799 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.826715 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-oauth-serving-cert\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.927996 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.927927 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-oauth-serving-cert\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.927996 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.927987 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-trusted-ca-bundle\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.928267 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.928009 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-console-config\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.928267 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.928029 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/748e323f-531f-4edd-82fe-f9601e002437-console-serving-cert\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.928267 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.928046 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/748e323f-531f-4edd-82fe-f9601e002437-console-oauth-config\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.928267 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.928071 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-service-ca\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.928267 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.928116 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fwrh\" (UniqueName: \"kubernetes.io/projected/748e323f-531f-4edd-82fe-f9601e002437-kube-api-access-9fwrh\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.929312 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.929093 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-console-config\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.934785 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.929437 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-oauth-serving-cert\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.934785 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.929509 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-service-ca\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.934785 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.929596 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-trusted-ca-bundle\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.934785 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.931005 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/748e323f-531f-4edd-82fe-f9601e002437-console-serving-cert\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.934785 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.931412 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/748e323f-531f-4edd-82fe-f9601e002437-console-oauth-config\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.937904 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.937880 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fwrh\" (UniqueName: \"kubernetes.io/projected/748e323f-531f-4edd-82fe-f9601e002437-kube-api-access-9fwrh\") pod \"console-fcf8f4748-wv2jn\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:20.990038 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:20.990005 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:21.150236 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:21.150204 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fcf8f4748-wv2jn"] Jul 17 17:32:21.153733 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:32:21.153707 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748e323f_531f_4edd_82fe_f9601e002437.slice/crio-5ce1610012f9783a5bcb721619963f839195238ffae4f312fc520ff9541331c5 WatchSource:0}: Error finding container 5ce1610012f9783a5bcb721619963f839195238ffae4f312fc520ff9541331c5: Status 404 returned error can't find the container with id 5ce1610012f9783a5bcb721619963f839195238ffae4f312fc520ff9541331c5 Jul 17 17:32:21.563284 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:21.563194 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fcf8f4748-wv2jn" event={"ID":"748e323f-531f-4edd-82fe-f9601e002437","Type":"ContainerStarted","Data":"a86477d94b0f7d623edfd853e1574cdc71882d1185a8b97a5f4109f4d66dce9f"} Jul 17 17:32:21.563284 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:21.563243 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fcf8f4748-wv2jn" event={"ID":"748e323f-531f-4edd-82fe-f9601e002437","Type":"ContainerStarted","Data":"5ce1610012f9783a5bcb721619963f839195238ffae4f312fc520ff9541331c5"} Jul 17 17:32:21.582696 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:21.582630 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fcf8f4748-wv2jn" podStartSLOduration=1.5826167249999998 podStartE2EDuration="1.582616725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:32:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:21.580927258 +0000 UTC m=+110.191596641" watchObservedRunningTime="2026-07-17 17:32:21.582616725 +0000 UTC m=+110.193286106" Jul 17 17:32:25.439947 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:25.439909 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:28.593903 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:28.593870 2557 generic.go:356] "Generic (PLEG): container finished" podID="4cfa3866-cee4-4677-b24c-97c3b7839334" containerID="f7ea8405bd899efaabed0ce8f7acb762d8ab787e171666afa409c03dbca988b6" exitCode=0 Jul 17 17:32:28.594368 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:28.593943 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" event={"ID":"4cfa3866-cee4-4677-b24c-97c3b7839334","Type":"ContainerDied","Data":"f7ea8405bd899efaabed0ce8f7acb762d8ab787e171666afa409c03dbca988b6"} Jul 17 17:32:28.594368 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:28.594288 2557 scope.go:117] "RemoveContainer" containerID="f7ea8405bd899efaabed0ce8f7acb762d8ab787e171666afa409c03dbca988b6" Jul 17 17:32:29.599856 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:29.599822 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5g8wt" event={"ID":"4cfa3866-cee4-4677-b24c-97c3b7839334","Type":"ContainerStarted","Data":"f08c683b9822b33edc1bec5a5164b0ad871c5d0fc313fd4c1b2f65d667a1f803"} Jul 17 17:32:29.601328 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:29.601302 2557 generic.go:356] "Generic (PLEG): container finished" podID="ccfd68b0-0222-4940-9793-f503e6edc300" containerID="68f7f5e3d5f4e44216791e5b423be834f788c0ddacea683b561c6a5234c10de5" exitCode=0 Jul 17 17:32:29.601439 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:29.601373 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-qlvv2" event={"ID":"ccfd68b0-0222-4940-9793-f503e6edc300","Type":"ContainerDied","Data":"68f7f5e3d5f4e44216791e5b423be834f788c0ddacea683b561c6a5234c10de5"} Jul 17 17:32:29.601693 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:29.601666 2557 scope.go:117] "RemoveContainer" containerID="68f7f5e3d5f4e44216791e5b423be834f788c0ddacea683b561c6a5234c10de5" Jul 17 17:32:30.608868 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:30.608838 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-qlvv2" event={"ID":"ccfd68b0-0222-4940-9793-f503e6edc300","Type":"ContainerStarted","Data":"6ede27c329240009c9f0c29ef22f814f4d66b6635802fa43d03fd5692989bcd1"} Jul 17 17:32:30.990759 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:30.990642 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:30.990759 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:30.990750 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:30.995556 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:30.995530 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:31.617630 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:31.617603 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:32:31.735859 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:31.735825 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dd4bf87d8-vd929"] Jul 17 17:32:40.731364 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:40.731260 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" podUID="c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d" containerName="registry" containerID="cri-o://0169554d492bf806f96bbd9fb85b73468e4a1064f89045452c3c1cab5e07c787" gracePeriod=30 Jul 17 17:32:41.014776 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.014652 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:32:41.102646 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.102618 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-ca-trust-extracted\") pod \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " Jul 17 17:32:41.102828 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.102669 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls\") pod \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " Jul 17 17:32:41.102828 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.102711 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-installation-pull-secrets\") pod \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " Jul 17 17:32:41.102828 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.102738 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-image-registry-private-configuration\") pod \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " Jul 17 17:32:41.102828 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.102767 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dg7vx\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-kube-api-access-dg7vx\") pod \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " Jul 17 17:32:41.102828 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.102800 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-certificates\") pod \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " Jul 17 17:32:41.103086 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.102963 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-bound-sa-token\") pod \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " Jul 17 17:32:41.103086 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.103012 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-trusted-ca\") pod \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\" (UID: \"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d\") " Jul 17 17:32:41.103624 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.103590 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d" (UID: "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:32:41.103753 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.103635 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d" (UID: "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:32:41.105141 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.105110 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d" (UID: "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:32:41.105443 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.105410 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d" (UID: "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:32:41.105593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.105570 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d" (UID: "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:32:41.105641 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.105606 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-kube-api-access-dg7vx" (OuterVolumeSpecName: "kube-api-access-dg7vx") pod "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d" (UID: "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d"). InnerVolumeSpecName "kube-api-access-dg7vx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:32:41.105777 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.105750 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d" (UID: "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:32:41.111026 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.110998 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d" (UID: "c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:32:41.203814 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.203771 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-certificates\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:41.203814 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.203811 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-bound-sa-token\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:41.203814 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.203820 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-trusted-ca\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:41.203814 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.203828 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-ca-trust-extracted\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:41.204071 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.203837 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-registry-tls\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:41.204071 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.203845 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-installation-pull-secrets\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:41.204071 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.203857 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-image-registry-private-configuration\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:41.204071 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.203867 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dg7vx\" (UniqueName: \"kubernetes.io/projected/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d-kube-api-access-dg7vx\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:41.656945 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.656910 2557 generic.go:356] "Generic (PLEG): container finished" podID="c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d" containerID="0169554d492bf806f96bbd9fb85b73468e4a1064f89045452c3c1cab5e07c787" exitCode=0 Jul 17 17:32:41.657106 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.656954 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" Jul 17 17:32:41.657106 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.656976 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" event={"ID":"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d","Type":"ContainerDied","Data":"0169554d492bf806f96bbd9fb85b73468e4a1064f89045452c3c1cab5e07c787"} Jul 17 17:32:41.657106 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.657037 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-644dd77dcb-5d5fk" event={"ID":"c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d","Type":"ContainerDied","Data":"9c4ad4c59d2cb074d7966e59b9d80db6da029a318a4fa24d344e1eddf3142e23"} Jul 17 17:32:41.657106 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.657056 2557 scope.go:117] "RemoveContainer" containerID="0169554d492bf806f96bbd9fb85b73468e4a1064f89045452c3c1cab5e07c787" Jul 17 17:32:41.665709 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.665663 2557 scope.go:117] "RemoveContainer" containerID="0169554d492bf806f96bbd9fb85b73468e4a1064f89045452c3c1cab5e07c787" Jul 17 17:32:41.665959 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:32:41.665939 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0169554d492bf806f96bbd9fb85b73468e4a1064f89045452c3c1cab5e07c787\": container with ID starting with 0169554d492bf806f96bbd9fb85b73468e4a1064f89045452c3c1cab5e07c787 not found: ID does not exist" containerID="0169554d492bf806f96bbd9fb85b73468e4a1064f89045452c3c1cab5e07c787" Jul 17 17:32:41.666010 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.665966 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0169554d492bf806f96bbd9fb85b73468e4a1064f89045452c3c1cab5e07c787"} err="failed to get container status \"0169554d492bf806f96bbd9fb85b73468e4a1064f89045452c3c1cab5e07c787\": rpc error: code = NotFound desc = could not find container \"0169554d492bf806f96bbd9fb85b73468e4a1064f89045452c3c1cab5e07c787\": container with ID starting with 0169554d492bf806f96bbd9fb85b73468e4a1064f89045452c3c1cab5e07c787 not found: ID does not exist" Jul 17 17:32:41.677514 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.677493 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-644dd77dcb-5d5fk"] Jul 17 17:32:41.681238 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.681210 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-644dd77dcb-5d5fk"] Jul 17 17:32:41.877267 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:41.877233 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d" path="/var/lib/kubelet/pods/c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d/volumes" Jul 17 17:32:45.631840 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:45.631792 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5466c965b9-bbv7d" podUID="c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a" containerName="console" containerID="cri-o://61d369355e5659b30c4c98f4be1576ce11aee576596349a929d057541a07fa2a" gracePeriod=15 Jul 17 17:32:45.974306 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:45.974275 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:46.049295 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.049263 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-service-ca\") pod \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " Jul 17 17:32:46.049478 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.049307 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jqqt\" (UniqueName: \"kubernetes.io/projected/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-kube-api-access-8jqqt\") pod \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " Jul 17 17:32:46.049478 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.049354 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-trusted-ca-bundle\") pod \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " Jul 17 17:32:46.049478 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.049381 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-serving-cert\") pod \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " Jul 17 17:32:46.049478 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.049410 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-oauth-config\") pod \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " Jul 17 17:32:46.049478 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.049439 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-config\") pod \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " Jul 17 17:32:46.049478 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.049473 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-oauth-serving-cert\") pod \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\" (UID: \"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a\") " Jul 17 17:32:46.049815 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.049643 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-service-ca" (OuterVolumeSpecName: "service-ca") pod "c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a" (UID: "c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:32:46.049874 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.049836 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a" (UID: "c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:32:46.049933 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.049908 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-config" (OuterVolumeSpecName: "console-config") pod "c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a" (UID: "c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:32:46.049978 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.049962 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a" (UID: "c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:32:46.051668 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.051645 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a" (UID: "c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:32:46.051790 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.051694 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a" (UID: "c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:32:46.051855 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.051798 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-kube-api-access-8jqqt" (OuterVolumeSpecName: "kube-api-access-8jqqt") pod "c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a" (UID: "c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a"). InnerVolumeSpecName "kube-api-access-8jqqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:32:46.150977 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.150939 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-trusted-ca-bundle\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:46.150977 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.150972 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-serving-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:46.150977 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.150981 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-oauth-config\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:46.151198 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.150990 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-console-config\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:46.151198 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.150999 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-oauth-serving-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:46.151198 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.151008 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-service-ca\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:46.151198 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.151016 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jqqt\" (UniqueName: \"kubernetes.io/projected/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a-kube-api-access-8jqqt\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:46.680204 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.680169 2557 generic.go:356] "Generic (PLEG): container finished" podID="c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a" containerID="61d369355e5659b30c4c98f4be1576ce11aee576596349a929d057541a07fa2a" exitCode=0 Jul 17 17:32:46.680714 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.680216 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5466c965b9-bbv7d" Jul 17 17:32:46.680714 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.680250 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5466c965b9-bbv7d" event={"ID":"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a","Type":"ContainerDied","Data":"61d369355e5659b30c4c98f4be1576ce11aee576596349a929d057541a07fa2a"} Jul 17 17:32:46.680714 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.680299 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5466c965b9-bbv7d" event={"ID":"c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a","Type":"ContainerDied","Data":"5fdb87da97dcfaddee44596659a246c868ff099d7d93f1041a2ac9a546426c2f"} Jul 17 17:32:46.680714 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.680321 2557 scope.go:117] "RemoveContainer" containerID="61d369355e5659b30c4c98f4be1576ce11aee576596349a929d057541a07fa2a" Jul 17 17:32:46.689101 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.689085 2557 scope.go:117] "RemoveContainer" containerID="61d369355e5659b30c4c98f4be1576ce11aee576596349a929d057541a07fa2a" Jul 17 17:32:46.689376 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:32:46.689358 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61d369355e5659b30c4c98f4be1576ce11aee576596349a929d057541a07fa2a\": container with ID starting with 61d369355e5659b30c4c98f4be1576ce11aee576596349a929d057541a07fa2a not found: ID does not exist" containerID="61d369355e5659b30c4c98f4be1576ce11aee576596349a929d057541a07fa2a" Jul 17 17:32:46.689423 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.689383 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d369355e5659b30c4c98f4be1576ce11aee576596349a929d057541a07fa2a"} err="failed to get container status \"61d369355e5659b30c4c98f4be1576ce11aee576596349a929d057541a07fa2a\": rpc error: code = NotFound desc = could not find container \"61d369355e5659b30c4c98f4be1576ce11aee576596349a929d057541a07fa2a\": container with ID starting with 61d369355e5659b30c4c98f4be1576ce11aee576596349a929d057541a07fa2a not found: ID does not exist" Jul 17 17:32:46.702690 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.702655 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5466c965b9-bbv7d"] Jul 17 17:32:46.711766 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:46.711744 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5466c965b9-bbv7d"] Jul 17 17:32:47.877695 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:47.877650 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a" path="/var/lib/kubelet/pods/c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a/volumes" Jul 17 17:32:48.691671 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:48.691639 2557 generic.go:356] "Generic (PLEG): container finished" podID="3398a5d5-1531-4672-906c-ce042e4d7eef" containerID="cf5c1eb5a1f97e7c14a32342c4e721ab08c7e43d0b62cdfd806496a5fa81f9a3" exitCode=0 Jul 17 17:32:48.691851 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:48.691714 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" event={"ID":"3398a5d5-1531-4672-906c-ce042e4d7eef","Type":"ContainerDied","Data":"cf5c1eb5a1f97e7c14a32342c4e721ab08c7e43d0b62cdfd806496a5fa81f9a3"} Jul 17 17:32:48.692055 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:48.692041 2557 scope.go:117] "RemoveContainer" containerID="cf5c1eb5a1f97e7c14a32342c4e721ab08c7e43d0b62cdfd806496a5fa81f9a3" Jul 17 17:32:49.698231 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:49.698194 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6jr7d" event={"ID":"3398a5d5-1531-4672-906c-ce042e4d7eef","Type":"ContainerStarted","Data":"6c42e1faf156a15fa0dfed36ed4d8c76d86f770901d88b6d652cf328a72e1ae0"} Jul 17 17:32:56.762189 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:56.762122 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dd4bf87d8-vd929" podUID="dcf02c06-9eb9-4813-a985-bf1ed5eeb23d" containerName="console" containerID="cri-o://5c9b31075c2a8adb00fc8bacd637c46a9bc9a8a130a47995f0166ee1bd9a07ba" gracePeriod=15 Jul 17 17:32:57.072455 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.072422 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:32:57.143307 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.143271 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-oauth-config\") pod \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " Jul 17 17:32:57.143475 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.143322 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-service-ca\") pod \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " Jul 17 17:32:57.143475 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.143343 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-serving-cert\") pod \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " Jul 17 17:32:57.143594 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.143535 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-config\") pod \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " Jul 17 17:32:57.143700 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.143659 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dd2f\" (UniqueName: \"kubernetes.io/projected/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-kube-api-access-5dd2f\") pod \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " Jul 17 17:32:57.143700 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.143670 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-service-ca" (OuterVolumeSpecName: "service-ca") pod "dcf02c06-9eb9-4813-a985-bf1ed5eeb23d" (UID: "dcf02c06-9eb9-4813-a985-bf1ed5eeb23d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:32:57.143819 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.143722 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-oauth-serving-cert\") pod \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\" (UID: \"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d\") " Jul 17 17:32:57.143983 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.143966 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-service-ca\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:57.144056 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.143997 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-config" (OuterVolumeSpecName: "console-config") pod "dcf02c06-9eb9-4813-a985-bf1ed5eeb23d" (UID: "dcf02c06-9eb9-4813-a985-bf1ed5eeb23d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:32:57.144114 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.144062 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dcf02c06-9eb9-4813-a985-bf1ed5eeb23d" (UID: "dcf02c06-9eb9-4813-a985-bf1ed5eeb23d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:32:57.145508 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.145478 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dcf02c06-9eb9-4813-a985-bf1ed5eeb23d" (UID: "dcf02c06-9eb9-4813-a985-bf1ed5eeb23d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:32:57.145652 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.145632 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-kube-api-access-5dd2f" (OuterVolumeSpecName: "kube-api-access-5dd2f") pod "dcf02c06-9eb9-4813-a985-bf1ed5eeb23d" (UID: "dcf02c06-9eb9-4813-a985-bf1ed5eeb23d"). InnerVolumeSpecName "kube-api-access-5dd2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:32:57.145743 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.145652 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dcf02c06-9eb9-4813-a985-bf1ed5eeb23d" (UID: "dcf02c06-9eb9-4813-a985-bf1ed5eeb23d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:32:57.244537 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.244508 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-config\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:57.244537 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.244531 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dd2f\" (UniqueName: \"kubernetes.io/projected/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-kube-api-access-5dd2f\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:57.244537 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.244541 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-oauth-serving-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:57.244774 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.244551 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-oauth-config\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:57.244774 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.244559 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d-console-serving-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:32:57.733108 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.733073 2557 generic.go:356] "Generic (PLEG): container finished" podID="dcf02c06-9eb9-4813-a985-bf1ed5eeb23d" containerID="5c9b31075c2a8adb00fc8bacd637c46a9bc9a8a130a47995f0166ee1bd9a07ba" exitCode=0 Jul 17 17:32:57.733321 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.733119 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd4bf87d8-vd929" Jul 17 17:32:57.733321 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.733153 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd4bf87d8-vd929" event={"ID":"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d","Type":"ContainerDied","Data":"5c9b31075c2a8adb00fc8bacd637c46a9bc9a8a130a47995f0166ee1bd9a07ba"} Jul 17 17:32:57.733321 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.733203 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd4bf87d8-vd929" event={"ID":"dcf02c06-9eb9-4813-a985-bf1ed5eeb23d","Type":"ContainerDied","Data":"09a3f3a637d871d2737f5de533ddf54941dfae18ba36fcdeea159a3759011b76"} Jul 17 17:32:57.733321 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.733223 2557 scope.go:117] "RemoveContainer" containerID="5c9b31075c2a8adb00fc8bacd637c46a9bc9a8a130a47995f0166ee1bd9a07ba" Jul 17 17:32:57.742530 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.742515 2557 scope.go:117] "RemoveContainer" containerID="5c9b31075c2a8adb00fc8bacd637c46a9bc9a8a130a47995f0166ee1bd9a07ba" Jul 17 17:32:57.742818 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:32:57.742801 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c9b31075c2a8adb00fc8bacd637c46a9bc9a8a130a47995f0166ee1bd9a07ba\": container with ID starting with 5c9b31075c2a8adb00fc8bacd637c46a9bc9a8a130a47995f0166ee1bd9a07ba not found: ID does not exist" containerID="5c9b31075c2a8adb00fc8bacd637c46a9bc9a8a130a47995f0166ee1bd9a07ba" Jul 17 17:32:57.742884 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.742827 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9b31075c2a8adb00fc8bacd637c46a9bc9a8a130a47995f0166ee1bd9a07ba"} err="failed to get container status \"5c9b31075c2a8adb00fc8bacd637c46a9bc9a8a130a47995f0166ee1bd9a07ba\": rpc error: code = NotFound desc = could not find container \"5c9b31075c2a8adb00fc8bacd637c46a9bc9a8a130a47995f0166ee1bd9a07ba\": container with ID starting with 5c9b31075c2a8adb00fc8bacd637c46a9bc9a8a130a47995f0166ee1bd9a07ba not found: ID does not exist" Jul 17 17:32:57.754008 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.753983 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dd4bf87d8-vd929"] Jul 17 17:32:57.758200 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.758181 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dd4bf87d8-vd929"] Jul 17 17:32:57.877932 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:32:57.877890 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcf02c06-9eb9-4813-a985-bf1ed5eeb23d" path="/var/lib/kubelet/pods/dcf02c06-9eb9-4813-a985-bf1ed5eeb23d/volumes" Jul 17 17:33:41.236992 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:33:41.236959 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fcf8f4748-wv2jn"] Jul 17 17:34:06.257451 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.257383 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fcf8f4748-wv2jn" podUID="748e323f-531f-4edd-82fe-f9601e002437" containerName="console" containerID="cri-o://a86477d94b0f7d623edfd853e1574cdc71882d1185a8b97a5f4109f4d66dce9f" gracePeriod=15 Jul 17 17:34:06.544051 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.544024 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:34:06.714931 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.714900 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-console-config\") pod \"748e323f-531f-4edd-82fe-f9601e002437\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " Jul 17 17:34:06.715120 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.714946 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/748e323f-531f-4edd-82fe-f9601e002437-console-serving-cert\") pod \"748e323f-531f-4edd-82fe-f9601e002437\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " Jul 17 17:34:06.715120 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.714969 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-oauth-serving-cert\") pod \"748e323f-531f-4edd-82fe-f9601e002437\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " Jul 17 17:34:06.715120 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.715103 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/748e323f-531f-4edd-82fe-f9601e002437-console-oauth-config\") pod \"748e323f-531f-4edd-82fe-f9601e002437\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " Jul 17 17:34:06.715288 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.715173 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-trusted-ca-bundle\") pod \"748e323f-531f-4edd-82fe-f9601e002437\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " Jul 17 17:34:06.715288 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.715202 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fwrh\" (UniqueName: \"kubernetes.io/projected/748e323f-531f-4edd-82fe-f9601e002437-kube-api-access-9fwrh\") pod \"748e323f-531f-4edd-82fe-f9601e002437\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " Jul 17 17:34:06.715288 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.715240 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-service-ca\") pod \"748e323f-531f-4edd-82fe-f9601e002437\" (UID: \"748e323f-531f-4edd-82fe-f9601e002437\") " Jul 17 17:34:06.715435 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.715315 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-console-config" (OuterVolumeSpecName: "console-config") pod "748e323f-531f-4edd-82fe-f9601e002437" (UID: "748e323f-531f-4edd-82fe-f9601e002437"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:34:06.715435 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.715343 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "748e323f-531f-4edd-82fe-f9601e002437" (UID: "748e323f-531f-4edd-82fe-f9601e002437"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:34:06.715628 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.715606 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-console-config\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:34:06.715778 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.715635 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-oauth-serving-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:34:06.715778 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.715598 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "748e323f-531f-4edd-82fe-f9601e002437" (UID: "748e323f-531f-4edd-82fe-f9601e002437"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:34:06.715778 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.715615 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-service-ca" (OuterVolumeSpecName: "service-ca") pod "748e323f-531f-4edd-82fe-f9601e002437" (UID: "748e323f-531f-4edd-82fe-f9601e002437"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:34:06.717115 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.717093 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/748e323f-531f-4edd-82fe-f9601e002437-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "748e323f-531f-4edd-82fe-f9601e002437" (UID: "748e323f-531f-4edd-82fe-f9601e002437"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:34:06.717626 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.717597 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/748e323f-531f-4edd-82fe-f9601e002437-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "748e323f-531f-4edd-82fe-f9601e002437" (UID: "748e323f-531f-4edd-82fe-f9601e002437"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:34:06.717626 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.717609 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/748e323f-531f-4edd-82fe-f9601e002437-kube-api-access-9fwrh" (OuterVolumeSpecName: "kube-api-access-9fwrh") pod "748e323f-531f-4edd-82fe-f9601e002437" (UID: "748e323f-531f-4edd-82fe-f9601e002437"). InnerVolumeSpecName "kube-api-access-9fwrh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:34:06.816157 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.816070 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/748e323f-531f-4edd-82fe-f9601e002437-console-serving-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:34:06.816157 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.816101 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/748e323f-531f-4edd-82fe-f9601e002437-console-oauth-config\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:34:06.816157 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.816111 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-trusted-ca-bundle\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:34:06.816157 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.816121 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fwrh\" (UniqueName: \"kubernetes.io/projected/748e323f-531f-4edd-82fe-f9601e002437-kube-api-access-9fwrh\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:34:06.816157 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:06.816130 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/748e323f-531f-4edd-82fe-f9601e002437-service-ca\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:34:07.026390 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:07.026348 2557 generic.go:356] "Generic (PLEG): container finished" podID="748e323f-531f-4edd-82fe-f9601e002437" containerID="a86477d94b0f7d623edfd853e1574cdc71882d1185a8b97a5f4109f4d66dce9f" exitCode=0 Jul 17 17:34:07.026390 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:07.026395 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fcf8f4748-wv2jn" Jul 17 17:34:07.026614 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:07.026436 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fcf8f4748-wv2jn" event={"ID":"748e323f-531f-4edd-82fe-f9601e002437","Type":"ContainerDied","Data":"a86477d94b0f7d623edfd853e1574cdc71882d1185a8b97a5f4109f4d66dce9f"} Jul 17 17:34:07.026614 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:07.026487 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fcf8f4748-wv2jn" event={"ID":"748e323f-531f-4edd-82fe-f9601e002437","Type":"ContainerDied","Data":"5ce1610012f9783a5bcb721619963f839195238ffae4f312fc520ff9541331c5"} Jul 17 17:34:07.026614 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:07.026507 2557 scope.go:117] "RemoveContainer" containerID="a86477d94b0f7d623edfd853e1574cdc71882d1185a8b97a5f4109f4d66dce9f" Jul 17 17:34:07.035062 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:07.035046 2557 scope.go:117] "RemoveContainer" containerID="a86477d94b0f7d623edfd853e1574cdc71882d1185a8b97a5f4109f4d66dce9f" Jul 17 17:34:07.035338 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:34:07.035320 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a86477d94b0f7d623edfd853e1574cdc71882d1185a8b97a5f4109f4d66dce9f\": container with ID starting with a86477d94b0f7d623edfd853e1574cdc71882d1185a8b97a5f4109f4d66dce9f not found: ID does not exist" containerID="a86477d94b0f7d623edfd853e1574cdc71882d1185a8b97a5f4109f4d66dce9f" Jul 17 17:34:07.035406 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:07.035346 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a86477d94b0f7d623edfd853e1574cdc71882d1185a8b97a5f4109f4d66dce9f"} err="failed to get container status \"a86477d94b0f7d623edfd853e1574cdc71882d1185a8b97a5f4109f4d66dce9f\": rpc error: code = NotFound desc = could not find container \"a86477d94b0f7d623edfd853e1574cdc71882d1185a8b97a5f4109f4d66dce9f\": container with ID starting with a86477d94b0f7d623edfd853e1574cdc71882d1185a8b97a5f4109f4d66dce9f not found: ID does not exist" Jul 17 17:34:07.046237 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:07.046213 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fcf8f4748-wv2jn"] Jul 17 17:34:07.049564 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:07.049544 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fcf8f4748-wv2jn"] Jul 17 17:34:07.877476 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:34:07.877444 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="748e323f-531f-4edd-82fe-f9601e002437" path="/var/lib/kubelet/pods/748e323f-531f-4edd-82fe-f9601e002437/volumes" Jul 17 17:35:12.617265 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.617228 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8"] Jul 17 17:35:12.617700 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.617652 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d" containerName="registry" Jul 17 17:35:12.617700 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.617670 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d" containerName="registry" Jul 17 17:35:12.617785 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.617713 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="748e323f-531f-4edd-82fe-f9601e002437" containerName="console" Jul 17 17:35:12.617785 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.617722 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="748e323f-531f-4edd-82fe-f9601e002437" containerName="console" Jul 17 17:35:12.617785 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.617741 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a" containerName="console" Jul 17 17:35:12.617785 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.617750 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a" containerName="console" Jul 17 17:35:12.617785 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.617781 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcf02c06-9eb9-4813-a985-bf1ed5eeb23d" containerName="console" Jul 17 17:35:12.617928 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.617790 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcf02c06-9eb9-4813-a985-bf1ed5eeb23d" containerName="console" Jul 17 17:35:12.617928 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.617878 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="748e323f-531f-4edd-82fe-f9601e002437" containerName="console" Jul 17 17:35:12.617928 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.617892 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8db9e5a-fb13-4ae5-a1d1-1fa68080c09d" containerName="registry" Jul 17 17:35:12.617928 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.617905 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2dbfc96-c62b-426f-bca3-bc71e3bbdf2a" containerName="console" Jul 17 17:35:12.617928 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.617915 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcf02c06-9eb9-4813-a985-bf1ed5eeb23d" containerName="console" Jul 17 17:35:12.621342 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.621323 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.625211 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.625186 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 17 17:35:12.625211 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.625207 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rvvj5\"" Jul 17 17:35:12.625435 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.625189 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 17 17:35:12.625435 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.625319 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 17 17:35:12.625435 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.625330 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 17 17:35:12.649148 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.649117 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8"] Jul 17 17:35:12.756741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.756707 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/496789b4-7606-43a8-adc6-48cc03d6a930-tmp\") pod \"opendatahub-operator-controller-manager-7f5f54cb78-c8lg8\" (UID: \"496789b4-7606-43a8-adc6-48cc03d6a930\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.756937 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.756752 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/496789b4-7606-43a8-adc6-48cc03d6a930-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f5f54cb78-c8lg8\" (UID: \"496789b4-7606-43a8-adc6-48cc03d6a930\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.756937 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.756790 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/496789b4-7606-43a8-adc6-48cc03d6a930-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f5f54cb78-c8lg8\" (UID: \"496789b4-7606-43a8-adc6-48cc03d6a930\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.756937 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.756809 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/496789b4-7606-43a8-adc6-48cc03d6a930-manifests\") pod \"opendatahub-operator-controller-manager-7f5f54cb78-c8lg8\" (UID: \"496789b4-7606-43a8-adc6-48cc03d6a930\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.756937 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.756876 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjrt8\" (UniqueName: \"kubernetes.io/projected/496789b4-7606-43a8-adc6-48cc03d6a930-kube-api-access-fjrt8\") pod \"opendatahub-operator-controller-manager-7f5f54cb78-c8lg8\" (UID: \"496789b4-7606-43a8-adc6-48cc03d6a930\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.858204 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.858167 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/496789b4-7606-43a8-adc6-48cc03d6a930-manifests\") pod \"opendatahub-operator-controller-manager-7f5f54cb78-c8lg8\" (UID: \"496789b4-7606-43a8-adc6-48cc03d6a930\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.858408 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.858227 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjrt8\" (UniqueName: \"kubernetes.io/projected/496789b4-7606-43a8-adc6-48cc03d6a930-kube-api-access-fjrt8\") pod \"opendatahub-operator-controller-manager-7f5f54cb78-c8lg8\" (UID: \"496789b4-7606-43a8-adc6-48cc03d6a930\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.858408 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.858306 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/496789b4-7606-43a8-adc6-48cc03d6a930-tmp\") pod \"opendatahub-operator-controller-manager-7f5f54cb78-c8lg8\" (UID: \"496789b4-7606-43a8-adc6-48cc03d6a930\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.858408 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.858346 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/496789b4-7606-43a8-adc6-48cc03d6a930-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f5f54cb78-c8lg8\" (UID: \"496789b4-7606-43a8-adc6-48cc03d6a930\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.858408 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.858384 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/496789b4-7606-43a8-adc6-48cc03d6a930-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f5f54cb78-c8lg8\" (UID: \"496789b4-7606-43a8-adc6-48cc03d6a930\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.858649 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.858623 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/496789b4-7606-43a8-adc6-48cc03d6a930-manifests\") pod \"opendatahub-operator-controller-manager-7f5f54cb78-c8lg8\" (UID: \"496789b4-7606-43a8-adc6-48cc03d6a930\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.860625 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.860602 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/496789b4-7606-43a8-adc6-48cc03d6a930-tmp\") pod \"opendatahub-operator-controller-manager-7f5f54cb78-c8lg8\" (UID: \"496789b4-7606-43a8-adc6-48cc03d6a930\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.860741 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.860722 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/496789b4-7606-43a8-adc6-48cc03d6a930-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f5f54cb78-c8lg8\" (UID: \"496789b4-7606-43a8-adc6-48cc03d6a930\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.860881 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.860858 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/496789b4-7606-43a8-adc6-48cc03d6a930-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f5f54cb78-c8lg8\" (UID: \"496789b4-7606-43a8-adc6-48cc03d6a930\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.871427 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.871379 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjrt8\" (UniqueName: \"kubernetes.io/projected/496789b4-7606-43a8-adc6-48cc03d6a930-kube-api-access-fjrt8\") pod \"opendatahub-operator-controller-manager-7f5f54cb78-c8lg8\" (UID: \"496789b4-7606-43a8-adc6-48cc03d6a930\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:12.933387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:12.933357 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:13.076934 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:13.076910 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8"] Jul 17 17:35:13.079128 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:35:13.079102 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496789b4_7606_43a8_adc6_48cc03d6a930.slice/crio-f7571c4aa7b16e87d7964b3ed14a6a1735266fde39893c3d29875df87bc7c9c7 WatchSource:0}: Error finding container f7571c4aa7b16e87d7964b3ed14a6a1735266fde39893c3d29875df87bc7c9c7: Status 404 returned error can't find the container with id f7571c4aa7b16e87d7964b3ed14a6a1735266fde39893c3d29875df87bc7c9c7 Jul 17 17:35:13.295598 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:13.295514 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" event={"ID":"496789b4-7606-43a8-adc6-48cc03d6a930","Type":"ContainerStarted","Data":"f7571c4aa7b16e87d7964b3ed14a6a1735266fde39893c3d29875df87bc7c9c7"} Jul 17 17:35:16.312360 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:16.312281 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" event={"ID":"496789b4-7606-43a8-adc6-48cc03d6a930","Type":"ContainerStarted","Data":"c0151bef0e71f2084b3dc6c5dbfcc206b9800cd3a80797eb75e435de3183e6c2"} Jul 17 17:35:17.317299 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:17.317268 2557 generic.go:356] "Generic (PLEG): container finished" podID="496789b4-7606-43a8-adc6-48cc03d6a930" containerID="c0151bef0e71f2084b3dc6c5dbfcc206b9800cd3a80797eb75e435de3183e6c2" exitCode=0 Jul 17 17:35:17.317671 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:17.317334 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" event={"ID":"496789b4-7606-43a8-adc6-48cc03d6a930","Type":"ContainerDied","Data":"c0151bef0e71f2084b3dc6c5dbfcc206b9800cd3a80797eb75e435de3183e6c2"} Jul 17 17:35:18.324455 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:18.324421 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" event={"ID":"496789b4-7606-43a8-adc6-48cc03d6a930","Type":"ContainerStarted","Data":"8c08159bc1babbbc77852d75cb705b87ecb6eea8ad04d49018fa45507f46cdf1"} Jul 17 17:35:18.324887 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:18.324576 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:18.348968 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:18.348918 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" podStartSLOduration=2.105669271 podStartE2EDuration="6.348903522s" totalImagesPullingTime="3.225269151s" totalInitContainerRuntime="1.0179651s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:35:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:35:18.34763689 +0000 UTC m=+286.958306271" watchObservedRunningTime="2026-07-17 17:35:18.348903522 +0000 UTC m=+286.959572904" Jul 17 17:35:29.331904 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:29.331860 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f5f54cb78-c8lg8" Jul 17 17:35:31.833946 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:31.833916 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 17:35:31.835384 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:31.835363 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 17:35:31.844577 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:31.844558 2557 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 17:35:38.386770 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.386728 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv"] Jul 17 17:35:38.391439 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.391420 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:35:38.396523 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.396501 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 17 17:35:38.397535 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.397508 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 17 17:35:38.397627 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.397529 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vhxp4\"" Jul 17 17:35:38.397627 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.397563 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 17 17:35:38.397789 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.397690 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:35:38.397866 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.397848 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 17 17:35:38.414038 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.414006 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv"] Jul 17 17:35:38.453786 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.453753 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/96d9f7e3-0f69-40e7-a453-795dce81b983-metrics-cert\") pod \"lws-controller-manager-76cbd9fc7d-n8vbv\" (UID: \"96d9f7e3-0f69-40e7-a453-795dce81b983\") " pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:35:38.453976 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.453804 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96d9f7e3-0f69-40e7-a453-795dce81b983-cert\") pod \"lws-controller-manager-76cbd9fc7d-n8vbv\" (UID: \"96d9f7e3-0f69-40e7-a453-795dce81b983\") " pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:35:38.453976 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.453871 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/96d9f7e3-0f69-40e7-a453-795dce81b983-manager-config\") pod \"lws-controller-manager-76cbd9fc7d-n8vbv\" (UID: \"96d9f7e3-0f69-40e7-a453-795dce81b983\") " pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:35:38.453976 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.453901 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qvpf\" (UniqueName: \"kubernetes.io/projected/96d9f7e3-0f69-40e7-a453-795dce81b983-kube-api-access-8qvpf\") pod \"lws-controller-manager-76cbd9fc7d-n8vbv\" (UID: \"96d9f7e3-0f69-40e7-a453-795dce81b983\") " pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:35:38.554474 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.554438 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/96d9f7e3-0f69-40e7-a453-795dce81b983-metrics-cert\") pod \"lws-controller-manager-76cbd9fc7d-n8vbv\" (UID: \"96d9f7e3-0f69-40e7-a453-795dce81b983\") " pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:35:38.554660 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.554489 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96d9f7e3-0f69-40e7-a453-795dce81b983-cert\") pod \"lws-controller-manager-76cbd9fc7d-n8vbv\" (UID: \"96d9f7e3-0f69-40e7-a453-795dce81b983\") " pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:35:38.554660 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.554517 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/96d9f7e3-0f69-40e7-a453-795dce81b983-manager-config\") pod \"lws-controller-manager-76cbd9fc7d-n8vbv\" (UID: \"96d9f7e3-0f69-40e7-a453-795dce81b983\") " pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:35:38.554660 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.554537 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qvpf\" (UniqueName: \"kubernetes.io/projected/96d9f7e3-0f69-40e7-a453-795dce81b983-kube-api-access-8qvpf\") pod \"lws-controller-manager-76cbd9fc7d-n8vbv\" (UID: \"96d9f7e3-0f69-40e7-a453-795dce81b983\") " pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:35:38.555281 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.555260 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/96d9f7e3-0f69-40e7-a453-795dce81b983-manager-config\") pod \"lws-controller-manager-76cbd9fc7d-n8vbv\" (UID: \"96d9f7e3-0f69-40e7-a453-795dce81b983\") " pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:35:38.557147 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.557121 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96d9f7e3-0f69-40e7-a453-795dce81b983-cert\") pod \"lws-controller-manager-76cbd9fc7d-n8vbv\" (UID: \"96d9f7e3-0f69-40e7-a453-795dce81b983\") " pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:35:38.557234 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.557121 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/96d9f7e3-0f69-40e7-a453-795dce81b983-metrics-cert\") pod \"lws-controller-manager-76cbd9fc7d-n8vbv\" (UID: \"96d9f7e3-0f69-40e7-a453-795dce81b983\") " pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:35:38.576054 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.576024 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qvpf\" (UniqueName: \"kubernetes.io/projected/96d9f7e3-0f69-40e7-a453-795dce81b983-kube-api-access-8qvpf\") pod \"lws-controller-manager-76cbd9fc7d-n8vbv\" (UID: \"96d9f7e3-0f69-40e7-a453-795dce81b983\") " pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:35:38.701461 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.701387 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:35:38.844544 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:35:38.844512 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d9f7e3_0f69_40e7_a453_795dce81b983.slice/crio-8ecc249005a8ef9a32cc1465e3c4eb0c1d41d041d10abcc5f4a1884a667e15e9 WatchSource:0}: Error finding container 8ecc249005a8ef9a32cc1465e3c4eb0c1d41d041d10abcc5f4a1884a667e15e9: Status 404 returned error can't find the container with id 8ecc249005a8ef9a32cc1465e3c4eb0c1d41d041d10abcc5f4a1884a667e15e9 Jul 17 17:35:38.846644 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.846628 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 17:35:38.849642 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:38.849620 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv"] Jul 17 17:35:39.421724 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:39.421669 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" event={"ID":"96d9f7e3-0f69-40e7-a453-795dce81b983","Type":"ContainerStarted","Data":"8ecc249005a8ef9a32cc1465e3c4eb0c1d41d041d10abcc5f4a1884a667e15e9"} Jul 17 17:35:41.432385 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:41.432341 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" event={"ID":"96d9f7e3-0f69-40e7-a453-795dce81b983","Type":"ContainerStarted","Data":"a286d98a7293bef1556e27528394e67025748ab1381ac215fc38023c37620650"} Jul 17 17:35:41.432833 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:41.432442 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:35:41.502519 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:41.502464 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" podStartSLOduration=1.076824596 podStartE2EDuration="3.502450365s" totalImagesPullingTime="2.425625769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:35:41.501477046 +0000 UTC m=+310.112146429" watchObservedRunningTime="2026-07-17 17:35:41.502450365 +0000 UTC m=+310.113119746" Jul 17 17:35:43.320857 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.320821 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm"] Jul 17 17:35:43.324565 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.324545 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.328931 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.328909 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 17 17:35:43.334636 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.334618 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mzrrr\"" Jul 17 17:35:43.364706 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.364648 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm"] Jul 17 17:35:43.398340 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.398303 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8642dbf-2d25-4e11-819c-209f7d49be2d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.398340 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.398346 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8642dbf-2d25-4e11-819c-209f7d49be2d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.398595 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.398367 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8642dbf-2d25-4e11-819c-209f7d49be2d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.398595 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.398407 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8642dbf-2d25-4e11-819c-209f7d49be2d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.398595 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.398424 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf75w\" (UniqueName: \"kubernetes.io/projected/a8642dbf-2d25-4e11-819c-209f7d49be2d-kube-api-access-pf75w\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.398595 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.398443 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8642dbf-2d25-4e11-819c-209f7d49be2d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.398595 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.398467 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8642dbf-2d25-4e11-819c-209f7d49be2d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.398595 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.398514 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8642dbf-2d25-4e11-819c-209f7d49be2d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.398595 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.398581 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8642dbf-2d25-4e11-819c-209f7d49be2d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.499912 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.499872 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8642dbf-2d25-4e11-819c-209f7d49be2d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.499912 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.499916 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8642dbf-2d25-4e11-819c-209f7d49be2d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.500162 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.499934 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8642dbf-2d25-4e11-819c-209f7d49be2d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.500162 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.499957 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8642dbf-2d25-4e11-819c-209f7d49be2d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.500162 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.499981 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf75w\" (UniqueName: \"kubernetes.io/projected/a8642dbf-2d25-4e11-819c-209f7d49be2d-kube-api-access-pf75w\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.500162 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.500015 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8642dbf-2d25-4e11-819c-209f7d49be2d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.500162 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.500052 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8642dbf-2d25-4e11-819c-209f7d49be2d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.500162 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.500074 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8642dbf-2d25-4e11-819c-209f7d49be2d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.500162 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.500119 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8642dbf-2d25-4e11-819c-209f7d49be2d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.500520 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.500391 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8642dbf-2d25-4e11-819c-209f7d49be2d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.500580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.500562 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8642dbf-2d25-4e11-819c-209f7d49be2d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.500696 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.500651 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8642dbf-2d25-4e11-819c-209f7d49be2d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.500789 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.500765 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8642dbf-2d25-4e11-819c-209f7d49be2d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.500861 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.500844 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8642dbf-2d25-4e11-819c-209f7d49be2d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.502195 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.502170 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8642dbf-2d25-4e11-819c-209f7d49be2d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.502538 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.502522 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8642dbf-2d25-4e11-819c-209f7d49be2d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.520833 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.520810 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8642dbf-2d25-4e11-819c-209f7d49be2d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.529935 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.529912 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf75w\" (UniqueName: \"kubernetes.io/projected/a8642dbf-2d25-4e11-819c-209f7d49be2d-kube-api-access-pf75w\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678k5kfm\" (UID: \"a8642dbf-2d25-4e11-819c-209f7d49be2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.634737 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.634704 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:43.826959 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:35:43.826924 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8642dbf_2d25_4e11_819c_209f7d49be2d.slice/crio-87c2e61c6f9a949fff5a21b84371f56ec1b31997f04de02cc756b65e6761720b WatchSource:0}: Error finding container 87c2e61c6f9a949fff5a21b84371f56ec1b31997f04de02cc756b65e6761720b: Status 404 returned error can't find the container with id 87c2e61c6f9a949fff5a21b84371f56ec1b31997f04de02cc756b65e6761720b Jul 17 17:35:43.829052 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:43.829029 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm"] Jul 17 17:35:44.447102 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:44.447061 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" event={"ID":"a8642dbf-2d25-4e11-819c-209f7d49be2d","Type":"ContainerStarted","Data":"87c2e61c6f9a949fff5a21b84371f56ec1b31997f04de02cc756b65e6761720b"} Jul 17 17:35:46.735701 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:46.735631 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:35:46.735943 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:46.735789 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:35:46.735943 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:46.735827 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:35:47.463296 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:47.463257 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" event={"ID":"a8642dbf-2d25-4e11-819c-209f7d49be2d","Type":"ContainerStarted","Data":"123dfa9c822036737ea52ed876bc8677ddd43df31e65dc762a44771e4c9f2a79"} Jul 17 17:35:47.494116 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:47.494055 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" podStartSLOduration=1.5879417820000001 podStartE2EDuration="4.494038742s" totalImagesPullingTime="2.90609696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:35:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:35:47.491828809 +0000 UTC m=+316.102498187" watchObservedRunningTime="2026-07-17 17:35:47.494038742 +0000 UTC m=+316.104708124" Jul 17 17:35:47.635869 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:47.635827 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:47.640969 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:47.640941 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:48.468980 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:48.468951 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:48.470082 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:48.470065 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678k5kfm" Jul 17 17:35:52.439248 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:35:52.439215 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76cbd9fc7d-n8vbv" Jul 17 17:37:14.457884 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:14.457843 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2"] Jul 17 17:37:14.461073 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:14.461056 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" Jul 17 17:37:14.463529 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:14.463511 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 17:37:14.464466 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:14.464452 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8mts8\"" Jul 17 17:37:14.464519 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:14.464481 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 17:37:14.474007 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:14.473981 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2"] Jul 17 17:37:14.571004 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:14.570962 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njmqz\" (UniqueName: \"kubernetes.io/projected/a4a777ec-d237-497b-9b5d-46baa4c20428-kube-api-access-njmqz\") pod \"limitador-operator-controller-manager-859d7b78bd-jcwg2\" (UID: \"a4a777ec-d237-497b-9b5d-46baa4c20428\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" Jul 17 17:37:14.672030 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:14.671991 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njmqz\" (UniqueName: \"kubernetes.io/projected/a4a777ec-d237-497b-9b5d-46baa4c20428-kube-api-access-njmqz\") pod \"limitador-operator-controller-manager-859d7b78bd-jcwg2\" (UID: \"a4a777ec-d237-497b-9b5d-46baa4c20428\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" Jul 17 17:37:14.698578 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:14.698555 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njmqz\" (UniqueName: \"kubernetes.io/projected/a4a777ec-d237-497b-9b5d-46baa4c20428-kube-api-access-njmqz\") pod \"limitador-operator-controller-manager-859d7b78bd-jcwg2\" (UID: \"a4a777ec-d237-497b-9b5d-46baa4c20428\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" Jul 17 17:37:14.770792 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:14.770712 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" Jul 17 17:37:14.908141 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:14.907997 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2"] Jul 17 17:37:14.910647 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:37:14.910621 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a777ec_d237_497b_9b5d_46baa4c20428.slice/crio-8060576eecd2fd1eab180730ca195a2c7722172c9535322041128825286ef634 WatchSource:0}: Error finding container 8060576eecd2fd1eab180730ca195a2c7722172c9535322041128825286ef634: Status 404 returned error can't find the container with id 8060576eecd2fd1eab180730ca195a2c7722172c9535322041128825286ef634 Jul 17 17:37:15.846748 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:15.846713 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" event={"ID":"a4a777ec-d237-497b-9b5d-46baa4c20428","Type":"ContainerStarted","Data":"8060576eecd2fd1eab180730ca195a2c7722172c9535322041128825286ef634"} Jul 17 17:37:17.858019 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:17.857984 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" event={"ID":"a4a777ec-d237-497b-9b5d-46baa4c20428","Type":"ContainerStarted","Data":"332d22de37d74989f1e7aae893ef2e6b718814b7fbf044c3fb65c03a12341c69"} Jul 17 17:37:17.858523 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:17.858074 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" Jul 17 17:37:17.875050 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:17.875002 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" podStartSLOduration=1.7106895789999998 podStartE2EDuration="3.874988461s" totalImagesPullingTime="2.164298882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:37:17.873163451 +0000 UTC m=+406.483832844" watchObservedRunningTime="2026-07-17 17:37:17.874988461 +0000 UTC m=+406.485657842" Jul 17 17:37:22.803054 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.803015 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bf998f697-lrtz5"] Jul 17 17:37:22.806868 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.806841 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:22.809423 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.809395 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 17 17:37:22.809585 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.809458 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 17 17:37:22.809751 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.809546 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qd42z\"" Jul 17 17:37:22.810523 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.810499 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 17 17:37:22.810767 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.810747 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 17 17:37:22.812136 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.812115 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 17 17:37:22.816700 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.816656 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 17 17:37:22.821096 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.821074 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf998f697-lrtz5"] Jul 17 17:37:22.944997 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.944960 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a8d18bf-b811-4b68-b622-b18c0e55caae-console-serving-cert\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:22.944997 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.945000 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a8d18bf-b811-4b68-b622-b18c0e55caae-console-oauth-config\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:22.945245 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.945046 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a8d18bf-b811-4b68-b622-b18c0e55caae-service-ca\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:22.945245 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.945070 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr5v9\" (UniqueName: \"kubernetes.io/projected/3a8d18bf-b811-4b68-b622-b18c0e55caae-kube-api-access-dr5v9\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:22.945245 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.945161 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a8d18bf-b811-4b68-b622-b18c0e55caae-oauth-serving-cert\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:22.945245 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.945189 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a8d18bf-b811-4b68-b622-b18c0e55caae-console-config\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:22.945245 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:22.945208 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a8d18bf-b811-4b68-b622-b18c0e55caae-trusted-ca-bundle\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.045949 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.045903 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a8d18bf-b811-4b68-b622-b18c0e55caae-console-serving-cert\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.045949 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.045948 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a8d18bf-b811-4b68-b622-b18c0e55caae-console-oauth-config\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.046294 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.046049 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a8d18bf-b811-4b68-b622-b18c0e55caae-service-ca\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.046294 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.046067 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr5v9\" (UniqueName: \"kubernetes.io/projected/3a8d18bf-b811-4b68-b622-b18c0e55caae-kube-api-access-dr5v9\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.046294 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.046104 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a8d18bf-b811-4b68-b622-b18c0e55caae-oauth-serving-cert\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.046294 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.046120 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a8d18bf-b811-4b68-b622-b18c0e55caae-console-config\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.046294 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.046140 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a8d18bf-b811-4b68-b622-b18c0e55caae-trusted-ca-bundle\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.046944 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.046916 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a8d18bf-b811-4b68-b622-b18c0e55caae-service-ca\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.047065 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.046916 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a8d18bf-b811-4b68-b622-b18c0e55caae-console-config\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.047065 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.047000 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a8d18bf-b811-4b68-b622-b18c0e55caae-oauth-serving-cert\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.047065 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.047010 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a8d18bf-b811-4b68-b622-b18c0e55caae-trusted-ca-bundle\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.048378 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.048360 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a8d18bf-b811-4b68-b622-b18c0e55caae-console-oauth-config\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.048485 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.048469 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a8d18bf-b811-4b68-b622-b18c0e55caae-console-serving-cert\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.054094 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.054045 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr5v9\" (UniqueName: \"kubernetes.io/projected/3a8d18bf-b811-4b68-b622-b18c0e55caae-kube-api-access-dr5v9\") pod \"console-7bf998f697-lrtz5\" (UID: \"3a8d18bf-b811-4b68-b622-b18c0e55caae\") " pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.118465 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.118424 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:23.249622 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.249542 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf998f697-lrtz5"] Jul 17 17:37:23.251877 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:37:23.251839 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a8d18bf_b811_4b68_b622_b18c0e55caae.slice/crio-e0596635bda3d56ba988c436a967310c70c389beec4a024a764504d430fb98ad WatchSource:0}: Error finding container e0596635bda3d56ba988c436a967310c70c389beec4a024a764504d430fb98ad: Status 404 returned error can't find the container with id e0596635bda3d56ba988c436a967310c70c389beec4a024a764504d430fb98ad Jul 17 17:37:23.884433 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.884395 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf998f697-lrtz5" event={"ID":"3a8d18bf-b811-4b68-b622-b18c0e55caae","Type":"ContainerStarted","Data":"aee39a3611ad2bf9732d6bbc630d72ae5eeabb4b64da3349eaddd2ef2a9534b8"} Jul 17 17:37:23.884433 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.884441 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf998f697-lrtz5" event={"ID":"3a8d18bf-b811-4b68-b622-b18c0e55caae","Type":"ContainerStarted","Data":"e0596635bda3d56ba988c436a967310c70c389beec4a024a764504d430fb98ad"} Jul 17 17:37:23.906042 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:23.905989 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bf998f697-lrtz5" podStartSLOduration=1.9059731819999999 podStartE2EDuration="1.905973182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:37:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:37:23.905364956 +0000 UTC m=+412.516034339" watchObservedRunningTime="2026-07-17 17:37:23.905973182 +0000 UTC m=+412.516642561" Jul 17 17:37:28.865654 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:28.865626 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" Jul 17 17:37:33.039433 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.039396 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2"] Jul 17 17:37:33.039909 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.039637 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" podUID="a4a777ec-d237-497b-9b5d-46baa4c20428" containerName="manager" containerID="cri-o://332d22de37d74989f1e7aae893ef2e6b718814b7fbf044c3fb65c03a12341c69" gracePeriod=2 Jul 17 17:37:33.044031 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.044004 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2"] Jul 17 17:37:33.077705 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.077647 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bx4tb"] Jul 17 17:37:33.078037 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.078021 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4a777ec-d237-497b-9b5d-46baa4c20428" containerName="manager" Jul 17 17:37:33.078037 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.078038 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4a777ec-d237-497b-9b5d-46baa4c20428" containerName="manager" Jul 17 17:37:33.078182 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.078127 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4a777ec-d237-497b-9b5d-46baa4c20428" containerName="manager" Jul 17 17:37:33.080995 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.080980 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bx4tb" Jul 17 17:37:33.083913 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:37:33.083887 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jcwg2\" is forbidden: User \"system:node:ip-10-0-130-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-245.ec2.internal' and this object" podUID="a4a777ec-d237-497b-9b5d-46baa4c20428" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" Jul 17 17:37:33.096842 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.096814 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bx4tb"] Jul 17 17:37:33.119114 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.119082 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:33.119227 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.119140 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:33.124462 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.124439 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:33.127903 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.127878 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2zct\" (UniqueName: \"kubernetes.io/projected/85fa241d-1df4-459a-9f20-eed15a878957-kube-api-access-b2zct\") pod \"limitador-operator-controller-manager-859d7b78bd-bx4tb\" (UID: \"85fa241d-1df4-459a-9f20-eed15a878957\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bx4tb" Jul 17 17:37:33.149797 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:37:33.149754 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jcwg2\" is forbidden: User \"system:node:ip-10-0-130-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-245.ec2.internal' and this object" podUID="a4a777ec-d237-497b-9b5d-46baa4c20428" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" Jul 17 17:37:33.229476 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.229441 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2zct\" (UniqueName: \"kubernetes.io/projected/85fa241d-1df4-459a-9f20-eed15a878957-kube-api-access-b2zct\") pod \"limitador-operator-controller-manager-859d7b78bd-bx4tb\" (UID: \"85fa241d-1df4-459a-9f20-eed15a878957\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bx4tb" Jul 17 17:37:33.239441 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.239408 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2zct\" (UniqueName: \"kubernetes.io/projected/85fa241d-1df4-459a-9f20-eed15a878957-kube-api-access-b2zct\") pod \"limitador-operator-controller-manager-859d7b78bd-bx4tb\" (UID: \"85fa241d-1df4-459a-9f20-eed15a878957\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bx4tb" Jul 17 17:37:33.281213 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.281185 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" Jul 17 17:37:33.283693 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:37:33.283651 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jcwg2\" is forbidden: User \"system:node:ip-10-0-130-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-245.ec2.internal' and this object" podUID="a4a777ec-d237-497b-9b5d-46baa4c20428" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" Jul 17 17:37:33.330259 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.330187 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njmqz\" (UniqueName: \"kubernetes.io/projected/a4a777ec-d237-497b-9b5d-46baa4c20428-kube-api-access-njmqz\") pod \"a4a777ec-d237-497b-9b5d-46baa4c20428\" (UID: \"a4a777ec-d237-497b-9b5d-46baa4c20428\") " Jul 17 17:37:33.332294 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.332259 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4a777ec-d237-497b-9b5d-46baa4c20428-kube-api-access-njmqz" (OuterVolumeSpecName: "kube-api-access-njmqz") pod "a4a777ec-d237-497b-9b5d-46baa4c20428" (UID: "a4a777ec-d237-497b-9b5d-46baa4c20428"). InnerVolumeSpecName "kube-api-access-njmqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:37:33.415086 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.415043 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bx4tb" Jul 17 17:37:33.430940 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.430913 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njmqz\" (UniqueName: \"kubernetes.io/projected/a4a777ec-d237-497b-9b5d-46baa4c20428-kube-api-access-njmqz\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:37:33.557547 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.557499 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bx4tb"] Jul 17 17:37:33.559665 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:37:33.559634 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85fa241d_1df4_459a_9f20_eed15a878957.slice/crio-cc0c58470490ca94829e5001fffc1a5fbb47d0a0afdf5f6e0936d71c6fc34f5d WatchSource:0}: Error finding container cc0c58470490ca94829e5001fffc1a5fbb47d0a0afdf5f6e0936d71c6fc34f5d: Status 404 returned error can't find the container with id cc0c58470490ca94829e5001fffc1a5fbb47d0a0afdf5f6e0936d71c6fc34f5d Jul 17 17:37:33.877672 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.877580 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4a777ec-d237-497b-9b5d-46baa4c20428" path="/var/lib/kubelet/pods/a4a777ec-d237-497b-9b5d-46baa4c20428/volumes" Jul 17 17:37:33.933852 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.933814 2557 generic.go:356] "Generic (PLEG): container finished" podID="a4a777ec-d237-497b-9b5d-46baa4c20428" containerID="332d22de37d74989f1e7aae893ef2e6b718814b7fbf044c3fb65c03a12341c69" exitCode=0 Jul 17 17:37:33.934012 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.933873 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcwg2" Jul 17 17:37:33.934012 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.933872 2557 scope.go:117] "RemoveContainer" containerID="332d22de37d74989f1e7aae893ef2e6b718814b7fbf044c3fb65c03a12341c69" Jul 17 17:37:33.935735 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.935645 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bx4tb" event={"ID":"85fa241d-1df4-459a-9f20-eed15a878957","Type":"ContainerStarted","Data":"8680191a4926fd6bee413eb2e51720788eae8e3d969b897f43bd70dcc4587bcb"} Jul 17 17:37:33.935850 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.935744 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bx4tb" Jul 17 17:37:33.935850 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.935774 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bx4tb" event={"ID":"85fa241d-1df4-459a-9f20-eed15a878957","Type":"ContainerStarted","Data":"cc0c58470490ca94829e5001fffc1a5fbb47d0a0afdf5f6e0936d71c6fc34f5d"} Jul 17 17:37:33.939951 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.939929 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bf998f697-lrtz5" Jul 17 17:37:33.942760 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.942740 2557 scope.go:117] "RemoveContainer" containerID="332d22de37d74989f1e7aae893ef2e6b718814b7fbf044c3fb65c03a12341c69" Jul 17 17:37:33.943022 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:37:33.943004 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"332d22de37d74989f1e7aae893ef2e6b718814b7fbf044c3fb65c03a12341c69\": container with ID starting with 332d22de37d74989f1e7aae893ef2e6b718814b7fbf044c3fb65c03a12341c69 not found: ID does not exist" containerID="332d22de37d74989f1e7aae893ef2e6b718814b7fbf044c3fb65c03a12341c69" Jul 17 17:37:33.943069 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.943030 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"332d22de37d74989f1e7aae893ef2e6b718814b7fbf044c3fb65c03a12341c69"} err="failed to get container status \"332d22de37d74989f1e7aae893ef2e6b718814b7fbf044c3fb65c03a12341c69\": rpc error: code = NotFound desc = could not find container \"332d22de37d74989f1e7aae893ef2e6b718814b7fbf044c3fb65c03a12341c69\": container with ID starting with 332d22de37d74989f1e7aae893ef2e6b718814b7fbf044c3fb65c03a12341c69 not found: ID does not exist" Jul 17 17:37:33.954974 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:33.954934 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bx4tb" podStartSLOduration=0.95492205 podStartE2EDuration="954.92205ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:37:33.954216965 +0000 UTC m=+422.564886349" watchObservedRunningTime="2026-07-17 17:37:33.95492205 +0000 UTC m=+422.565591432" Jul 17 17:37:44.943850 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:37:44.943815 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bx4tb" Jul 17 17:38:12.720629 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.720594 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs"] Jul 17 17:38:12.724718 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.724698 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.726975 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.726954 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2r49r\"" Jul 17 17:38:12.734606 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.734583 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs"] Jul 17 17:38:12.855100 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.855061 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41b215b1-f7dd-4d82-8212-834fdeb62040-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.855264 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.855113 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b215b1-f7dd-4d82-8212-834fdeb62040-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.855264 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.855151 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41b215b1-f7dd-4d82-8212-834fdeb62040-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.855264 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.855175 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41b215b1-f7dd-4d82-8212-834fdeb62040-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.855264 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.855244 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41b215b1-f7dd-4d82-8212-834fdeb62040-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.855415 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.855274 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b215b1-f7dd-4d82-8212-834fdeb62040-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.855415 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.855314 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41b215b1-f7dd-4d82-8212-834fdeb62040-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.855415 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.855368 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41b215b1-f7dd-4d82-8212-834fdeb62040-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.855415 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.855403 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z8bd\" (UniqueName: \"kubernetes.io/projected/41b215b1-f7dd-4d82-8212-834fdeb62040-kube-api-access-5z8bd\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.956895 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.956864 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41b215b1-f7dd-4d82-8212-834fdeb62040-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.956895 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.956901 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b215b1-f7dd-4d82-8212-834fdeb62040-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.957144 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.956926 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41b215b1-f7dd-4d82-8212-834fdeb62040-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.957144 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.956941 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41b215b1-f7dd-4d82-8212-834fdeb62040-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.957144 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.957054 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41b215b1-f7dd-4d82-8212-834fdeb62040-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.957144 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.957086 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b215b1-f7dd-4d82-8212-834fdeb62040-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.957144 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.957110 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41b215b1-f7dd-4d82-8212-834fdeb62040-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.957495 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.957160 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41b215b1-f7dd-4d82-8212-834fdeb62040-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.957495 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.957183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z8bd\" (UniqueName: \"kubernetes.io/projected/41b215b1-f7dd-4d82-8212-834fdeb62040-kube-api-access-5z8bd\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.957495 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.957393 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b215b1-f7dd-4d82-8212-834fdeb62040-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.957495 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.957418 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b215b1-f7dd-4d82-8212-834fdeb62040-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.957706 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.957553 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41b215b1-f7dd-4d82-8212-834fdeb62040-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.958111 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.957868 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41b215b1-f7dd-4d82-8212-834fdeb62040-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.959601 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.958877 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41b215b1-f7dd-4d82-8212-834fdeb62040-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.963917 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.960705 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41b215b1-f7dd-4d82-8212-834fdeb62040-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.969027 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.968336 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41b215b1-f7dd-4d82-8212-834fdeb62040-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.969027 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.968837 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41b215b1-f7dd-4d82-8212-834fdeb62040-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:12.969027 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:12.968940 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z8bd\" (UniqueName: \"kubernetes.io/projected/41b215b1-f7dd-4d82-8212-834fdeb62040-kube-api-access-5z8bd\") pod \"maas-default-gateway-openshift-default-5896d4dd49-58lrs\" (UID: \"41b215b1-f7dd-4d82-8212-834fdeb62040\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:13.036719 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:13.036610 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:13.187384 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:13.187351 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs"] Jul 17 17:38:13.192088 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:38:13.192058 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b215b1_f7dd_4d82_8212_834fdeb62040.slice/crio-43e74608d02d042bd42e6a53e236d10d4678f45163202cd3c7aae4273928e7cb WatchSource:0}: Error finding container 43e74608d02d042bd42e6a53e236d10d4678f45163202cd3c7aae4273928e7cb: Status 404 returned error can't find the container with id 43e74608d02d042bd42e6a53e236d10d4678f45163202cd3c7aae4273928e7cb Jul 17 17:38:13.194657 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:13.194620 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:38:13.194787 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:13.194762 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:38:13.194858 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:13.194821 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:38:14.124781 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:14.124745 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" event={"ID":"41b215b1-f7dd-4d82-8212-834fdeb62040","Type":"ContainerStarted","Data":"5bdda9e4ff2228b931f59c52775f2b708a19ebbfb77350768c49512e23dfbecc"} Jul 17 17:38:14.125270 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:14.124796 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" event={"ID":"41b215b1-f7dd-4d82-8212-834fdeb62040","Type":"ContainerStarted","Data":"43e74608d02d042bd42e6a53e236d10d4678f45163202cd3c7aae4273928e7cb"} Jul 17 17:38:14.146606 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:14.146552 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" podStartSLOduration=2.146538045 podStartE2EDuration="2.146538045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:38:14.144768493 +0000 UTC m=+462.755437874" watchObservedRunningTime="2026-07-17 17:38:14.146538045 +0000 UTC m=+462.757207427" Jul 17 17:38:15.037749 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:15.037719 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:15.042357 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:15.042334 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:15.129203 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:15.129171 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:15.130318 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:15.130292 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:38:16.064846 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:16.064816 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7s9s9"] Jul 17 17:38:16.068332 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:16.068316 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7s9s9" Jul 17 17:38:16.070762 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:16.070742 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qc8bp\"" Jul 17 17:38:16.075258 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:16.075234 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7s9s9"] Jul 17 17:38:16.187434 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:16.187397 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk9jg\" (UniqueName: \"kubernetes.io/projected/0e0f342f-25c1-4863-9233-44001f5a5f20-kube-api-access-pk9jg\") pod \"authorino-75d556bd77-7s9s9\" (UID: \"0e0f342f-25c1-4863-9233-44001f5a5f20\") " pod="kuadrant-system/authorino-75d556bd77-7s9s9" Jul 17 17:38:16.288285 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:16.288249 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk9jg\" (UniqueName: \"kubernetes.io/projected/0e0f342f-25c1-4863-9233-44001f5a5f20-kube-api-access-pk9jg\") pod \"authorino-75d556bd77-7s9s9\" (UID: \"0e0f342f-25c1-4863-9233-44001f5a5f20\") " pod="kuadrant-system/authorino-75d556bd77-7s9s9" Jul 17 17:38:16.302133 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:16.302107 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk9jg\" (UniqueName: \"kubernetes.io/projected/0e0f342f-25c1-4863-9233-44001f5a5f20-kube-api-access-pk9jg\") pod \"authorino-75d556bd77-7s9s9\" (UID: \"0e0f342f-25c1-4863-9233-44001f5a5f20\") " pod="kuadrant-system/authorino-75d556bd77-7s9s9" Jul 17 17:38:16.378688 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:16.378659 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7s9s9" Jul 17 17:38:16.510647 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:16.510601 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7s9s9"] Jul 17 17:38:16.512747 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:38:16.512712 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e0f342f_25c1_4863_9233_44001f5a5f20.slice/crio-9efd022f253644962e864d2bb5ca6292d14ad5e254ba707fe87ce4849d766792 WatchSource:0}: Error finding container 9efd022f253644962e864d2bb5ca6292d14ad5e254ba707fe87ce4849d766792: Status 404 returned error can't find the container with id 9efd022f253644962e864d2bb5ca6292d14ad5e254ba707fe87ce4849d766792 Jul 17 17:38:17.144503 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:17.144203 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7s9s9" event={"ID":"0e0f342f-25c1-4863-9233-44001f5a5f20","Type":"ContainerStarted","Data":"9efd022f253644962e864d2bb5ca6292d14ad5e254ba707fe87ce4849d766792"} Jul 17 17:38:20.160411 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:20.160375 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7s9s9" event={"ID":"0e0f342f-25c1-4863-9233-44001f5a5f20","Type":"ContainerStarted","Data":"1c98e9df80b07a631f126de4ee6d68b3e1005ff9dbfc7b80bbd816006a37899b"} Jul 17 17:38:20.177790 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:20.177741 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7s9s9" podStartSLOduration=1.421391468 podStartE2EDuration="4.177727207s" totalImagesPullingTime="2.756335739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:38:20.176174599 +0000 UTC m=+468.786843995" watchObservedRunningTime="2026-07-17 17:38:20.177727207 +0000 UTC m=+468.788396589" Jul 17 17:38:50.625639 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:50.625601 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75497c7b7b-tvhfw"] Jul 17 17:38:50.632422 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:50.632400 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75497c7b7b-tvhfw" Jul 17 17:38:50.635203 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:50.635169 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 17 17:38:50.638487 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:50.638465 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75497c7b7b-tvhfw"] Jul 17 17:38:50.680001 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:50.679966 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vrrg\" (UniqueName: \"kubernetes.io/projected/cb7d823e-edcb-4178-b77d-82cf9c314a94-kube-api-access-7vrrg\") pod \"authorino-75497c7b7b-tvhfw\" (UID: \"cb7d823e-edcb-4178-b77d-82cf9c314a94\") " pod="kuadrant-system/authorino-75497c7b7b-tvhfw" Jul 17 17:38:50.680175 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:50.680018 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb7d823e-edcb-4178-b77d-82cf9c314a94-tls-cert\") pod \"authorino-75497c7b7b-tvhfw\" (UID: \"cb7d823e-edcb-4178-b77d-82cf9c314a94\") " pod="kuadrant-system/authorino-75497c7b7b-tvhfw" Jul 17 17:38:50.780796 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:50.780756 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb7d823e-edcb-4178-b77d-82cf9c314a94-tls-cert\") pod \"authorino-75497c7b7b-tvhfw\" (UID: \"cb7d823e-edcb-4178-b77d-82cf9c314a94\") " pod="kuadrant-system/authorino-75497c7b7b-tvhfw" Jul 17 17:38:50.780991 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:50.780840 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vrrg\" (UniqueName: \"kubernetes.io/projected/cb7d823e-edcb-4178-b77d-82cf9c314a94-kube-api-access-7vrrg\") pod \"authorino-75497c7b7b-tvhfw\" (UID: \"cb7d823e-edcb-4178-b77d-82cf9c314a94\") " pod="kuadrant-system/authorino-75497c7b7b-tvhfw" Jul 17 17:38:50.783387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:50.783353 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb7d823e-edcb-4178-b77d-82cf9c314a94-tls-cert\") pod \"authorino-75497c7b7b-tvhfw\" (UID: \"cb7d823e-edcb-4178-b77d-82cf9c314a94\") " pod="kuadrant-system/authorino-75497c7b7b-tvhfw" Jul 17 17:38:50.790024 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:50.790001 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vrrg\" (UniqueName: \"kubernetes.io/projected/cb7d823e-edcb-4178-b77d-82cf9c314a94-kube-api-access-7vrrg\") pod \"authorino-75497c7b7b-tvhfw\" (UID: \"cb7d823e-edcb-4178-b77d-82cf9c314a94\") " pod="kuadrant-system/authorino-75497c7b7b-tvhfw" Jul 17 17:38:50.942443 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:50.942363 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75497c7b7b-tvhfw" Jul 17 17:38:51.073855 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:51.073820 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75497c7b7b-tvhfw"] Jul 17 17:38:51.077341 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:38:51.077316 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb7d823e_edcb_4178_b77d_82cf9c314a94.slice/crio-0a472a123292a76e2d9d2723e8bf251c367c3b426f90f8a112accd9e37c8679e WatchSource:0}: Error finding container 0a472a123292a76e2d9d2723e8bf251c367c3b426f90f8a112accd9e37c8679e: Status 404 returned error can't find the container with id 0a472a123292a76e2d9d2723e8bf251c367c3b426f90f8a112accd9e37c8679e Jul 17 17:38:51.299936 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:51.299857 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75497c7b7b-tvhfw" event={"ID":"cb7d823e-edcb-4178-b77d-82cf9c314a94","Type":"ContainerStarted","Data":"0a472a123292a76e2d9d2723e8bf251c367c3b426f90f8a112accd9e37c8679e"} Jul 17 17:38:52.306608 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:52.306575 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75497c7b7b-tvhfw" event={"ID":"cb7d823e-edcb-4178-b77d-82cf9c314a94","Type":"ContainerStarted","Data":"308208089c57caadf4c1e79673157b65324f97d9db0233cfa16d79589bf07583"} Jul 17 17:38:52.324490 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:52.324429 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75497c7b7b-tvhfw" podStartSLOduration=1.8837721379999999 podStartE2EDuration="2.324410705s" totalImagesPullingTime="440.638567ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:38:52.323028065 +0000 UTC m=+500.933697472" watchObservedRunningTime="2026-07-17 17:38:52.324410705 +0000 UTC m=+500.935080130" Jul 17 17:38:52.352039 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:52.351999 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7s9s9"] Jul 17 17:38:52.352253 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:52.352226 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7s9s9" podUID="0e0f342f-25c1-4863-9233-44001f5a5f20" containerName="authorino" containerID="cri-o://1c98e9df80b07a631f126de4ee6d68b3e1005ff9dbfc7b80bbd816006a37899b" gracePeriod=30 Jul 17 17:38:52.616773 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:52.616744 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7s9s9" Jul 17 17:38:52.698243 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:52.698199 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk9jg\" (UniqueName: \"kubernetes.io/projected/0e0f342f-25c1-4863-9233-44001f5a5f20-kube-api-access-pk9jg\") pod \"0e0f342f-25c1-4863-9233-44001f5a5f20\" (UID: \"0e0f342f-25c1-4863-9233-44001f5a5f20\") " Jul 17 17:38:52.700289 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:52.700266 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e0f342f-25c1-4863-9233-44001f5a5f20-kube-api-access-pk9jg" (OuterVolumeSpecName: "kube-api-access-pk9jg") pod "0e0f342f-25c1-4863-9233-44001f5a5f20" (UID: "0e0f342f-25c1-4863-9233-44001f5a5f20"). InnerVolumeSpecName "kube-api-access-pk9jg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:38:52.798959 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:52.798920 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk9jg\" (UniqueName: \"kubernetes.io/projected/0e0f342f-25c1-4863-9233-44001f5a5f20-kube-api-access-pk9jg\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:38:53.312585 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:53.312543 2557 generic.go:356] "Generic (PLEG): container finished" podID="0e0f342f-25c1-4863-9233-44001f5a5f20" containerID="1c98e9df80b07a631f126de4ee6d68b3e1005ff9dbfc7b80bbd816006a37899b" exitCode=0 Jul 17 17:38:53.312585 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:53.312587 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7s9s9" Jul 17 17:38:53.313119 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:53.312620 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7s9s9" event={"ID":"0e0f342f-25c1-4863-9233-44001f5a5f20","Type":"ContainerDied","Data":"1c98e9df80b07a631f126de4ee6d68b3e1005ff9dbfc7b80bbd816006a37899b"} Jul 17 17:38:53.313119 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:53.312665 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7s9s9" event={"ID":"0e0f342f-25c1-4863-9233-44001f5a5f20","Type":"ContainerDied","Data":"9efd022f253644962e864d2bb5ca6292d14ad5e254ba707fe87ce4849d766792"} Jul 17 17:38:53.313119 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:53.312703 2557 scope.go:117] "RemoveContainer" containerID="1c98e9df80b07a631f126de4ee6d68b3e1005ff9dbfc7b80bbd816006a37899b" Jul 17 17:38:53.321221 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:53.321201 2557 scope.go:117] "RemoveContainer" containerID="1c98e9df80b07a631f126de4ee6d68b3e1005ff9dbfc7b80bbd816006a37899b" Jul 17 17:38:53.321513 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:38:53.321496 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c98e9df80b07a631f126de4ee6d68b3e1005ff9dbfc7b80bbd816006a37899b\": container with ID starting with 1c98e9df80b07a631f126de4ee6d68b3e1005ff9dbfc7b80bbd816006a37899b not found: ID does not exist" containerID="1c98e9df80b07a631f126de4ee6d68b3e1005ff9dbfc7b80bbd816006a37899b" Jul 17 17:38:53.321554 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:53.321526 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c98e9df80b07a631f126de4ee6d68b3e1005ff9dbfc7b80bbd816006a37899b"} err="failed to get container status \"1c98e9df80b07a631f126de4ee6d68b3e1005ff9dbfc7b80bbd816006a37899b\": rpc error: code = NotFound desc = could not find container \"1c98e9df80b07a631f126de4ee6d68b3e1005ff9dbfc7b80bbd816006a37899b\": container with ID starting with 1c98e9df80b07a631f126de4ee6d68b3e1005ff9dbfc7b80bbd816006a37899b not found: ID does not exist" Jul 17 17:38:53.332206 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:53.332175 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7s9s9"] Jul 17 17:38:53.336578 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:53.336549 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7s9s9"] Jul 17 17:38:53.877418 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:38:53.877383 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e0f342f-25c1-4863-9233-44001f5a5f20" path="/var/lib/kubelet/pods/0e0f342f-25c1-4863-9233-44001f5a5f20/volumes" Jul 17 17:39:43.548569 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:43.548490 2557 generic.go:356] "Generic (PLEG): container finished" podID="41b215b1-f7dd-4d82-8212-834fdeb62040" containerID="5bdda9e4ff2228b931f59c52775f2b708a19ebbfb77350768c49512e23dfbecc" exitCode=0 Jul 17 17:39:43.548967 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:43.548562 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" event={"ID":"41b215b1-f7dd-4d82-8212-834fdeb62040","Type":"ContainerDied","Data":"5bdda9e4ff2228b931f59c52775f2b708a19ebbfb77350768c49512e23dfbecc"} Jul 17 17:39:43.549007 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:43.548982 2557 scope.go:117] "RemoveContainer" containerID="5bdda9e4ff2228b931f59c52775f2b708a19ebbfb77350768c49512e23dfbecc" Jul 17 17:39:43.549999 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:43.549970 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:39:43.550073 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:43.550055 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:39:43.550121 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:43.550104 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:39:44.555220 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:44.555188 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" event={"ID":"41b215b1-f7dd-4d82-8212-834fdeb62040","Type":"ContainerStarted","Data":"b3d5ca93edfcd02622755b3bca667e022f930b5a7003336527d80cfc85280617"} Jul 17 17:39:45.036833 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:45.036802 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:39:45.037956 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:45.037932 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-58lrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 17 17:39:45.038035 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:45.037980 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" podUID="41b215b1-f7dd-4d82-8212-834fdeb62040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 17 17:39:45.129103 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:45.129068 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:39:46.037034 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:46.036994 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-58lrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 17 17:39:46.037433 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:46.037059 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" podUID="41b215b1-f7dd-4d82-8212-834fdeb62040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 17 17:39:47.037645 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:47.037609 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-58lrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 17 17:39:47.038047 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:47.037666 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" podUID="41b215b1-f7dd-4d82-8212-834fdeb62040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 17 17:39:48.037605 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:48.037560 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-58lrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 17 17:39:48.037811 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:48.037637 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" podUID="41b215b1-f7dd-4d82-8212-834fdeb62040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 17 17:39:49.041306 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:49.041272 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:39:49.042239 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:39:49.042216 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-58lrs" Jul 17 17:40:20.352099 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.352062 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx"] Jul 17 17:40:20.352556 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.352422 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e0f342f-25c1-4863-9233-44001f5a5f20" containerName="authorino" Jul 17 17:40:20.352556 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.352433 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e0f342f-25c1-4863-9233-44001f5a5f20" containerName="authorino" Jul 17 17:40:20.352556 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.352503 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e0f342f-25c1-4863-9233-44001f5a5f20" containerName="authorino" Jul 17 17:40:20.355715 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.355672 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.358584 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.358559 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 17 17:40:20.359450 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.359431 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 17 17:40:20.359559 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.359464 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 17 17:40:20.359627 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.359572 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kpxlh\"" Jul 17 17:40:20.369886 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.369853 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx"] Jul 17 17:40:20.479869 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.479832 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93c9b461-bf9c-4d71-976d-eead863a4b90-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.479869 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.479872 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93c9b461-bf9c-4d71-976d-eead863a4b90-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.480098 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.479893 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93c9b461-bf9c-4d71-976d-eead863a4b90-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.480098 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.479991 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnvqq\" (UniqueName: \"kubernetes.io/projected/93c9b461-bf9c-4d71-976d-eead863a4b90-kube-api-access-rnvqq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.480098 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.480031 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93c9b461-bf9c-4d71-976d-eead863a4b90-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.480098 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.480059 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93c9b461-bf9c-4d71-976d-eead863a4b90-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.581194 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.581153 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93c9b461-bf9c-4d71-976d-eead863a4b90-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.581194 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.581200 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93c9b461-bf9c-4d71-976d-eead863a4b90-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.581443 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.581217 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93c9b461-bf9c-4d71-976d-eead863a4b90-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.581443 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.581271 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnvqq\" (UniqueName: \"kubernetes.io/projected/93c9b461-bf9c-4d71-976d-eead863a4b90-kube-api-access-rnvqq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.581443 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.581291 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93c9b461-bf9c-4d71-976d-eead863a4b90-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.581443 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.581314 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93c9b461-bf9c-4d71-976d-eead863a4b90-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.581649 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.581620 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93c9b461-bf9c-4d71-976d-eead863a4b90-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.581754 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.581709 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93c9b461-bf9c-4d71-976d-eead863a4b90-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.581754 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.581724 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93c9b461-bf9c-4d71-976d-eead863a4b90-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.583542 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.583512 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93c9b461-bf9c-4d71-976d-eead863a4b90-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.583857 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.583838 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93c9b461-bf9c-4d71-976d-eead863a4b90-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.590143 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.590123 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnvqq\" (UniqueName: \"kubernetes.io/projected/93c9b461-bf9c-4d71-976d-eead863a4b90-kube-api-access-rnvqq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8fccx\" (UID: \"93c9b461-bf9c-4d71-976d-eead863a4b90\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.666537 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.666449 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:20.800821 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:20.800796 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx"] Jul 17 17:40:20.802401 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:40:20.802368 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c9b461_bf9c_4d71_976d_eead863a4b90.slice/crio-e7e6fd395afc604f3e28bc07fc66b89569d583b992ff2506e36ac4f486e9df4e WatchSource:0}: Error finding container e7e6fd395afc604f3e28bc07fc66b89569d583b992ff2506e36ac4f486e9df4e: Status 404 returned error can't find the container with id e7e6fd395afc604f3e28bc07fc66b89569d583b992ff2506e36ac4f486e9df4e Jul 17 17:40:21.729994 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:21.729952 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" event={"ID":"93c9b461-bf9c-4d71-976d-eead863a4b90","Type":"ContainerStarted","Data":"e7e6fd395afc604f3e28bc07fc66b89569d583b992ff2506e36ac4f486e9df4e"} Jul 17 17:40:22.735907 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:22.735872 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" event={"ID":"93c9b461-bf9c-4d71-976d-eead863a4b90","Type":"ContainerStarted","Data":"30a26a5ef041a0c46ad7471729744e65707d49f56f20be0484e9a0d28c006f0b"} Jul 17 17:40:22.753865 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:22.753811 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" podStartSLOduration=1.50449873 podStartE2EDuration="2.753795477s" totalImagesPullingTime="1.249296747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:40:22.751945584 +0000 UTC m=+591.362614981" watchObservedRunningTime="2026-07-17 17:40:22.753795477 +0000 UTC m=+591.364464858" Jul 17 17:40:30.667580 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:30.667542 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:30.668012 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:30.667704 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:30.680130 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:30.680101 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:30.785313 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:30.785280 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8fccx" Jul 17 17:40:31.870991 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:31.870962 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 17:40:31.871578 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:31.871560 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 17:40:47.453476 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.453440 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz"] Jul 17 17:40:47.456875 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.456858 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.459611 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.459589 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 17 17:40:47.470647 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.470624 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz"] Jul 17 17:40:47.501575 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.501543 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdf35d77-f622-4d00-985e-0dc4923eecb8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.501575 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.501576 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q458p\" (UniqueName: \"kubernetes.io/projected/fdf35d77-f622-4d00-985e-0dc4923eecb8-kube-api-access-q458p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.501789 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.501612 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdf35d77-f622-4d00-985e-0dc4923eecb8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.501789 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.501629 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdf35d77-f622-4d00-985e-0dc4923eecb8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.501789 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.501656 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdf35d77-f622-4d00-985e-0dc4923eecb8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.501789 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.501698 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdf35d77-f622-4d00-985e-0dc4923eecb8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.603107 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.603072 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdf35d77-f622-4d00-985e-0dc4923eecb8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.603107 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.603112 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q458p\" (UniqueName: \"kubernetes.io/projected/fdf35d77-f622-4d00-985e-0dc4923eecb8-kube-api-access-q458p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.603373 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.603162 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdf35d77-f622-4d00-985e-0dc4923eecb8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.603373 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.603186 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdf35d77-f622-4d00-985e-0dc4923eecb8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.603500 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.603375 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdf35d77-f622-4d00-985e-0dc4923eecb8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.603500 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.603454 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdf35d77-f622-4d00-985e-0dc4923eecb8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.603604 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.603583 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdf35d77-f622-4d00-985e-0dc4923eecb8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.603808 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.603784 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdf35d77-f622-4d00-985e-0dc4923eecb8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.604185 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.604164 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdf35d77-f622-4d00-985e-0dc4923eecb8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.606249 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.606223 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdf35d77-f622-4d00-985e-0dc4923eecb8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.606443 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.606399 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdf35d77-f622-4d00-985e-0dc4923eecb8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.612022 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.612003 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q458p\" (UniqueName: \"kubernetes.io/projected/fdf35d77-f622-4d00-985e-0dc4923eecb8-kube-api-access-q458p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz\" (UID: \"fdf35d77-f622-4d00-985e-0dc4923eecb8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.767305 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.767210 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:47.900790 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.900715 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz"] Jul 17 17:40:47.903305 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:40:47.903278 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf35d77_f622_4d00_985e_0dc4923eecb8.slice/crio-fc7d89fc302d0b3e113645a84795fd3f4557d4a42a058d05504a1c0eb0c3684b WatchSource:0}: Error finding container fc7d89fc302d0b3e113645a84795fd3f4557d4a42a058d05504a1c0eb0c3684b: Status 404 returned error can't find the container with id fc7d89fc302d0b3e113645a84795fd3f4557d4a42a058d05504a1c0eb0c3684b Jul 17 17:40:47.905001 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:47.904985 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 17:40:48.861723 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:48.861659 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" event={"ID":"fdf35d77-f622-4d00-985e-0dc4923eecb8","Type":"ContainerStarted","Data":"9b3aafad96a1ac6737cc676474e6dfbacb46a523664ae6c72ea7c0a4aca51417"} Jul 17 17:40:48.862208 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:48.861781 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" event={"ID":"fdf35d77-f622-4d00-985e-0dc4923eecb8","Type":"ContainerStarted","Data":"fc7d89fc302d0b3e113645a84795fd3f4557d4a42a058d05504a1c0eb0c3684b"} Jul 17 17:40:48.881315 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:48.881247 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" podStartSLOduration=1.695347624 podStartE2EDuration="1.881226449s" totalImagesPullingTime="185.878825ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:40:48.879278373 +0000 UTC m=+617.489947756" watchObservedRunningTime="2026-07-17 17:40:48.881226449 +0000 UTC m=+617.491895839" Jul 17 17:40:57.768421 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:57.768340 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:57.768421 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:57.768409 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:57.780601 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:57.780569 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:40:57.915120 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:40:57.915092 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz" Jul 17 17:42:33.275737 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:33.275570 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-849b75d88f-t8pjf"] Jul 17 17:42:33.279221 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:33.279204 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-849b75d88f-t8pjf" Jul 17 17:42:33.287349 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:33.287321 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-849b75d88f-t8pjf"] Jul 17 17:42:33.433833 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:33.433802 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5caa57cd-5a11-4443-8036-74871c015526-tls-cert\") pod \"authorino-849b75d88f-t8pjf\" (UID: \"5caa57cd-5a11-4443-8036-74871c015526\") " pod="kuadrant-system/authorino-849b75d88f-t8pjf" Jul 17 17:42:33.434009 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:33.433854 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht4gf\" (UniqueName: \"kubernetes.io/projected/5caa57cd-5a11-4443-8036-74871c015526-kube-api-access-ht4gf\") pod \"authorino-849b75d88f-t8pjf\" (UID: \"5caa57cd-5a11-4443-8036-74871c015526\") " pod="kuadrant-system/authorino-849b75d88f-t8pjf" Jul 17 17:42:33.534434 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:33.534356 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5caa57cd-5a11-4443-8036-74871c015526-tls-cert\") pod \"authorino-849b75d88f-t8pjf\" (UID: \"5caa57cd-5a11-4443-8036-74871c015526\") " pod="kuadrant-system/authorino-849b75d88f-t8pjf" Jul 17 17:42:33.534434 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:33.534410 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht4gf\" (UniqueName: \"kubernetes.io/projected/5caa57cd-5a11-4443-8036-74871c015526-kube-api-access-ht4gf\") pod \"authorino-849b75d88f-t8pjf\" (UID: \"5caa57cd-5a11-4443-8036-74871c015526\") " pod="kuadrant-system/authorino-849b75d88f-t8pjf" Jul 17 17:42:33.536853 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:33.536827 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5caa57cd-5a11-4443-8036-74871c015526-tls-cert\") pod \"authorino-849b75d88f-t8pjf\" (UID: \"5caa57cd-5a11-4443-8036-74871c015526\") " pod="kuadrant-system/authorino-849b75d88f-t8pjf" Jul 17 17:42:33.551306 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:33.551279 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht4gf\" (UniqueName: \"kubernetes.io/projected/5caa57cd-5a11-4443-8036-74871c015526-kube-api-access-ht4gf\") pod \"authorino-849b75d88f-t8pjf\" (UID: \"5caa57cd-5a11-4443-8036-74871c015526\") " pod="kuadrant-system/authorino-849b75d88f-t8pjf" Jul 17 17:42:33.589126 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:33.589092 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-849b75d88f-t8pjf" Jul 17 17:42:33.735310 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:33.735253 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-849b75d88f-t8pjf"] Jul 17 17:42:33.737519 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:42:33.737481 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5caa57cd_5a11_4443_8036_74871c015526.slice/crio-a35f486d024601af834752546b5c34bb4c64b57fe312de48c5a6f52367e9daf5 WatchSource:0}: Error finding container a35f486d024601af834752546b5c34bb4c64b57fe312de48c5a6f52367e9daf5: Status 404 returned error can't find the container with id a35f486d024601af834752546b5c34bb4c64b57fe312de48c5a6f52367e9daf5 Jul 17 17:42:34.354766 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:34.354729 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-849b75d88f-t8pjf" event={"ID":"5caa57cd-5a11-4443-8036-74871c015526","Type":"ContainerStarted","Data":"847b2534869d1d8487eb9e3141d93ace901df9c86b363479ce49a6b7da50064f"} Jul 17 17:42:34.355200 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:34.354778 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-849b75d88f-t8pjf" event={"ID":"5caa57cd-5a11-4443-8036-74871c015526","Type":"ContainerStarted","Data":"a35f486d024601af834752546b5c34bb4c64b57fe312de48c5a6f52367e9daf5"} Jul 17 17:42:34.372468 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:34.372412 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-849b75d88f-t8pjf" podStartSLOduration=0.951761128 podStartE2EDuration="1.372394992s" totalImagesPullingTime="420.633864ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:42:34.370119396 +0000 UTC m=+722.980788778" watchObservedRunningTime="2026-07-17 17:42:34.372394992 +0000 UTC m=+722.983064375" Jul 17 17:42:34.406358 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:34.406308 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75497c7b7b-tvhfw"] Jul 17 17:42:34.406584 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:34.406554 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75497c7b7b-tvhfw" podUID="cb7d823e-edcb-4178-b77d-82cf9c314a94" containerName="authorino" containerID="cri-o://308208089c57caadf4c1e79673157b65324f97d9db0233cfa16d79589bf07583" gracePeriod=30 Jul 17 17:42:34.673111 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:34.673078 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75497c7b7b-tvhfw" Jul 17 17:42:34.745232 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:34.745146 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vrrg\" (UniqueName: \"kubernetes.io/projected/cb7d823e-edcb-4178-b77d-82cf9c314a94-kube-api-access-7vrrg\") pod \"cb7d823e-edcb-4178-b77d-82cf9c314a94\" (UID: \"cb7d823e-edcb-4178-b77d-82cf9c314a94\") " Jul 17 17:42:34.745576 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:34.745558 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb7d823e-edcb-4178-b77d-82cf9c314a94-tls-cert\") pod \"cb7d823e-edcb-4178-b77d-82cf9c314a94\" (UID: \"cb7d823e-edcb-4178-b77d-82cf9c314a94\") " Jul 17 17:42:34.752056 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:34.752028 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb7d823e-edcb-4178-b77d-82cf9c314a94-kube-api-access-7vrrg" (OuterVolumeSpecName: "kube-api-access-7vrrg") pod "cb7d823e-edcb-4178-b77d-82cf9c314a94" (UID: "cb7d823e-edcb-4178-b77d-82cf9c314a94"). InnerVolumeSpecName "kube-api-access-7vrrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:42:34.758613 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:34.758588 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb7d823e-edcb-4178-b77d-82cf9c314a94-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cb7d823e-edcb-4178-b77d-82cf9c314a94" (UID: "cb7d823e-edcb-4178-b77d-82cf9c314a94"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:42:34.846860 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:34.846826 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vrrg\" (UniqueName: \"kubernetes.io/projected/cb7d823e-edcb-4178-b77d-82cf9c314a94-kube-api-access-7vrrg\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:42:34.846860 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:34.846856 2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb7d823e-edcb-4178-b77d-82cf9c314a94-tls-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:42:35.361560 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:35.361523 2557 generic.go:356] "Generic (PLEG): container finished" podID="cb7d823e-edcb-4178-b77d-82cf9c314a94" containerID="308208089c57caadf4c1e79673157b65324f97d9db0233cfa16d79589bf07583" exitCode=0 Jul 17 17:42:35.362042 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:35.361593 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75497c7b7b-tvhfw" Jul 17 17:42:35.362042 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:35.361611 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75497c7b7b-tvhfw" event={"ID":"cb7d823e-edcb-4178-b77d-82cf9c314a94","Type":"ContainerDied","Data":"308208089c57caadf4c1e79673157b65324f97d9db0233cfa16d79589bf07583"} Jul 17 17:42:35.362042 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:35.361660 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75497c7b7b-tvhfw" event={"ID":"cb7d823e-edcb-4178-b77d-82cf9c314a94","Type":"ContainerDied","Data":"0a472a123292a76e2d9d2723e8bf251c367c3b426f90f8a112accd9e37c8679e"} Jul 17 17:42:35.362042 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:35.361699 2557 scope.go:117] "RemoveContainer" containerID="308208089c57caadf4c1e79673157b65324f97d9db0233cfa16d79589bf07583" Jul 17 17:42:35.371290 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:35.371273 2557 scope.go:117] "RemoveContainer" containerID="308208089c57caadf4c1e79673157b65324f97d9db0233cfa16d79589bf07583" Jul 17 17:42:35.371526 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:42:35.371509 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"308208089c57caadf4c1e79673157b65324f97d9db0233cfa16d79589bf07583\": container with ID starting with 308208089c57caadf4c1e79673157b65324f97d9db0233cfa16d79589bf07583 not found: ID does not exist" containerID="308208089c57caadf4c1e79673157b65324f97d9db0233cfa16d79589bf07583" Jul 17 17:42:35.371565 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:35.371534 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"308208089c57caadf4c1e79673157b65324f97d9db0233cfa16d79589bf07583"} err="failed to get container status \"308208089c57caadf4c1e79673157b65324f97d9db0233cfa16d79589bf07583\": rpc error: code = NotFound desc = could not find container \"308208089c57caadf4c1e79673157b65324f97d9db0233cfa16d79589bf07583\": container with ID starting with 308208089c57caadf4c1e79673157b65324f97d9db0233cfa16d79589bf07583 not found: ID does not exist" Jul 17 17:42:35.384689 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:35.384648 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75497c7b7b-tvhfw"] Jul 17 17:42:35.391595 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:35.391567 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75497c7b7b-tvhfw"] Jul 17 17:42:35.879809 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:42:35.879779 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb7d823e-edcb-4178-b77d-82cf9c314a94" path="/var/lib/kubelet/pods/cb7d823e-edcb-4178-b77d-82cf9c314a94/volumes" Jul 17 17:45:31.898767 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:45:31.898672 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 17:45:31.901024 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:45:31.901000 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 17:50:31.927309 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:50:31.927277 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 17:50:31.929434 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:50:31.929414 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 17:55:31.955727 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:55:31.955699 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 17:55:31.959331 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:55:31.959309 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 17:56:55.023028 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.022994 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx"] Jul 17 17:56:55.023625 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.023369 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb7d823e-edcb-4178-b77d-82cf9c314a94" containerName="authorino" Jul 17 17:56:55.023625 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.023387 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb7d823e-edcb-4178-b77d-82cf9c314a94" containerName="authorino" Jul 17 17:56:55.023625 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.023517 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb7d823e-edcb-4178-b77d-82cf9c314a94" containerName="authorino" Jul 17 17:56:55.026906 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.026881 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.030160 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.030143 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1d1f23e1-openshift-default-dockercfg-s4wqt\"" Jul 17 17:56:55.053949 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.053924 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx"] Jul 17 17:56:55.112799 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.112760 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/566ab4dd-8d6f-4714-8362-104a112c7060-istiod-ca-cert\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.112976 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.112837 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/566ab4dd-8d6f-4714-8362-104a112c7060-istio-podinfo\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.112976 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.112872 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-workload-socket\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.112976 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.112890 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxlzn\" (UniqueName: \"kubernetes.io/projected/566ab4dd-8d6f-4714-8362-104a112c7060-kube-api-access-vxlzn\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.112976 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.112921 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-credential-socket\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.112976 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.112945 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-istio-envoy\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.113183 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.113014 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-workload-certs\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.113183 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.113052 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-istio-data\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.113183 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.113085 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/566ab4dd-8d6f-4714-8362-104a112c7060-istio-token\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.214313 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.214265 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/566ab4dd-8d6f-4714-8362-104a112c7060-istiod-ca-cert\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.214519 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.214338 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/566ab4dd-8d6f-4714-8362-104a112c7060-istio-podinfo\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.214519 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.214372 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-workload-socket\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.214519 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.214388 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxlzn\" (UniqueName: \"kubernetes.io/projected/566ab4dd-8d6f-4714-8362-104a112c7060-kube-api-access-vxlzn\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.214519 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.214409 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-credential-socket\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.214519 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.214424 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-istio-envoy\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.214519 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.214454 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-workload-certs\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.214519 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.214474 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-istio-data\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.214519 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.214496 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/566ab4dd-8d6f-4714-8362-104a112c7060-istio-token\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.214942 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.214809 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-credential-socket\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.214942 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.214863 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-workload-socket\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.215085 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.215056 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-istio-data\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.215210 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.215101 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/566ab4dd-8d6f-4714-8362-104a112c7060-istiod-ca-cert\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.215210 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.215135 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-workload-certs\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.216720 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.216700 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-istio-envoy\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.217060 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.217040 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/566ab4dd-8d6f-4714-8362-104a112c7060-istio-podinfo\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.228923 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.228901 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/566ab4dd-8d6f-4714-8362-104a112c7060-istio-token\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.229125 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.229102 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxlzn\" (UniqueName: \"kubernetes.io/projected/566ab4dd-8d6f-4714-8362-104a112c7060-kube-api-access-vxlzn\") pod \"e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.340631 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.340603 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:55.508093 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.508064 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx"] Jul 17 17:56:55.510539 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:56:55.510507 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod566ab4dd_8d6f_4714_8362_104a112c7060.slice/crio-7c1b8ad6f08197d90edd8a98e2701661299c20e3fc595f6a4a8b2e0fb73dde2f WatchSource:0}: Error finding container 7c1b8ad6f08197d90edd8a98e2701661299c20e3fc595f6a4a8b2e0fb73dde2f: Status 404 returned error can't find the container with id 7c1b8ad6f08197d90edd8a98e2701661299c20e3fc595f6a4a8b2e0fb73dde2f Jul 17 17:56:55.512746 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.512704 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:56:55.512839 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.512783 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:56:55.512839 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:55.512815 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:56:56.408725 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:56.408668 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" event={"ID":"566ab4dd-8d6f-4714-8362-104a112c7060","Type":"ContainerStarted","Data":"e5a4d39626ef9c5ab0051a78927a48780509ab2e4310909c38309559e84ca95f"} Jul 17 17:56:56.409195 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:56.408763 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" event={"ID":"566ab4dd-8d6f-4714-8362-104a112c7060","Type":"ContainerStarted","Data":"7c1b8ad6f08197d90edd8a98e2701661299c20e3fc595f6a4a8b2e0fb73dde2f"} Jul 17 17:56:56.432983 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:56.432930 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" podStartSLOduration=2.432915981 podStartE2EDuration="2.432915981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:56.431289138 +0000 UTC m=+1585.041958520" watchObservedRunningTime="2026-07-17 17:56:56.432915981 +0000 UTC m=+1585.043585391" Jul 17 17:56:57.341028 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:57.340988 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:57.345966 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:57.345939 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:57.414028 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:57.413998 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:56:57.414900 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:56:57.414881 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:57:01.462568 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:01.462534 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx"] Jul 17 17:57:01.462988 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:01.462732 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" podUID="566ab4dd-8d6f-4714-8362-104a112c7060" containerName="istio-proxy" containerID="cri-o://e5a4d39626ef9c5ab0051a78927a48780509ab2e4310909c38309559e84ca95f" gracePeriod=30 Jul 17 17:57:06.115337 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.115307 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:57:06.219080 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.218997 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/566ab4dd-8d6f-4714-8362-104a112c7060-istio-token\") pod \"566ab4dd-8d6f-4714-8362-104a112c7060\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " Jul 17 17:57:06.219080 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219045 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/566ab4dd-8d6f-4714-8362-104a112c7060-istiod-ca-cert\") pod \"566ab4dd-8d6f-4714-8362-104a112c7060\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " Jul 17 17:57:06.219080 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219073 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-credential-socket\") pod \"566ab4dd-8d6f-4714-8362-104a112c7060\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " Jul 17 17:57:06.219592 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219192 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxlzn\" (UniqueName: \"kubernetes.io/projected/566ab4dd-8d6f-4714-8362-104a112c7060-kube-api-access-vxlzn\") pod \"566ab4dd-8d6f-4714-8362-104a112c7060\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " Jul 17 17:57:06.219592 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219232 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-workload-certs\") pod \"566ab4dd-8d6f-4714-8362-104a112c7060\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " Jul 17 17:57:06.219592 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219267 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-istio-data\") pod \"566ab4dd-8d6f-4714-8362-104a112c7060\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " Jul 17 17:57:06.219592 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219338 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-workload-socket\") pod \"566ab4dd-8d6f-4714-8362-104a112c7060\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " Jul 17 17:57:06.219592 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219345 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "566ab4dd-8d6f-4714-8362-104a112c7060" (UID: "566ab4dd-8d6f-4714-8362-104a112c7060"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:57:06.219592 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219369 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-istio-envoy\") pod \"566ab4dd-8d6f-4714-8362-104a112c7060\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " Jul 17 17:57:06.219592 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219405 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/566ab4dd-8d6f-4714-8362-104a112c7060-istio-podinfo\") pod \"566ab4dd-8d6f-4714-8362-104a112c7060\" (UID: \"566ab4dd-8d6f-4714-8362-104a112c7060\") " Jul 17 17:57:06.219592 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219441 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/566ab4dd-8d6f-4714-8362-104a112c7060-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "566ab4dd-8d6f-4714-8362-104a112c7060" (UID: "566ab4dd-8d6f-4714-8362-104a112c7060"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:57:06.219592 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219479 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "566ab4dd-8d6f-4714-8362-104a112c7060" (UID: "566ab4dd-8d6f-4714-8362-104a112c7060"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:57:06.219592 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219590 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "566ab4dd-8d6f-4714-8362-104a112c7060" (UID: "566ab4dd-8d6f-4714-8362-104a112c7060"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:57:06.220122 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219770 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-workload-certs\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:06.220122 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219790 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-workload-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:06.220122 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219803 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/566ab4dd-8d6f-4714-8362-104a112c7060-istiod-ca-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:06.220122 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.219816 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-credential-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:06.220385 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.220359 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-istio-data" (OuterVolumeSpecName: "istio-data") pod "566ab4dd-8d6f-4714-8362-104a112c7060" (UID: "566ab4dd-8d6f-4714-8362-104a112c7060"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:57:06.221397 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.221377 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/566ab4dd-8d6f-4714-8362-104a112c7060-istio-token" (OuterVolumeSpecName: "istio-token") pod "566ab4dd-8d6f-4714-8362-104a112c7060" (UID: "566ab4dd-8d6f-4714-8362-104a112c7060"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:57:06.221483 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.221437 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "566ab4dd-8d6f-4714-8362-104a112c7060" (UID: "566ab4dd-8d6f-4714-8362-104a112c7060"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:57:06.221650 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.221630 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/566ab4dd-8d6f-4714-8362-104a112c7060-kube-api-access-vxlzn" (OuterVolumeSpecName: "kube-api-access-vxlzn") pod "566ab4dd-8d6f-4714-8362-104a112c7060" (UID: "566ab4dd-8d6f-4714-8362-104a112c7060"). InnerVolumeSpecName "kube-api-access-vxlzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:57:06.221803 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.221781 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/566ab4dd-8d6f-4714-8362-104a112c7060-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "566ab4dd-8d6f-4714-8362-104a112c7060" (UID: "566ab4dd-8d6f-4714-8362-104a112c7060"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 17:57:06.321284 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.321250 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxlzn\" (UniqueName: \"kubernetes.io/projected/566ab4dd-8d6f-4714-8362-104a112c7060-kube-api-access-vxlzn\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:06.321284 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.321280 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-istio-data\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:06.321284 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.321291 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/566ab4dd-8d6f-4714-8362-104a112c7060-istio-envoy\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:06.321532 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.321299 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/566ab4dd-8d6f-4714-8362-104a112c7060-istio-podinfo\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:06.321532 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.321307 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/566ab4dd-8d6f-4714-8362-104a112c7060-istio-token\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:06.457404 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.457363 2557 generic.go:356] "Generic (PLEG): container finished" podID="566ab4dd-8d6f-4714-8362-104a112c7060" containerID="e5a4d39626ef9c5ab0051a78927a48780509ab2e4310909c38309559e84ca95f" exitCode=0 Jul 17 17:57:06.457567 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.457412 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" Jul 17 17:57:06.457567 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.457435 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" event={"ID":"566ab4dd-8d6f-4714-8362-104a112c7060","Type":"ContainerDied","Data":"e5a4d39626ef9c5ab0051a78927a48780509ab2e4310909c38309559e84ca95f"} Jul 17 17:57:06.457567 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.457487 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx" event={"ID":"566ab4dd-8d6f-4714-8362-104a112c7060","Type":"ContainerDied","Data":"7c1b8ad6f08197d90edd8a98e2701661299c20e3fc595f6a4a8b2e0fb73dde2f"} Jul 17 17:57:06.457567 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.457517 2557 scope.go:117] "RemoveContainer" containerID="e5a4d39626ef9c5ab0051a78927a48780509ab2e4310909c38309559e84ca95f" Jul 17 17:57:06.466662 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.466644 2557 scope.go:117] "RemoveContainer" containerID="e5a4d39626ef9c5ab0051a78927a48780509ab2e4310909c38309559e84ca95f" Jul 17 17:57:06.466942 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:57:06.466920 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5a4d39626ef9c5ab0051a78927a48780509ab2e4310909c38309559e84ca95f\": container with ID starting with e5a4d39626ef9c5ab0051a78927a48780509ab2e4310909c38309559e84ca95f not found: ID does not exist" containerID="e5a4d39626ef9c5ab0051a78927a48780509ab2e4310909c38309559e84ca95f" Jul 17 17:57:06.467002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.466950 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a4d39626ef9c5ab0051a78927a48780509ab2e4310909c38309559e84ca95f"} err="failed to get container status \"e5a4d39626ef9c5ab0051a78927a48780509ab2e4310909c38309559e84ca95f\": rpc error: code = NotFound desc = could not find container \"e5a4d39626ef9c5ab0051a78927a48780509ab2e4310909c38309559e84ca95f\": container with ID starting with e5a4d39626ef9c5ab0051a78927a48780509ab2e4310909c38309559e84ca95f not found: ID does not exist" Jul 17 17:57:06.481279 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.481217 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx"] Jul 17 17:57:06.486781 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:06.486754 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1d1f23e1-openshift-default-85bd9bffb9-7nmzx"] Jul 17 17:57:07.839383 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.839349 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs"] Jul 17 17:57:07.839864 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.839793 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566ab4dd-8d6f-4714-8362-104a112c7060" containerName="istio-proxy" Jul 17 17:57:07.839864 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.839806 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="566ab4dd-8d6f-4714-8362-104a112c7060" containerName="istio-proxy" Jul 17 17:57:07.839967 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.839890 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="566ab4dd-8d6f-4714-8362-104a112c7060" containerName="istio-proxy" Jul 17 17:57:07.844512 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.844485 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:07.850282 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.850256 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-24f8a1bf-gw-openshift-default-dockercfg-xvchn\"" Jul 17 17:57:07.857476 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.857445 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs"] Jul 17 17:57:07.878642 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.878604 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="566ab4dd-8d6f-4714-8362-104a112c7060" path="/var/lib/kubelet/pods/566ab4dd-8d6f-4714-8362-104a112c7060/volumes" Jul 17 17:57:07.938379 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.938342 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bhkg\" (UniqueName: \"kubernetes.io/projected/68cffb3b-9a78-45e4-b268-241d416913de-kube-api-access-2bhkg\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:07.938542 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.938395 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-workload-certs\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:07.938542 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.938450 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-istio-data\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:07.938542 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.938484 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-workload-socket\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:07.938542 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.938509 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-credential-socket\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:07.938699 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.938568 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68cffb3b-9a78-45e4-b268-241d416913de-istiod-ca-cert\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:07.938699 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.938618 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68cffb3b-9a78-45e4-b268-241d416913de-istio-podinfo\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:07.938699 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.938638 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68cffb3b-9a78-45e4-b268-241d416913de-istio-token\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:07.938699 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:07.938659 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-istio-envoy\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.040029 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.039987 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bhkg\" (UniqueName: \"kubernetes.io/projected/68cffb3b-9a78-45e4-b268-241d416913de-kube-api-access-2bhkg\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.040232 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.040045 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-workload-certs\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.040232 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.040082 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-istio-data\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.040232 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.040121 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-workload-socket\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.040232 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.040147 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-credential-socket\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.040232 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.040182 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68cffb3b-9a78-45e4-b268-241d416913de-istiod-ca-cert\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.040232 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.040222 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68cffb3b-9a78-45e4-b268-241d416913de-istio-podinfo\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.040576 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.040245 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68cffb3b-9a78-45e4-b268-241d416913de-istio-token\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.040576 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.040274 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-istio-envoy\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.040576 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.040513 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-workload-certs\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.040576 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.040563 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-istio-data\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.040796 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.040603 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-workload-socket\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.040796 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.040619 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-credential-socket\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.041122 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.041103 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68cffb3b-9a78-45e4-b268-241d416913de-istiod-ca-cert\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.042504 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.042481 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-istio-envoy\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.042750 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.042733 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68cffb3b-9a78-45e4-b268-241d416913de-istio-podinfo\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.052242 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.052220 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68cffb3b-9a78-45e4-b268-241d416913de-istio-token\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.052335 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.052299 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bhkg\" (UniqueName: \"kubernetes.io/projected/68cffb3b-9a78-45e4-b268-241d416913de-kube-api-access-2bhkg\") pod \"e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.158479 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.158397 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:08.304992 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.304952 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs"] Jul 17 17:57:08.307398 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:57:08.307356 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68cffb3b_9a78_45e4_b268_241d416913de.slice/crio-dee9c867a8ad3bdd2b52f36f2880c9cbce37e8df8ba560f20d70125771021094 WatchSource:0}: Error finding container dee9c867a8ad3bdd2b52f36f2880c9cbce37e8df8ba560f20d70125771021094: Status 404 returned error can't find the container with id dee9c867a8ad3bdd2b52f36f2880c9cbce37e8df8ba560f20d70125771021094 Jul 17 17:57:08.309394 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.309356 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:57:08.309481 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.309428 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:57:08.309481 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.309453 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:57:08.470618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.470531 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" event={"ID":"68cffb3b-9a78-45e4-b268-241d416913de","Type":"ContainerStarted","Data":"99f3dc9255d3d7760e9d7fe59208201f1bd446238742305f011c6cf42a52e954"} Jul 17 17:57:08.470618 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.470599 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" event={"ID":"68cffb3b-9a78-45e4-b268-241d416913de","Type":"ContainerStarted","Data":"dee9c867a8ad3bdd2b52f36f2880c9cbce37e8df8ba560f20d70125771021094"} Jul 17 17:57:08.492282 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:08.492215 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" podStartSLOduration=1.492197964 podStartE2EDuration="1.492197964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:57:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:08.490641136 +0000 UTC m=+1597.101310518" watchObservedRunningTime="2026-07-17 17:57:08.492197964 +0000 UTC m=+1597.102867346" Jul 17 17:57:09.159463 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:09.159423 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:09.164214 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:09.164188 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:09.475430 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:09.475338 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:09.476390 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:09.476373 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:13.748198 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:13.748162 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs"] Jul 17 17:57:13.748712 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:13.748352 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" podUID="68cffb3b-9a78-45e4-b268-241d416913de" containerName="istio-proxy" containerID="cri-o://99f3dc9255d3d7760e9d7fe59208201f1bd446238742305f011c6cf42a52e954" gracePeriod=30 Jul 17 17:57:19.894948 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:19.894918 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:19.914966 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:19.914938 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr"] Jul 17 17:57:19.915316 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:19.915300 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68cffb3b-9a78-45e4-b268-241d416913de" containerName="istio-proxy" Jul 17 17:57:19.915316 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:19.915316 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="68cffb3b-9a78-45e4-b268-241d416913de" containerName="istio-proxy" Jul 17 17:57:19.915469 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:19.915449 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="68cffb3b-9a78-45e4-b268-241d416913de" containerName="istio-proxy" Jul 17 17:57:19.918429 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:19.918408 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:19.921459 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:19.921435 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ee229465-openshift-default-dockercfg-nxq2t\"" Jul 17 17:57:19.933016 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:19.932984 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr"] Jul 17 17:57:20.052994 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.052964 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-credential-socket\") pod \"68cffb3b-9a78-45e4-b268-241d416913de\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " Jul 17 17:57:20.052994 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053002 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68cffb3b-9a78-45e4-b268-241d416913de-istio-token\") pod \"68cffb3b-9a78-45e4-b268-241d416913de\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " Jul 17 17:57:20.053204 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053044 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-istio-data\") pod \"68cffb3b-9a78-45e4-b268-241d416913de\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " Jul 17 17:57:20.053204 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053084 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68cffb3b-9a78-45e4-b268-241d416913de-istiod-ca-cert\") pod \"68cffb3b-9a78-45e4-b268-241d416913de\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " Jul 17 17:57:20.053204 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053112 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68cffb3b-9a78-45e4-b268-241d416913de-istio-podinfo\") pod \"68cffb3b-9a78-45e4-b268-241d416913de\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " Jul 17 17:57:20.053204 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053140 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-istio-envoy\") pod \"68cffb3b-9a78-45e4-b268-241d416913de\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " Jul 17 17:57:20.053398 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053210 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-workload-certs\") pod \"68cffb3b-9a78-45e4-b268-241d416913de\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " Jul 17 17:57:20.053398 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053241 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bhkg\" (UniqueName: \"kubernetes.io/projected/68cffb3b-9a78-45e4-b268-241d416913de-kube-api-access-2bhkg\") pod \"68cffb3b-9a78-45e4-b268-241d416913de\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " Jul 17 17:57:20.053398 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053275 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "68cffb3b-9a78-45e4-b268-241d416913de" (UID: "68cffb3b-9a78-45e4-b268-241d416913de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:57:20.053398 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053295 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-workload-socket\") pod \"68cffb3b-9a78-45e4-b268-241d416913de\" (UID: \"68cffb3b-9a78-45e4-b268-241d416913de\") " Jul 17 17:57:20.053602 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053400 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-token\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.053602 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053443 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56631cb0-4cba-4d62-aa33-a457aa9356bc-istiod-ca-cert\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.053602 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053495 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "68cffb3b-9a78-45e4-b268-241d416913de" (UID: "68cffb3b-9a78-45e4-b268-241d416913de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:57:20.053602 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053531 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-workload-certs\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.053602 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053584 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5b79\" (UniqueName: \"kubernetes.io/projected/56631cb0-4cba-4d62-aa33-a457aa9356bc-kube-api-access-h5b79\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.053926 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053609 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-envoy\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.053926 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053632 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-data\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.053926 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053718 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "68cffb3b-9a78-45e4-b268-241d416913de" (UID: "68cffb3b-9a78-45e4-b268-241d416913de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:57:20.053926 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053748 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-credential-socket\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.053926 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053811 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-workload-socket\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.053926 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053854 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-podinfo\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.054251 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053967 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-credential-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:20.054251 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.053986 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-workload-certs\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:20.054251 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.054002 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-workload-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:20.054251 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.054188 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68cffb3b-9a78-45e4-b268-241d416913de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "68cffb3b-9a78-45e4-b268-241d416913de" (UID: "68cffb3b-9a78-45e4-b268-241d416913de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:57:20.054475 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.054286 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-istio-data" (OuterVolumeSpecName: "istio-data") pod "68cffb3b-9a78-45e4-b268-241d416913de" (UID: "68cffb3b-9a78-45e4-b268-241d416913de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:57:20.055553 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.055453 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68cffb3b-9a78-45e4-b268-241d416913de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "68cffb3b-9a78-45e4-b268-241d416913de" (UID: "68cffb3b-9a78-45e4-b268-241d416913de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 17:57:20.055553 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.055482 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68cffb3b-9a78-45e4-b268-241d416913de-kube-api-access-2bhkg" (OuterVolumeSpecName: "kube-api-access-2bhkg") pod "68cffb3b-9a78-45e4-b268-241d416913de" (UID: "68cffb3b-9a78-45e4-b268-241d416913de"). InnerVolumeSpecName "kube-api-access-2bhkg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:57:20.055553 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.055557 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68cffb3b-9a78-45e4-b268-241d416913de-istio-token" (OuterVolumeSpecName: "istio-token") pod "68cffb3b-9a78-45e4-b268-241d416913de" (UID: "68cffb3b-9a78-45e4-b268-241d416913de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:57:20.055839 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.055640 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "68cffb3b-9a78-45e4-b268-241d416913de" (UID: "68cffb3b-9a78-45e4-b268-241d416913de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:57:20.155324 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155285 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5b79\" (UniqueName: \"kubernetes.io/projected/56631cb0-4cba-4d62-aa33-a457aa9356bc-kube-api-access-h5b79\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.155524 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155333 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-envoy\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.155524 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155358 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-data\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.155524 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155430 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-credential-socket\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.155524 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155455 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-workload-socket\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.155524 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155479 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-podinfo\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.155524 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155523 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-token\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.155849 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155552 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56631cb0-4cba-4d62-aa33-a457aa9356bc-istiod-ca-cert\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.155849 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155616 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-workload-certs\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.155849 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155662 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68cffb3b-9a78-45e4-b268-241d416913de-istio-token\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:20.155849 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155693 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-istio-data\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:20.155849 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155707 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68cffb3b-9a78-45e4-b268-241d416913de-istiod-ca-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:20.155849 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155720 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68cffb3b-9a78-45e4-b268-241d416913de-istio-podinfo\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:20.155849 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155733 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68cffb3b-9a78-45e4-b268-241d416913de-istio-envoy\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:20.155849 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155748 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bhkg\" (UniqueName: \"kubernetes.io/projected/68cffb3b-9a78-45e4-b268-241d416913de-kube-api-access-2bhkg\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:57:20.155849 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155814 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-data\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.156349 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.155888 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-credential-socket\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.156349 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.156050 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-workload-certs\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.156349 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.156188 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-workload-socket\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.158105 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.158076 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56631cb0-4cba-4d62-aa33-a457aa9356bc-istiod-ca-cert\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.158626 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.158605 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-envoy\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.158797 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.158773 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-podinfo\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.171624 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.171593 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-token\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.171808 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.171784 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5b79\" (UniqueName: \"kubernetes.io/projected/56631cb0-4cba-4d62-aa33-a457aa9356bc-kube-api-access-h5b79\") pod \"e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.232761 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.232659 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:20.387211 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.387184 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr"] Jul 17 17:57:20.389961 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:57:20.389919 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56631cb0_4cba_4d62_aa33_a457aa9356bc.slice/crio-25d3e60e3cdb61b5c8fcc47af0abd0f28777c7c5b411dcfcf8975b81ca78011c WatchSource:0}: Error finding container 25d3e60e3cdb61b5c8fcc47af0abd0f28777c7c5b411dcfcf8975b81ca78011c: Status 404 returned error can't find the container with id 25d3e60e3cdb61b5c8fcc47af0abd0f28777c7c5b411dcfcf8975b81ca78011c Jul 17 17:57:20.392107 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.392070 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:57:20.392174 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.392151 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:57:20.392211 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.392186 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:57:20.535154 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.535059 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" event={"ID":"56631cb0-4cba-4d62-aa33-a457aa9356bc","Type":"ContainerStarted","Data":"f5ffd19d01bbf001edc5ec6f75d6e89719d0368bde24cdedf473eaad05b77a79"} Jul 17 17:57:20.535154 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.535125 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" event={"ID":"56631cb0-4cba-4d62-aa33-a457aa9356bc","Type":"ContainerStarted","Data":"25d3e60e3cdb61b5c8fcc47af0abd0f28777c7c5b411dcfcf8975b81ca78011c"} Jul 17 17:57:20.536550 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.536526 2557 generic.go:356] "Generic (PLEG): container finished" podID="68cffb3b-9a78-45e4-b268-241d416913de" containerID="99f3dc9255d3d7760e9d7fe59208201f1bd446238742305f011c6cf42a52e954" exitCode=0 Jul 17 17:57:20.536653 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.536574 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" event={"ID":"68cffb3b-9a78-45e4-b268-241d416913de","Type":"ContainerDied","Data":"99f3dc9255d3d7760e9d7fe59208201f1bd446238742305f011c6cf42a52e954"} Jul 17 17:57:20.536653 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.536577 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" Jul 17 17:57:20.536653 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.536610 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs" event={"ID":"68cffb3b-9a78-45e4-b268-241d416913de","Type":"ContainerDied","Data":"dee9c867a8ad3bdd2b52f36f2880c9cbce37e8df8ba560f20d70125771021094"} Jul 17 17:57:20.536653 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.536632 2557 scope.go:117] "RemoveContainer" containerID="99f3dc9255d3d7760e9d7fe59208201f1bd446238742305f011c6cf42a52e954" Jul 17 17:57:20.545577 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.545556 2557 scope.go:117] "RemoveContainer" containerID="99f3dc9255d3d7760e9d7fe59208201f1bd446238742305f011c6cf42a52e954" Jul 17 17:57:20.545926 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:57:20.545896 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99f3dc9255d3d7760e9d7fe59208201f1bd446238742305f011c6cf42a52e954\": container with ID starting with 99f3dc9255d3d7760e9d7fe59208201f1bd446238742305f011c6cf42a52e954 not found: ID does not exist" containerID="99f3dc9255d3d7760e9d7fe59208201f1bd446238742305f011c6cf42a52e954" Jul 17 17:57:20.546019 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.545936 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99f3dc9255d3d7760e9d7fe59208201f1bd446238742305f011c6cf42a52e954"} err="failed to get container status \"99f3dc9255d3d7760e9d7fe59208201f1bd446238742305f011c6cf42a52e954\": rpc error: code = NotFound desc = could not find container \"99f3dc9255d3d7760e9d7fe59208201f1bd446238742305f011c6cf42a52e954\": container with ID starting with 99f3dc9255d3d7760e9d7fe59208201f1bd446238742305f011c6cf42a52e954 not found: ID does not exist" Jul 17 17:57:20.564078 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.564024 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" podStartSLOduration=1.564009452 podStartE2EDuration="1.564009452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:57:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:20.562257435 +0000 UTC m=+1609.172926819" watchObservedRunningTime="2026-07-17 17:57:20.564009452 +0000 UTC m=+1609.174678909" Jul 17 17:57:20.579825 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.579786 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs"] Jul 17 17:57:20.584865 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:20.584828 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-24f8a1bf-gw-openshift-default-74fbd5dfbc-qqrrs"] Jul 17 17:57:21.233570 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:21.233536 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:21.238372 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:21.238344 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:21.549163 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:21.549085 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:21.550231 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:21.550212 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:21.878412 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:21.878374 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68cffb3b-9a78-45e4-b268-241d416913de" path="/var/lib/kubelet/pods/68cffb3b-9a78-45e4-b268-241d416913de/volumes" Jul 17 17:57:31.603969 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:31.603932 2557 generic.go:356] "Generic (PLEG): container finished" podID="56631cb0-4cba-4d62-aa33-a457aa9356bc" containerID="f5ffd19d01bbf001edc5ec6f75d6e89719d0368bde24cdedf473eaad05b77a79" exitCode=0 Jul 17 17:57:31.604475 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:31.603982 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" event={"ID":"56631cb0-4cba-4d62-aa33-a457aa9356bc","Type":"ContainerDied","Data":"f5ffd19d01bbf001edc5ec6f75d6e89719d0368bde24cdedf473eaad05b77a79"} Jul 17 17:57:31.604541 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:31.604518 2557 scope.go:117] "RemoveContainer" containerID="f5ffd19d01bbf001edc5ec6f75d6e89719d0368bde24cdedf473eaad05b77a79" Jul 17 17:57:31.605583 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:31.605551 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:57:31.605646 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:31.605621 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:57:31.605713 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:31.605699 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:57:32.612003 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:32.611976 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" event={"ID":"56631cb0-4cba-4d62-aa33-a457aa9356bc","Type":"ContainerStarted","Data":"32388f285b5e3f6a862c649021d60a36a2b89ccb29f74c2ba91113d0b50f950a"} Jul 17 17:57:33.233611 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:33.233566 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:33.234673 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:33.234649 2557 patch_prober.go:28] interesting pod/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 17 17:57:33.234783 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:33.234727 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" podUID="56631cb0-4cba-4d62-aa33-a457aa9356bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 17 17:57:34.233101 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:34.233056 2557 patch_prober.go:28] interesting pod/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 17 17:57:34.233480 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:34.233127 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" podUID="56631cb0-4cba-4d62-aa33-a457aa9356bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 17 17:57:35.233877 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:35.233843 2557 patch_prober.go:28] interesting pod/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 17 17:57:35.234337 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:35.233903 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" podUID="56631cb0-4cba-4d62-aa33-a457aa9356bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 17 17:57:36.233972 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:36.233935 2557 patch_prober.go:28] interesting pod/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 17 17:57:36.234370 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:36.233990 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" podUID="56631cb0-4cba-4d62-aa33-a457aa9356bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 17 17:57:36.549073 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:36.548971 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:37.236945 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:37.236918 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:57:37.237949 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:57:37.237927 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:59:29.728442 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:29.728397 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr"] Jul 17 17:59:29.729064 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:29.728694 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" podUID="56631cb0-4cba-4d62-aa33-a457aa9356bc" containerName="istio-proxy" containerID="cri-o://32388f285b5e3f6a862c649021d60a36a2b89ccb29f74c2ba91113d0b50f950a" gracePeriod=30 Jul 17 17:59:34.975343 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:34.975319 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:59:35.058626 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.058593 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-workload-certs\") pod \"56631cb0-4cba-4d62-aa33-a457aa9356bc\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " Jul 17 17:59:35.058821 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.058640 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-workload-socket\") pod \"56631cb0-4cba-4d62-aa33-a457aa9356bc\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " Jul 17 17:59:35.058821 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.058662 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-podinfo\") pod \"56631cb0-4cba-4d62-aa33-a457aa9356bc\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " Jul 17 17:59:35.058821 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.058718 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-token\") pod \"56631cb0-4cba-4d62-aa33-a457aa9356bc\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " Jul 17 17:59:35.058821 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.058746 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56631cb0-4cba-4d62-aa33-a457aa9356bc-istiod-ca-cert\") pod \"56631cb0-4cba-4d62-aa33-a457aa9356bc\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " Jul 17 17:59:35.058821 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.058763 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5b79\" (UniqueName: \"kubernetes.io/projected/56631cb0-4cba-4d62-aa33-a457aa9356bc-kube-api-access-h5b79\") pod \"56631cb0-4cba-4d62-aa33-a457aa9356bc\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " Jul 17 17:59:35.059136 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.058823 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-envoy\") pod \"56631cb0-4cba-4d62-aa33-a457aa9356bc\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " Jul 17 17:59:35.059136 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.058846 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-data\") pod \"56631cb0-4cba-4d62-aa33-a457aa9356bc\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " Jul 17 17:59:35.059136 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.058920 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-credential-socket\") pod \"56631cb0-4cba-4d62-aa33-a457aa9356bc\" (UID: \"56631cb0-4cba-4d62-aa33-a457aa9356bc\") " Jul 17 17:59:35.059136 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.058919 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "56631cb0-4cba-4d62-aa33-a457aa9356bc" (UID: "56631cb0-4cba-4d62-aa33-a457aa9356bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:59:35.059136 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.058957 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "56631cb0-4cba-4d62-aa33-a457aa9356bc" (UID: "56631cb0-4cba-4d62-aa33-a457aa9356bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:59:35.059400 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.059241 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-workload-certs\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:35.059400 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.059262 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-workload-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:35.059400 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.059283 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "56631cb0-4cba-4d62-aa33-a457aa9356bc" (UID: "56631cb0-4cba-4d62-aa33-a457aa9356bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:59:35.059400 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.059346 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56631cb0-4cba-4d62-aa33-a457aa9356bc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "56631cb0-4cba-4d62-aa33-a457aa9356bc" (UID: "56631cb0-4cba-4d62-aa33-a457aa9356bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:59:35.059846 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.059820 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-data" (OuterVolumeSpecName: "istio-data") pod "56631cb0-4cba-4d62-aa33-a457aa9356bc" (UID: "56631cb0-4cba-4d62-aa33-a457aa9356bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:59:35.061072 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.061034 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "56631cb0-4cba-4d62-aa33-a457aa9356bc" (UID: "56631cb0-4cba-4d62-aa33-a457aa9356bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 17:59:35.061177 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.061136 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "56631cb0-4cba-4d62-aa33-a457aa9356bc" (UID: "56631cb0-4cba-4d62-aa33-a457aa9356bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:59:35.061393 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.061373 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56631cb0-4cba-4d62-aa33-a457aa9356bc-kube-api-access-h5b79" (OuterVolumeSpecName: "kube-api-access-h5b79") pod "56631cb0-4cba-4d62-aa33-a457aa9356bc" (UID: "56631cb0-4cba-4d62-aa33-a457aa9356bc"). InnerVolumeSpecName "kube-api-access-h5b79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:59:35.061573 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.061547 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-token" (OuterVolumeSpecName: "istio-token") pod "56631cb0-4cba-4d62-aa33-a457aa9356bc" (UID: "56631cb0-4cba-4d62-aa33-a457aa9356bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:59:35.160006 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.159969 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-podinfo\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:35.160006 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.159996 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-token\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:35.160006 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.160006 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56631cb0-4cba-4d62-aa33-a457aa9356bc-istiod-ca-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:35.160006 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.160014 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5b79\" (UniqueName: \"kubernetes.io/projected/56631cb0-4cba-4d62-aa33-a457aa9356bc-kube-api-access-h5b79\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:35.160321 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.160024 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-envoy\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:35.160321 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.160032 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-istio-data\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:35.160321 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.160040 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56631cb0-4cba-4d62-aa33-a457aa9356bc-credential-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:35.190942 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.190905 2557 generic.go:356] "Generic (PLEG): container finished" podID="56631cb0-4cba-4d62-aa33-a457aa9356bc" containerID="32388f285b5e3f6a862c649021d60a36a2b89ccb29f74c2ba91113d0b50f950a" exitCode=0 Jul 17 17:59:35.191110 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.190965 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" Jul 17 17:59:35.191110 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.190999 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" event={"ID":"56631cb0-4cba-4d62-aa33-a457aa9356bc","Type":"ContainerDied","Data":"32388f285b5e3f6a862c649021d60a36a2b89ccb29f74c2ba91113d0b50f950a"} Jul 17 17:59:35.191110 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.191059 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr" event={"ID":"56631cb0-4cba-4d62-aa33-a457aa9356bc","Type":"ContainerDied","Data":"25d3e60e3cdb61b5c8fcc47af0abd0f28777c7c5b411dcfcf8975b81ca78011c"} Jul 17 17:59:35.191110 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.191085 2557 scope.go:117] "RemoveContainer" containerID="32388f285b5e3f6a862c649021d60a36a2b89ccb29f74c2ba91113d0b50f950a" Jul 17 17:59:35.200271 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.200251 2557 scope.go:117] "RemoveContainer" containerID="f5ffd19d01bbf001edc5ec6f75d6e89719d0368bde24cdedf473eaad05b77a79" Jul 17 17:59:35.208031 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.208013 2557 scope.go:117] "RemoveContainer" containerID="32388f285b5e3f6a862c649021d60a36a2b89ccb29f74c2ba91113d0b50f950a" Jul 17 17:59:35.208278 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:59:35.208260 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32388f285b5e3f6a862c649021d60a36a2b89ccb29f74c2ba91113d0b50f950a\": container with ID starting with 32388f285b5e3f6a862c649021d60a36a2b89ccb29f74c2ba91113d0b50f950a not found: ID does not exist" containerID="32388f285b5e3f6a862c649021d60a36a2b89ccb29f74c2ba91113d0b50f950a" Jul 17 17:59:35.208323 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.208287 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32388f285b5e3f6a862c649021d60a36a2b89ccb29f74c2ba91113d0b50f950a"} err="failed to get container status \"32388f285b5e3f6a862c649021d60a36a2b89ccb29f74c2ba91113d0b50f950a\": rpc error: code = NotFound desc = could not find container \"32388f285b5e3f6a862c649021d60a36a2b89ccb29f74c2ba91113d0b50f950a\": container with ID starting with 32388f285b5e3f6a862c649021d60a36a2b89ccb29f74c2ba91113d0b50f950a not found: ID does not exist" Jul 17 17:59:35.208323 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.208304 2557 scope.go:117] "RemoveContainer" containerID="f5ffd19d01bbf001edc5ec6f75d6e89719d0368bde24cdedf473eaad05b77a79" Jul 17 17:59:35.208543 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:59:35.208527 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5ffd19d01bbf001edc5ec6f75d6e89719d0368bde24cdedf473eaad05b77a79\": container with ID starting with f5ffd19d01bbf001edc5ec6f75d6e89719d0368bde24cdedf473eaad05b77a79 not found: ID does not exist" containerID="f5ffd19d01bbf001edc5ec6f75d6e89719d0368bde24cdedf473eaad05b77a79" Jul 17 17:59:35.208585 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.208549 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5ffd19d01bbf001edc5ec6f75d6e89719d0368bde24cdedf473eaad05b77a79"} err="failed to get container status \"f5ffd19d01bbf001edc5ec6f75d6e89719d0368bde24cdedf473eaad05b77a79\": rpc error: code = NotFound desc = could not find container \"f5ffd19d01bbf001edc5ec6f75d6e89719d0368bde24cdedf473eaad05b77a79\": container with ID starting with f5ffd19d01bbf001edc5ec6f75d6e89719d0368bde24cdedf473eaad05b77a79 not found: ID does not exist" Jul 17 17:59:35.211624 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.211604 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr"] Jul 17 17:59:35.214273 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.214253 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ee229465-openshift-default-fb6f99dc9-qx2mr"] Jul 17 17:59:35.854981 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.854951 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr"] Jul 17 17:59:35.855302 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.855290 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56631cb0-4cba-4d62-aa33-a457aa9356bc" containerName="istio-proxy" Jul 17 17:59:35.855345 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.855303 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="56631cb0-4cba-4d62-aa33-a457aa9356bc" containerName="istio-proxy" Jul 17 17:59:35.855345 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.855311 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56631cb0-4cba-4d62-aa33-a457aa9356bc" containerName="istio-proxy" Jul 17 17:59:35.855345 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.855316 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="56631cb0-4cba-4d62-aa33-a457aa9356bc" containerName="istio-proxy" Jul 17 17:59:35.855442 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.855402 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="56631cb0-4cba-4d62-aa33-a457aa9356bc" containerName="istio-proxy" Jul 17 17:59:35.859891 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.859868 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:35.862377 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.862353 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-84841c77-openshift-default-dockercfg-dbcks\"" Jul 17 17:59:35.880507 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.880480 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56631cb0-4cba-4d62-aa33-a457aa9356bc" path="/var/lib/kubelet/pods/56631cb0-4cba-4d62-aa33-a457aa9356bc/volumes" Jul 17 17:59:35.880790 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.880776 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr"] Jul 17 17:59:35.969640 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.969603 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-credential-socket\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:35.969842 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.969652 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe312a19-1fd5-4660-80af-559fd18fe0f8-istiod-ca-cert\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:35.969842 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.969730 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-token\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:35.969946 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.969840 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-workload-certs\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:35.969946 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.969878 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-envoy\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:35.970023 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.969956 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncxdz\" (UniqueName: \"kubernetes.io/projected/fe312a19-1fd5-4660-80af-559fd18fe0f8-kube-api-access-ncxdz\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:35.970023 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.969998 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-podinfo\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:35.970126 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.970037 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-workload-socket\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:35.970126 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:35.970101 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-data\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.071267 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.071179 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-workload-socket\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.071267 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.071233 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-data\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.071267 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.071262 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-credential-socket\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.071836 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.071278 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe312a19-1fd5-4660-80af-559fd18fe0f8-istiod-ca-cert\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.071836 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.071304 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-token\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.071836 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.071341 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-workload-certs\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.071836 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.071663 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-workload-socket\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.071836 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.071713 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-envoy\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.071836 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.071778 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-credential-socket\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.071836 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.071717 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-workload-certs\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.071836 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.071804 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-data\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.071836 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.071789 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncxdz\" (UniqueName: \"kubernetes.io/projected/fe312a19-1fd5-4660-80af-559fd18fe0f8-kube-api-access-ncxdz\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.072157 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.071857 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-podinfo\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.072204 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.072163 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe312a19-1fd5-4660-80af-559fd18fe0f8-istiod-ca-cert\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.073949 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.073922 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-envoy\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.074177 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.074160 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-podinfo\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.082387 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.082359 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncxdz\" (UniqueName: \"kubernetes.io/projected/fe312a19-1fd5-4660-80af-559fd18fe0f8-kube-api-access-ncxdz\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.089431 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.089404 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-token\") pod \"e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.170348 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.170311 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:36.316565 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.316531 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr"] Jul 17 17:59:36.320614 ip-10-0-130-245 kubenswrapper[2557]: W0717 17:59:36.320588 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe312a19_1fd5_4660_80af_559fd18fe0f8.slice/crio-e5b5f2a0490f8eefff52bc171c1b3f21d12f6189ef058c57e2e8d1cca1a0ca32 WatchSource:0}: Error finding container e5b5f2a0490f8eefff52bc171c1b3f21d12f6189ef058c57e2e8d1cca1a0ca32: Status 404 returned error can't find the container with id e5b5f2a0490f8eefff52bc171c1b3f21d12f6189ef058c57e2e8d1cca1a0ca32 Jul 17 17:59:36.323266 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.323227 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:59:36.323346 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.323312 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:59:36.323386 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:36.323353 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 17:59:37.203118 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:37.203077 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" event={"ID":"fe312a19-1fd5-4660-80af-559fd18fe0f8","Type":"ContainerStarted","Data":"94febea16c72b2021b600d44a350ef91745939d179e7c47d8444997201f55945"} Jul 17 17:59:37.203554 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:37.203133 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" event={"ID":"fe312a19-1fd5-4660-80af-559fd18fe0f8","Type":"ContainerStarted","Data":"e5b5f2a0490f8eefff52bc171c1b3f21d12f6189ef058c57e2e8d1cca1a0ca32"} Jul 17 17:59:37.223515 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:37.223464 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" podStartSLOduration=2.223450428 podStartE2EDuration="2.223450428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:59:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:59:37.222138709 +0000 UTC m=+1745.832808289" watchObservedRunningTime="2026-07-17 17:59:37.223450428 +0000 UTC m=+1745.834119810" Jul 17 17:59:38.170857 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:38.170820 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:38.175991 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:38.175967 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:38.208742 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:38.208707 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:38.209581 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:38.209563 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:41.511671 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:41.511631 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr"] Jul 17 17:59:41.512085 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:41.511863 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" podUID="fe312a19-1fd5-4660-80af-559fd18fe0f8" containerName="istio-proxy" containerID="cri-o://94febea16c72b2021b600d44a350ef91745939d179e7c47d8444997201f55945" gracePeriod=30 Jul 17 17:59:48.171791 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.171725 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:48.261002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.260917 2557 generic.go:356] "Generic (PLEG): container finished" podID="fe312a19-1fd5-4660-80af-559fd18fe0f8" containerID="94febea16c72b2021b600d44a350ef91745939d179e7c47d8444997201f55945" exitCode=0 Jul 17 17:59:48.261002 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.260959 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" Jul 17 17:59:48.261191 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.261006 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" event={"ID":"fe312a19-1fd5-4660-80af-559fd18fe0f8","Type":"ContainerDied","Data":"94febea16c72b2021b600d44a350ef91745939d179e7c47d8444997201f55945"} Jul 17 17:59:48.261191 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.261059 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr" event={"ID":"fe312a19-1fd5-4660-80af-559fd18fe0f8","Type":"ContainerDied","Data":"e5b5f2a0490f8eefff52bc171c1b3f21d12f6189ef058c57e2e8d1cca1a0ca32"} Jul 17 17:59:48.261191 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.261081 2557 scope.go:117] "RemoveContainer" containerID="94febea16c72b2021b600d44a350ef91745939d179e7c47d8444997201f55945" Jul 17 17:59:48.269370 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.269349 2557 scope.go:117] "RemoveContainer" containerID="94febea16c72b2021b600d44a350ef91745939d179e7c47d8444997201f55945" Jul 17 17:59:48.269609 ip-10-0-130-245 kubenswrapper[2557]: E0717 17:59:48.269589 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94febea16c72b2021b600d44a350ef91745939d179e7c47d8444997201f55945\": container with ID starting with 94febea16c72b2021b600d44a350ef91745939d179e7c47d8444997201f55945 not found: ID does not exist" containerID="94febea16c72b2021b600d44a350ef91745939d179e7c47d8444997201f55945" Jul 17 17:59:48.269661 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.269616 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94febea16c72b2021b600d44a350ef91745939d179e7c47d8444997201f55945"} err="failed to get container status \"94febea16c72b2021b600d44a350ef91745939d179e7c47d8444997201f55945\": rpc error: code = NotFound desc = could not find container \"94febea16c72b2021b600d44a350ef91745939d179e7c47d8444997201f55945\": container with ID starting with 94febea16c72b2021b600d44a350ef91745939d179e7c47d8444997201f55945 not found: ID does not exist" Jul 17 17:59:48.284371 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.284348 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-podinfo\") pod \"fe312a19-1fd5-4660-80af-559fd18fe0f8\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " Jul 17 17:59:48.284478 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.284398 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncxdz\" (UniqueName: \"kubernetes.io/projected/fe312a19-1fd5-4660-80af-559fd18fe0f8-kube-api-access-ncxdz\") pod \"fe312a19-1fd5-4660-80af-559fd18fe0f8\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " Jul 17 17:59:48.284478 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.284451 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-token\") pod \"fe312a19-1fd5-4660-80af-559fd18fe0f8\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " Jul 17 17:59:48.284478 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.284475 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe312a19-1fd5-4660-80af-559fd18fe0f8-istiod-ca-cert\") pod \"fe312a19-1fd5-4660-80af-559fd18fe0f8\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " Jul 17 17:59:48.284593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.284496 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-workload-certs\") pod \"fe312a19-1fd5-4660-80af-559fd18fe0f8\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " Jul 17 17:59:48.284593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.284511 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-data\") pod \"fe312a19-1fd5-4660-80af-559fd18fe0f8\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " Jul 17 17:59:48.284593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.284546 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-credential-socket\") pod \"fe312a19-1fd5-4660-80af-559fd18fe0f8\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " Jul 17 17:59:48.284593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.284571 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-envoy\") pod \"fe312a19-1fd5-4660-80af-559fd18fe0f8\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " Jul 17 17:59:48.284593 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.284587 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-workload-socket\") pod \"fe312a19-1fd5-4660-80af-559fd18fe0f8\" (UID: \"fe312a19-1fd5-4660-80af-559fd18fe0f8\") " Jul 17 17:59:48.286260 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.286242 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fe312a19-1fd5-4660-80af-559fd18fe0f8" (UID: "fe312a19-1fd5-4660-80af-559fd18fe0f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 17:59:48.290023 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.289941 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fe312a19-1fd5-4660-80af-559fd18fe0f8" (UID: "fe312a19-1fd5-4660-80af-559fd18fe0f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:59:48.290023 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.289952 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fe312a19-1fd5-4660-80af-559fd18fe0f8" (UID: "fe312a19-1fd5-4660-80af-559fd18fe0f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:59:48.290195 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.290146 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe312a19-1fd5-4660-80af-559fd18fe0f8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fe312a19-1fd5-4660-80af-559fd18fe0f8" (UID: "fe312a19-1fd5-4660-80af-559fd18fe0f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:59:48.290326 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.290294 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fe312a19-1fd5-4660-80af-559fd18fe0f8" (UID: "fe312a19-1fd5-4660-80af-559fd18fe0f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:59:48.290714 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.290664 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-data" (OuterVolumeSpecName: "istio-data") pod "fe312a19-1fd5-4660-80af-559fd18fe0f8" (UID: "fe312a19-1fd5-4660-80af-559fd18fe0f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:59:48.291760 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.291739 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe312a19-1fd5-4660-80af-559fd18fe0f8-kube-api-access-ncxdz" (OuterVolumeSpecName: "kube-api-access-ncxdz") pod "fe312a19-1fd5-4660-80af-559fd18fe0f8" (UID: "fe312a19-1fd5-4660-80af-559fd18fe0f8"). InnerVolumeSpecName "kube-api-access-ncxdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:59:48.291844 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.291770 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fe312a19-1fd5-4660-80af-559fd18fe0f8" (UID: "fe312a19-1fd5-4660-80af-559fd18fe0f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:59:48.291977 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.291958 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "fe312a19-1fd5-4660-80af-559fd18fe0f8" (UID: "fe312a19-1fd5-4660-80af-559fd18fe0f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:59:48.385656 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.385624 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-token\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:48.385656 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.385652 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe312a19-1fd5-4660-80af-559fd18fe0f8-istiod-ca-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:48.385656 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.385662 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-workload-certs\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:48.385906 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.385670 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-data\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:48.385906 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.385699 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-credential-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:48.385906 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.385709 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-envoy\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:48.385906 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.385718 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe312a19-1fd5-4660-80af-559fd18fe0f8-workload-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:48.385906 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.385728 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe312a19-1fd5-4660-80af-559fd18fe0f8-istio-podinfo\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:48.385906 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.385736 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncxdz\" (UniqueName: \"kubernetes.io/projected/fe312a19-1fd5-4660-80af-559fd18fe0f8-kube-api-access-ncxdz\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 17:59:48.582438 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.582407 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr"] Jul 17 17:59:48.587096 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:48.587059 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-84841c77-openshift-default-7cdbf7bdcf-hzqwr"] Jul 17 17:59:49.878838 ip-10-0-130-245 kubenswrapper[2557]: I0717 17:59:49.878796 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe312a19-1fd5-4660-80af-559fd18fe0f8" path="/var/lib/kubelet/pods/fe312a19-1fd5-4660-80af-559fd18fe0f8/volumes" Jul 17 18:00:00.131341 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.131304 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ee229465-29738520-45nzf"] Jul 17 18:00:00.131740 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.131659 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe312a19-1fd5-4660-80af-559fd18fe0f8" containerName="istio-proxy" Jul 17 18:00:00.131740 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.131670 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe312a19-1fd5-4660-80af-559fd18fe0f8" containerName="istio-proxy" Jul 17 18:00:00.131827 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.131757 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="56631cb0-4cba-4d62-aa33-a457aa9356bc" containerName="istio-proxy" Jul 17 18:00:00.131827 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.131767 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe312a19-1fd5-4660-80af-559fd18fe0f8" containerName="istio-proxy" Jul 17 18:00:00.136181 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.136155 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ee229465-29738520-45nzf" Jul 17 18:00:00.136346 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.136316 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-1d1f23e1-29738520-p5dvj"] Jul 17 18:00:00.139261 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.139228 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dzkq8\"" Jul 17 18:00:00.139995 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.139972 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-24f8a1bf-29738520-kl2m9"] Jul 17 18:00:00.140105 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.140089 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-1d1f23e1-29738520-p5dvj" Jul 17 18:00:00.143024 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.143004 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738520-xdckp"] Jul 17 18:00:00.143119 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.143108 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-24f8a1bf-29738520-kl2m9" Jul 17 18:00:00.146487 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.146468 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-84841c77-29738520-p5gwd"] Jul 17 18:00:00.146658 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.146637 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738520-xdckp" Jul 17 18:00:00.149776 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.149755 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ee229465-29738520-45nzf" Jul 17 18:00:00.149985 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.149965 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ee229465-29738520-45nzf"] Jul 17 18:00:00.150072 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.150057 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-84841c77-29738520-p5gwd" Jul 17 18:00:00.154570 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.154552 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-1d1f23e1-29738520-p5dvj"] Jul 17 18:00:00.159292 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.159271 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-24f8a1bf-29738520-kl2m9"] Jul 17 18:00:00.161383 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.161081 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-1d1f23e1-29738520-p5dvj" Jul 17 18:00:00.161383 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.161314 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-84841c77-29738520-p5gwd"] Jul 17 18:00:00.167109 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.165011 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738520-xdckp"] Jul 17 18:00:00.199472 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.199444 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-24f8a1bf-29738520-kl2m9" Jul 17 18:00:00.208971 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.208784 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738520-xdckp" Jul 17 18:00:00.243582 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.243372 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-84841c77-29738520-p5gwd" Jul 17 18:00:00.380029 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.380002 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ee229465-29738520-45nzf"] Jul 17 18:00:00.382936 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:00:00.382862 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95bba85d_3878_4515_a36a_05916e82829c.slice/crio-3c089c728a90e6ddbae62814fadc6c300399067ca01581afee3cd1d9e19e2293 WatchSource:0}: Error finding container 3c089c728a90e6ddbae62814fadc6c300399067ca01581afee3cd1d9e19e2293: Status 404 returned error can't find the container with id 3c089c728a90e6ddbae62814fadc6c300399067ca01581afee3cd1d9e19e2293 Jul 17 18:00:00.385287 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.385267 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 18:00:00.404932 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.404864 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-1d1f23e1-29738520-p5dvj"] Jul 17 18:00:00.408153 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:00:00.408127 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839a8041_0030_463f_94ec_fdeebe008251.slice/crio-f9858d45c752c32cda4f87fce5f81ad8c666bf40e6dc03cea1dcc95760c9b9fd WatchSource:0}: Error finding container f9858d45c752c32cda4f87fce5f81ad8c666bf40e6dc03cea1dcc95760c9b9fd: Status 404 returned error can't find the container with id f9858d45c752c32cda4f87fce5f81ad8c666bf40e6dc03cea1dcc95760c9b9fd Jul 17 18:00:00.447952 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.447917 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738520-xdckp"] Jul 17 18:00:00.451071 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:00:00.451033 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda15751df_7903_413e_80b8_90b365f2584f.slice/crio-8e6031b9ed2fc04776f32905a0b7a9db06c7ac3b4bfe2ae608cbf16c2b020d13 WatchSource:0}: Error finding container 8e6031b9ed2fc04776f32905a0b7a9db06c7ac3b4bfe2ae608cbf16c2b020d13: Status 404 returned error can't find the container with id 8e6031b9ed2fc04776f32905a0b7a9db06c7ac3b4bfe2ae608cbf16c2b020d13 Jul 17 18:00:00.468088 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.467986 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-24f8a1bf-29738520-kl2m9"] Jul 17 18:00:00.471303 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:00:00.471278 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf493131_0b3d_4f3e_a99a_54d34aa1fff3.slice/crio-89d3a1f787d72f0969fc03a89d8ba280ffb9ab0c7d2f752f5a69a8a44a31d251 WatchSource:0}: Error finding container 89d3a1f787d72f0969fc03a89d8ba280ffb9ab0c7d2f752f5a69a8a44a31d251: Status 404 returned error can't find the container with id 89d3a1f787d72f0969fc03a89d8ba280ffb9ab0c7d2f752f5a69a8a44a31d251 Jul 17 18:00:00.491174 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:00.491152 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-84841c77-29738520-p5gwd"] Jul 17 18:00:00.492931 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:00:00.492901 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0d3bcb_10be_49ac_a40d_ef7753c52bcb.slice/crio-407fdbee7237595a72915758bf80d376ae5d686d66acd8f3c39c90ffec2b54e8 WatchSource:0}: Error finding container 407fdbee7237595a72915758bf80d376ae5d686d66acd8f3c39c90ffec2b54e8: Status 404 returned error can't find the container with id 407fdbee7237595a72915758bf80d376ae5d686d66acd8f3c39c90ffec2b54e8 Jul 17 18:00:01.331828 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:01.331797 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-24f8a1bf-29738520-kl2m9" event={"ID":"df493131-0b3d-4f3e-a99a-54d34aa1fff3","Type":"ContainerStarted","Data":"89d3a1f787d72f0969fc03a89d8ba280ffb9ab0c7d2f752f5a69a8a44a31d251"} Jul 17 18:00:01.332963 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:01.332931 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-1d1f23e1-29738520-p5dvj" event={"ID":"839a8041-0030-463f-94ec-fdeebe008251","Type":"ContainerStarted","Data":"f9858d45c752c32cda4f87fce5f81ad8c666bf40e6dc03cea1dcc95760c9b9fd"} Jul 17 18:00:01.334050 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:01.334027 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738520-xdckp" event={"ID":"a15751df-7903-413e-80b8-90b365f2584f","Type":"ContainerStarted","Data":"8e6031b9ed2fc04776f32905a0b7a9db06c7ac3b4bfe2ae608cbf16c2b020d13"} Jul 17 18:00:01.335026 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:01.335009 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-84841c77-29738520-p5gwd" event={"ID":"ff0d3bcb-10be-49ac-a40d-ef7753c52bcb","Type":"ContainerStarted","Data":"407fdbee7237595a72915758bf80d376ae5d686d66acd8f3c39c90ffec2b54e8"} Jul 17 18:00:01.336021 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:01.336002 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ee229465-29738520-45nzf" event={"ID":"95bba85d-3878-4515-a36a-05916e82829c","Type":"ContainerStarted","Data":"3c089c728a90e6ddbae62814fadc6c300399067ca01581afee3cd1d9e19e2293"} Jul 17 18:00:06.367966 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:06.367931 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-24f8a1bf-29738520-kl2m9" event={"ID":"df493131-0b3d-4f3e-a99a-54d34aa1fff3","Type":"ContainerStarted","Data":"e9d331cec7f21e6b3269558cbf575e595ffbdb7a34b5142da63c9f075bbbcfa0"} Jul 17 18:00:06.369528 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:06.369496 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-1d1f23e1-29738520-p5dvj" event={"ID":"839a8041-0030-463f-94ec-fdeebe008251","Type":"ContainerStarted","Data":"88f6e6d3dc867d27e9e28e08104728d2fa1e0828290975c55a66f4836a33645e"} Jul 17 18:00:06.370974 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:06.370936 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-84841c77-29738520-p5gwd" event={"ID":"ff0d3bcb-10be-49ac-a40d-ef7753c52bcb","Type":"ContainerStarted","Data":"7f460916bf9e63580b515e7a77a9bc9abfb60a71afd44b7391500c1c91e45c6c"} Jul 17 18:00:06.372415 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:06.372394 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ee229465-29738520-45nzf" event={"ID":"95bba85d-3878-4515-a36a-05916e82829c","Type":"ContainerStarted","Data":"589d6ce1e41f72aaa06238af665ae31d984820aff07bd2a92356a5a885918928"} Jul 17 18:00:06.384944 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:06.384896 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-24f8a1bf-29738520-kl2m9" podStartSLOduration=1.425094613 podStartE2EDuration="6.384877157s" totalImagesPullingTime="4.959782544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:00:06.383434712 +0000 UTC m=+1774.994104093" watchObservedRunningTime="2026-07-17 18:00:06.384877157 +0000 UTC m=+1774.995546540" Jul 17 18:00:06.402893 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:06.402846 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ee229465-29738520-45nzf" podStartSLOduration=1.359383295 podStartE2EDuration="6.402832634s" totalImagesPullingTime="5.043449339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:00:06.401110081 +0000 UTC m=+1775.011779467" watchObservedRunningTime="2026-07-17 18:00:06.402832634 +0000 UTC m=+1775.013502016" Jul 17 18:00:06.418632 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:06.418586 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-1d1f23e1-29738520-p5dvj" podStartSLOduration=1.503069277 podStartE2EDuration="6.418571397s" totalImagesPullingTime="4.91550212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:00:06.416619579 +0000 UTC m=+1775.027288959" watchObservedRunningTime="2026-07-17 18:00:06.418571397 +0000 UTC m=+1775.029240780" Jul 17 18:00:06.432044 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:06.432005 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-84841c77-29738520-p5gwd" podStartSLOduration=1.564777597 podStartE2EDuration="6.431991599s" totalImagesPullingTime="4.867214002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:00:06.430471935 +0000 UTC m=+1775.041141318" watchObservedRunningTime="2026-07-17 18:00:06.431991599 +0000 UTC m=+1775.042660980" Jul 17 18:00:07.378825 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:07.378734 2557 generic.go:356] "Generic (PLEG): container finished" podID="ff0d3bcb-10be-49ac-a40d-ef7753c52bcb" containerID="7f460916bf9e63580b515e7a77a9bc9abfb60a71afd44b7391500c1c91e45c6c" exitCode=0 Jul 17 18:00:07.379217 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:07.378823 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-84841c77-29738520-p5gwd" event={"ID":"ff0d3bcb-10be-49ac-a40d-ef7753c52bcb","Type":"ContainerDied","Data":"7f460916bf9e63580b515e7a77a9bc9abfb60a71afd44b7391500c1c91e45c6c"} Jul 17 18:00:07.380303 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:07.380282 2557 generic.go:356] "Generic (PLEG): container finished" podID="95bba85d-3878-4515-a36a-05916e82829c" containerID="589d6ce1e41f72aaa06238af665ae31d984820aff07bd2a92356a5a885918928" exitCode=0 Jul 17 18:00:07.380414 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:07.380343 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ee229465-29738520-45nzf" event={"ID":"95bba85d-3878-4515-a36a-05916e82829c","Type":"ContainerDied","Data":"589d6ce1e41f72aaa06238af665ae31d984820aff07bd2a92356a5a885918928"} Jul 17 18:00:07.381728 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:07.381704 2557 generic.go:356] "Generic (PLEG): container finished" podID="df493131-0b3d-4f3e-a99a-54d34aa1fff3" containerID="e9d331cec7f21e6b3269558cbf575e595ffbdb7a34b5142da63c9f075bbbcfa0" exitCode=0 Jul 17 18:00:07.381847 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:07.381771 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-24f8a1bf-29738520-kl2m9" event={"ID":"df493131-0b3d-4f3e-a99a-54d34aa1fff3","Type":"ContainerDied","Data":"e9d331cec7f21e6b3269558cbf575e595ffbdb7a34b5142da63c9f075bbbcfa0"} Jul 17 18:00:07.383183 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:07.383161 2557 generic.go:356] "Generic (PLEG): container finished" podID="839a8041-0030-463f-94ec-fdeebe008251" containerID="88f6e6d3dc867d27e9e28e08104728d2fa1e0828290975c55a66f4836a33645e" exitCode=0 Jul 17 18:00:07.383296 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:07.383211 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-1d1f23e1-29738520-p5dvj" event={"ID":"839a8041-0030-463f-94ec-fdeebe008251","Type":"ContainerDied","Data":"88f6e6d3dc867d27e9e28e08104728d2fa1e0828290975c55a66f4836a33645e"} Jul 17 18:00:07.384619 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:07.384602 2557 generic.go:356] "Generic (PLEG): container finished" podID="a15751df-7903-413e-80b8-90b365f2584f" containerID="3350d8dc3426eb4752589b6713ee977311b95431cc06ba8b66f1545662ffbd2d" exitCode=0 Jul 17 18:00:07.384722 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:07.384632 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738520-xdckp" event={"ID":"a15751df-7903-413e-80b8-90b365f2584f","Type":"ContainerDied","Data":"3350d8dc3426eb4752589b6713ee977311b95431cc06ba8b66f1545662ffbd2d"} Jul 17 18:00:08.569898 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:08.569870 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-24f8a1bf-29738520-kl2m9" Jul 17 18:00:08.572952 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:08.572928 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-84841c77-29738520-p5gwd" Jul 17 18:00:08.651699 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:08.651617 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738520-xdckp" Jul 17 18:00:08.655012 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:08.654991 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-1d1f23e1-29738520-p5dvj" Jul 17 18:00:08.658390 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:08.658369 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ee229465-29738520-45nzf" Jul 17 18:00:09.396293 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:09.396266 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-24f8a1bf-29738520-kl2m9" Jul 17 18:00:09.396293 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:09.396271 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-24f8a1bf-29738520-kl2m9" event={"ID":"df493131-0b3d-4f3e-a99a-54d34aa1fff3","Type":"ContainerDied","Data":"89d3a1f787d72f0969fc03a89d8ba280ffb9ab0c7d2f752f5a69a8a44a31d251"} Jul 17 18:00:09.396512 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:09.396322 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89d3a1f787d72f0969fc03a89d8ba280ffb9ab0c7d2f752f5a69a8a44a31d251" Jul 17 18:00:09.397650 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:09.397627 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-1d1f23e1-29738520-p5dvj" Jul 17 18:00:09.397808 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:09.397703 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-1d1f23e1-29738520-p5dvj" event={"ID":"839a8041-0030-463f-94ec-fdeebe008251","Type":"ContainerDied","Data":"f9858d45c752c32cda4f87fce5f81ad8c666bf40e6dc03cea1dcc95760c9b9fd"} Jul 17 18:00:09.397808 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:09.397745 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9858d45c752c32cda4f87fce5f81ad8c666bf40e6dc03cea1dcc95760c9b9fd" Jul 17 18:00:09.399111 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:09.399092 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738520-xdckp" event={"ID":"a15751df-7903-413e-80b8-90b365f2584f","Type":"ContainerDied","Data":"8e6031b9ed2fc04776f32905a0b7a9db06c7ac3b4bfe2ae608cbf16c2b020d13"} Jul 17 18:00:09.399233 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:09.399116 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738520-xdckp" Jul 17 18:00:09.399233 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:09.399130 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e6031b9ed2fc04776f32905a0b7a9db06c7ac3b4bfe2ae608cbf16c2b020d13" Jul 17 18:00:09.400415 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:09.400390 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-84841c77-29738520-p5gwd" Jul 17 18:00:09.400528 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:09.400383 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-84841c77-29738520-p5gwd" event={"ID":"ff0d3bcb-10be-49ac-a40d-ef7753c52bcb","Type":"ContainerDied","Data":"407fdbee7237595a72915758bf80d376ae5d686d66acd8f3c39c90ffec2b54e8"} Jul 17 18:00:09.400528 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:09.400492 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="407fdbee7237595a72915758bf80d376ae5d686d66acd8f3c39c90ffec2b54e8" Jul 17 18:00:09.401825 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:09.401805 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ee229465-29738520-45nzf" event={"ID":"95bba85d-3878-4515-a36a-05916e82829c","Type":"ContainerDied","Data":"3c089c728a90e6ddbae62814fadc6c300399067ca01581afee3cd1d9e19e2293"} Jul 17 18:00:09.401934 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:09.401834 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ee229465-29738520-45nzf" Jul 17 18:00:09.401934 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:09.401841 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c089c728a90e6ddbae62814fadc6c300399067ca01581afee3cd1d9e19e2293" Jul 17 18:00:31.984761 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:31.984734 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 18:00:31.991837 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:00:31.991808 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 18:01:23.511562 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.511527 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc"] Jul 17 18:01:23.512076 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.512061 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff0d3bcb-10be-49ac-a40d-ef7753c52bcb" containerName="cleanup" Jul 17 18:01:23.512133 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.512080 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff0d3bcb-10be-49ac-a40d-ef7753c52bcb" containerName="cleanup" Jul 17 18:01:23.512133 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.512094 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df493131-0b3d-4f3e-a99a-54d34aa1fff3" containerName="cleanup" Jul 17 18:01:23.512133 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.512103 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="df493131-0b3d-4f3e-a99a-54d34aa1fff3" containerName="cleanup" Jul 17 18:01:23.512133 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.512120 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a15751df-7903-413e-80b8-90b365f2584f" containerName="cleanup" Jul 17 18:01:23.512133 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.512128 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a15751df-7903-413e-80b8-90b365f2584f" containerName="cleanup" Jul 17 18:01:23.512301 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.512149 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95bba85d-3878-4515-a36a-05916e82829c" containerName="cleanup" Jul 17 18:01:23.512301 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.512160 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="95bba85d-3878-4515-a36a-05916e82829c" containerName="cleanup" Jul 17 18:01:23.512301 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.512171 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="839a8041-0030-463f-94ec-fdeebe008251" containerName="cleanup" Jul 17 18:01:23.512301 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.512179 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="839a8041-0030-463f-94ec-fdeebe008251" containerName="cleanup" Jul 17 18:01:23.512301 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.512254 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="95bba85d-3878-4515-a36a-05916e82829c" containerName="cleanup" Jul 17 18:01:23.512301 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.512264 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="df493131-0b3d-4f3e-a99a-54d34aa1fff3" containerName="cleanup" Jul 17 18:01:23.512301 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.512277 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff0d3bcb-10be-49ac-a40d-ef7753c52bcb" containerName="cleanup" Jul 17 18:01:23.512301 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.512288 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="839a8041-0030-463f-94ec-fdeebe008251" containerName="cleanup" Jul 17 18:01:23.512550 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.512296 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a15751df-7903-413e-80b8-90b365f2584f" containerName="cleanup" Jul 17 18:01:23.515664 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.515643 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.518035 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.518015 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4355f0b1-openshift-default-dockercfg-dvgwv\"" Jul 17 18:01:23.526257 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.526233 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc"] Jul 17 18:01:23.598071 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.598037 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-token\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.598071 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.598073 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpc29\" (UniqueName: \"kubernetes.io/projected/a874bb7a-052f-4aca-aa33-62b6516c1d5a-kube-api-access-rpc29\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.598275 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.598205 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-workload-certs\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.598312 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.598276 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-envoy\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.598352 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.598327 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-workload-socket\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.598385 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.598369 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-credential-socket\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.598427 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.598392 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-podinfo\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.598470 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.598437 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-data\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.598470 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.598456 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istiod-ca-cert\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.699307 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.699270 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-workload-certs\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.699503 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.699319 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-envoy\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.699503 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.699350 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-workload-socket\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.699503 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.699368 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-credential-socket\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.699503 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.699384 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-podinfo\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.699503 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.699411 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-data\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.699503 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.699431 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istiod-ca-cert\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.699867 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.699836 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-workload-certs\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.699922 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.699877 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-credential-socket\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.699994 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.699467 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-token\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.699994 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.699958 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-data\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.699994 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.699977 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpc29\" (UniqueName: \"kubernetes.io/projected/a874bb7a-052f-4aca-aa33-62b6516c1d5a-kube-api-access-rpc29\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.700135 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.699998 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-workload-socket\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.700237 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.700215 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istiod-ca-cert\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.701966 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.701944 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-envoy\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.702197 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.702178 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-podinfo\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.707898 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.707873 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpc29\" (UniqueName: \"kubernetes.io/projected/a874bb7a-052f-4aca-aa33-62b6516c1d5a-kube-api-access-rpc29\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.707968 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.707947 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-token\") pod \"e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.827366 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.827276 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:23.979814 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.979781 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc"] Jul 17 18:01:23.981168 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:01:23.981146 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda874bb7a_052f_4aca_aa33_62b6516c1d5a.slice/crio-c1287660ce47f48ef4a94ba0c156245b86fceb266353e863a7a46f8b8a3c6636 WatchSource:0}: Error finding container c1287660ce47f48ef4a94ba0c156245b86fceb266353e863a7a46f8b8a3c6636: Status 404 returned error can't find the container with id c1287660ce47f48ef4a94ba0c156245b86fceb266353e863a7a46f8b8a3c6636 Jul 17 18:01:23.983513 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.983472 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:01:23.983581 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.983556 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:01:23.983625 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:23.983598 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:01:24.778456 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:24.778419 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" event={"ID":"a874bb7a-052f-4aca-aa33-62b6516c1d5a","Type":"ContainerStarted","Data":"ad429f827dd9c2516eb64454c38eef60ba98e014eb0815670e97e756e6d39f2e"} Jul 17 18:01:24.778972 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:24.778481 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" event={"ID":"a874bb7a-052f-4aca-aa33-62b6516c1d5a","Type":"ContainerStarted","Data":"c1287660ce47f48ef4a94ba0c156245b86fceb266353e863a7a46f8b8a3c6636"} Jul 17 18:01:24.811161 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:24.811115 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" podStartSLOduration=1.811099869 podStartE2EDuration="1.811099869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:01:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:01:24.809305656 +0000 UTC m=+1853.419975038" watchObservedRunningTime="2026-07-17 18:01:24.811099869 +0000 UTC m=+1853.421769250" Jul 17 18:01:24.827365 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:24.827339 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:25.833208 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:25.833174 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:26.788966 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:26.788934 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:26.790007 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:26.789986 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:39.861102 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:39.861066 2557 generic.go:356] "Generic (PLEG): container finished" podID="a874bb7a-052f-4aca-aa33-62b6516c1d5a" containerID="ad429f827dd9c2516eb64454c38eef60ba98e014eb0815670e97e756e6d39f2e" exitCode=0 Jul 17 18:01:39.861528 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:39.861140 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" event={"ID":"a874bb7a-052f-4aca-aa33-62b6516c1d5a","Type":"ContainerDied","Data":"ad429f827dd9c2516eb64454c38eef60ba98e014eb0815670e97e756e6d39f2e"} Jul 17 18:01:39.861528 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:39.861504 2557 scope.go:117] "RemoveContainer" containerID="ad429f827dd9c2516eb64454c38eef60ba98e014eb0815670e97e756e6d39f2e" Jul 17 18:01:39.862516 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:39.862487 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:01:39.862629 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:39.862555 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:01:39.862629 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:39.862599 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:01:40.867619 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:40.867588 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" event={"ID":"a874bb7a-052f-4aca-aa33-62b6516c1d5a","Type":"ContainerStarted","Data":"1a066fe5153f50eb8a18f6b89666c6cc91ab6c6a7c1e8eae83406a11b6f41c3b"} Jul 17 18:01:41.789191 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:41.789145 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:41.827698 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:41.827641 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:41.828726 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:41.828699 2557 patch_prober.go:28] interesting pod/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 17 18:01:41.828848 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:41.828762 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" podUID="a874bb7a-052f-4aca-aa33-62b6516c1d5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 17 18:01:42.828167 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:42.828125 2557 patch_prober.go:28] interesting pod/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 17 18:01:42.828544 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:42.828187 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" podUID="a874bb7a-052f-4aca-aa33-62b6516c1d5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 17 18:01:43.828520 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:43.828478 2557 patch_prober.go:28] interesting pod/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 17 18:01:43.828948 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:43.828543 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" podUID="a874bb7a-052f-4aca-aa33-62b6516c1d5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 17 18:01:44.832536 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:44.832502 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:44.833691 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:44.833634 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:45.171392 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:45.171352 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc"] Jul 17 18:01:45.900064 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:45.900024 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" podUID="a874bb7a-052f-4aca-aa33-62b6516c1d5a" containerName="istio-proxy" containerID="cri-o://1a066fe5153f50eb8a18f6b89666c6cc91ab6c6a7c1e8eae83406a11b6f41c3b" gracePeriod=30 Jul 17 18:01:51.159937 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.159913 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:51.261664 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.261570 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-workload-certs\") pod \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " Jul 17 18:01:51.261664 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.261628 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-podinfo\") pod \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " Jul 17 18:01:51.261914 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.261725 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-workload-socket\") pod \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " Jul 17 18:01:51.261914 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.261755 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istiod-ca-cert\") pod \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " Jul 17 18:01:51.261914 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.261788 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpc29\" (UniqueName: \"kubernetes.io/projected/a874bb7a-052f-4aca-aa33-62b6516c1d5a-kube-api-access-rpc29\") pod \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " Jul 17 18:01:51.261914 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.261823 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-token\") pod \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " Jul 17 18:01:51.261914 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.261848 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-envoy\") pod \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " Jul 17 18:01:51.261914 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.261871 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-credential-socket\") pod \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " Jul 17 18:01:51.261914 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.261895 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a874bb7a-052f-4aca-aa33-62b6516c1d5a" (UID: "a874bb7a-052f-4aca-aa33-62b6516c1d5a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:01:51.262276 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.261908 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-data\") pod \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\" (UID: \"a874bb7a-052f-4aca-aa33-62b6516c1d5a\") " Jul 17 18:01:51.262276 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.262105 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a874bb7a-052f-4aca-aa33-62b6516c1d5a" (UID: "a874bb7a-052f-4aca-aa33-62b6516c1d5a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:01:51.262376 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.262327 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a874bb7a-052f-4aca-aa33-62b6516c1d5a" (UID: "a874bb7a-052f-4aca-aa33-62b6516c1d5a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:01:51.262428 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.262412 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-credential-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:01:51.262483 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.262422 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a874bb7a-052f-4aca-aa33-62b6516c1d5a" (UID: "a874bb7a-052f-4aca-aa33-62b6516c1d5a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:01:51.262483 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.262433 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-workload-certs\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:01:51.262483 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.262448 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-workload-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:01:51.262809 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.262788 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-data" (OuterVolumeSpecName: "istio-data") pod "a874bb7a-052f-4aca-aa33-62b6516c1d5a" (UID: "a874bb7a-052f-4aca-aa33-62b6516c1d5a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:01:51.264077 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.264054 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a874bb7a-052f-4aca-aa33-62b6516c1d5a-kube-api-access-rpc29" (OuterVolumeSpecName: "kube-api-access-rpc29") pod "a874bb7a-052f-4aca-aa33-62b6516c1d5a" (UID: "a874bb7a-052f-4aca-aa33-62b6516c1d5a"). InnerVolumeSpecName "kube-api-access-rpc29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:01:51.264180 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.264117 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-token" (OuterVolumeSpecName: "istio-token") pod "a874bb7a-052f-4aca-aa33-62b6516c1d5a" (UID: "a874bb7a-052f-4aca-aa33-62b6516c1d5a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:01:51.264301 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.264284 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a874bb7a-052f-4aca-aa33-62b6516c1d5a" (UID: "a874bb7a-052f-4aca-aa33-62b6516c1d5a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:01:51.264363 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.264297 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a874bb7a-052f-4aca-aa33-62b6516c1d5a" (UID: "a874bb7a-052f-4aca-aa33-62b6516c1d5a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:01:51.363729 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.363668 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-podinfo\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:01:51.363729 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.363723 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istiod-ca-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:01:51.363729 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.363736 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpc29\" (UniqueName: \"kubernetes.io/projected/a874bb7a-052f-4aca-aa33-62b6516c1d5a-kube-api-access-rpc29\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:01:51.363966 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.363745 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-token\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:01:51.363966 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.363754 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-envoy\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:01:51.363966 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.363762 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a874bb7a-052f-4aca-aa33-62b6516c1d5a-istio-data\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:01:51.929019 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.928982 2557 generic.go:356] "Generic (PLEG): container finished" podID="a874bb7a-052f-4aca-aa33-62b6516c1d5a" containerID="1a066fe5153f50eb8a18f6b89666c6cc91ab6c6a7c1e8eae83406a11b6f41c3b" exitCode=0 Jul 17 18:01:51.929182 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.929037 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" Jul 17 18:01:51.929182 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.929034 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" event={"ID":"a874bb7a-052f-4aca-aa33-62b6516c1d5a","Type":"ContainerDied","Data":"1a066fe5153f50eb8a18f6b89666c6cc91ab6c6a7c1e8eae83406a11b6f41c3b"} Jul 17 18:01:51.929182 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.929104 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc" event={"ID":"a874bb7a-052f-4aca-aa33-62b6516c1d5a","Type":"ContainerDied","Data":"c1287660ce47f48ef4a94ba0c156245b86fceb266353e863a7a46f8b8a3c6636"} Jul 17 18:01:51.929182 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.929135 2557 scope.go:117] "RemoveContainer" containerID="1a066fe5153f50eb8a18f6b89666c6cc91ab6c6a7c1e8eae83406a11b6f41c3b" Jul 17 18:01:51.938107 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.938077 2557 scope.go:117] "RemoveContainer" containerID="ad429f827dd9c2516eb64454c38eef60ba98e014eb0815670e97e756e6d39f2e" Jul 17 18:01:51.946212 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.946191 2557 scope.go:117] "RemoveContainer" containerID="1a066fe5153f50eb8a18f6b89666c6cc91ab6c6a7c1e8eae83406a11b6f41c3b" Jul 17 18:01:51.946472 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:01:51.946453 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a066fe5153f50eb8a18f6b89666c6cc91ab6c6a7c1e8eae83406a11b6f41c3b\": container with ID starting with 1a066fe5153f50eb8a18f6b89666c6cc91ab6c6a7c1e8eae83406a11b6f41c3b not found: ID does not exist" containerID="1a066fe5153f50eb8a18f6b89666c6cc91ab6c6a7c1e8eae83406a11b6f41c3b" Jul 17 18:01:51.946534 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.946480 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a066fe5153f50eb8a18f6b89666c6cc91ab6c6a7c1e8eae83406a11b6f41c3b"} err="failed to get container status \"1a066fe5153f50eb8a18f6b89666c6cc91ab6c6a7c1e8eae83406a11b6f41c3b\": rpc error: code = NotFound desc = could not find container \"1a066fe5153f50eb8a18f6b89666c6cc91ab6c6a7c1e8eae83406a11b6f41c3b\": container with ID starting with 1a066fe5153f50eb8a18f6b89666c6cc91ab6c6a7c1e8eae83406a11b6f41c3b not found: ID does not exist" Jul 17 18:01:51.946534 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.946499 2557 scope.go:117] "RemoveContainer" containerID="ad429f827dd9c2516eb64454c38eef60ba98e014eb0815670e97e756e6d39f2e" Jul 17 18:01:51.946757 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:01:51.946739 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad429f827dd9c2516eb64454c38eef60ba98e014eb0815670e97e756e6d39f2e\": container with ID starting with ad429f827dd9c2516eb64454c38eef60ba98e014eb0815670e97e756e6d39f2e not found: ID does not exist" containerID="ad429f827dd9c2516eb64454c38eef60ba98e014eb0815670e97e756e6d39f2e" Jul 17 18:01:51.946811 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.946760 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad429f827dd9c2516eb64454c38eef60ba98e014eb0815670e97e756e6d39f2e"} err="failed to get container status \"ad429f827dd9c2516eb64454c38eef60ba98e014eb0815670e97e756e6d39f2e\": rpc error: code = NotFound desc = could not find container \"ad429f827dd9c2516eb64454c38eef60ba98e014eb0815670e97e756e6d39f2e\": container with ID starting with ad429f827dd9c2516eb64454c38eef60ba98e014eb0815670e97e756e6d39f2e not found: ID does not exist" Jul 17 18:01:51.946905 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.946889 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc"] Jul 17 18:01:51.951332 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:51.951312 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4355f0b1-openshift-default-776cd9b66c-ncvmc"] Jul 17 18:01:53.878507 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:01:53.878473 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a874bb7a-052f-4aca-aa33-62b6516c1d5a" path="/var/lib/kubelet/pods/a874bb7a-052f-4aca-aa33-62b6516c1d5a/volumes" Jul 17 18:02:05.466608 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.466575 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf"] Jul 17 18:02:05.467027 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.467013 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a874bb7a-052f-4aca-aa33-62b6516c1d5a" containerName="istio-proxy" Jul 17 18:02:05.467027 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.467028 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a874bb7a-052f-4aca-aa33-62b6516c1d5a" containerName="istio-proxy" Jul 17 18:02:05.467111 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.467101 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a874bb7a-052f-4aca-aa33-62b6516c1d5a" containerName="istio-proxy" Jul 17 18:02:05.467146 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.467116 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a874bb7a-052f-4aca-aa33-62b6516c1d5a" containerName="istio-proxy" Jul 17 18:02:05.470063 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.470040 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.473745 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.473711 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7548b62e-openshift-default-dockercfg-hgdz6\"" Jul 17 18:02:05.491006 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.490956 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-data\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.491006 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.490997 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-podinfo\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.491211 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.491114 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8c12654-aa5a-4bbd-89a7-488744948b82-istiod-ca-cert\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.491211 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.491176 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-credential-socket\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.491305 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.491225 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-workload-certs\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.491305 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.491260 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-envoy\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.491386 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.491335 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-token\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.491422 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.491386 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-workload-socket\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.491422 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.491404 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rh7n\" (UniqueName: \"kubernetes.io/projected/c8c12654-aa5a-4bbd-89a7-488744948b82-kube-api-access-8rh7n\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.492207 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.492187 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf"] Jul 17 18:02:05.591988 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.591951 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-token\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.592238 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.592017 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-workload-socket\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.592238 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.592049 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rh7n\" (UniqueName: \"kubernetes.io/projected/c8c12654-aa5a-4bbd-89a7-488744948b82-kube-api-access-8rh7n\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.592238 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.592094 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-data\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.592238 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.592124 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-podinfo\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.592238 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.592193 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8c12654-aa5a-4bbd-89a7-488744948b82-istiod-ca-cert\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.592547 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.592253 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-credential-socket\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.592547 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.592452 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-workload-certs\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.592718 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.592662 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-credential-socket\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.592909 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.592814 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-workload-certs\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.592909 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.592845 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-workload-socket\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.592909 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.592859 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-envoy\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.592909 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.592878 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-data\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.593393 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.593370 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8c12654-aa5a-4bbd-89a7-488744948b82-istiod-ca-cert\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.595027 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.595007 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-podinfo\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.595582 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.595563 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-envoy\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.602366 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.602343 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-token\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.602547 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.602522 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rh7n\" (UniqueName: \"kubernetes.io/projected/c8c12654-aa5a-4bbd-89a7-488744948b82-kube-api-access-8rh7n\") pod \"e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.780868 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.780753 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:05.918049 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.918022 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf"] Jul 17 18:02:05.919748 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:02:05.919722 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c12654_aa5a_4bbd_89a7_488744948b82.slice/crio-f824ef415a8dd6343bc403b90eb5170539be615ec7384b08de9df9221b5eaeb4 WatchSource:0}: Error finding container f824ef415a8dd6343bc403b90eb5170539be615ec7384b08de9df9221b5eaeb4: Status 404 returned error can't find the container with id f824ef415a8dd6343bc403b90eb5170539be615ec7384b08de9df9221b5eaeb4 Jul 17 18:02:05.921933 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.921903 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:02:05.922009 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.921962 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:02:05.922009 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:05.921991 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:02:06.000043 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:06.000000 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" event={"ID":"c8c12654-aa5a-4bbd-89a7-488744948b82","Type":"ContainerStarted","Data":"f6da450ece6ee469ece0c42c5533c9ab205c1a6a8c0ec7ac5223f467955bfec8"} Jul 17 18:02:06.000187 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:06.000051 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" event={"ID":"c8c12654-aa5a-4bbd-89a7-488744948b82","Type":"ContainerStarted","Data":"f824ef415a8dd6343bc403b90eb5170539be615ec7384b08de9df9221b5eaeb4"} Jul 17 18:02:06.024139 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:06.024078 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" podStartSLOduration=1.024061479 podStartE2EDuration="1.024061479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:02:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:02:06.022826807 +0000 UTC m=+1894.633496190" watchObservedRunningTime="2026-07-17 18:02:06.024061479 +0000 UTC m=+1894.634730861" Jul 17 18:02:06.781520 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:06.781478 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:06.786445 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:06.786414 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:07.004751 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.004717 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:07.005652 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.005631 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:07.261673 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.261636 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg"] Jul 17 18:02:07.262231 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.262213 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a874bb7a-052f-4aca-aa33-62b6516c1d5a" containerName="istio-proxy" Jul 17 18:02:07.262277 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.262235 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a874bb7a-052f-4aca-aa33-62b6516c1d5a" containerName="istio-proxy" Jul 17 18:02:07.265944 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.265917 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" Jul 17 18:02:07.268453 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.268433 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7548b62e-serving-cert\"" Jul 17 18:02:07.268712 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.268536 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mct5m\"" Jul 17 18:02:07.268832 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.268622 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 17 18:02:07.268942 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.268926 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 17 18:02:07.276603 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.276579 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg"] Jul 17 18:02:07.310087 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.310055 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vlrj\" (UniqueName: \"kubernetes.io/projected/9f146bb0-cc29-438d-9d30-fd688c38213d-kube-api-access-7vlrj\") pod \"maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg\" (UID: \"9f146bb0-cc29-438d-9d30-fd688c38213d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" Jul 17 18:02:07.310236 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.310177 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f146bb0-cc29-438d-9d30-fd688c38213d-maas-api-tls\") pod \"maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg\" (UID: \"9f146bb0-cc29-438d-9d30-fd688c38213d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" Jul 17 18:02:07.310236 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.310226 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f146bb0-cc29-438d-9d30-fd688c38213d-openshift-service-ca\") pod \"maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg\" (UID: \"9f146bb0-cc29-438d-9d30-fd688c38213d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" Jul 17 18:02:07.411760 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.411717 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vlrj\" (UniqueName: \"kubernetes.io/projected/9f146bb0-cc29-438d-9d30-fd688c38213d-kube-api-access-7vlrj\") pod \"maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg\" (UID: \"9f146bb0-cc29-438d-9d30-fd688c38213d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" Jul 17 18:02:07.411914 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.411850 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f146bb0-cc29-438d-9d30-fd688c38213d-maas-api-tls\") pod \"maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg\" (UID: \"9f146bb0-cc29-438d-9d30-fd688c38213d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" Jul 17 18:02:07.411914 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.411898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f146bb0-cc29-438d-9d30-fd688c38213d-openshift-service-ca\") pod \"maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg\" (UID: \"9f146bb0-cc29-438d-9d30-fd688c38213d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" Jul 17 18:02:07.412003 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:02:07.411986 2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-serving-cert: secret "maas-api-e2e-mt-7548b62e-serving-cert" not found Jul 17 18:02:07.412100 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:02:07.412088 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f146bb0-cc29-438d-9d30-fd688c38213d-maas-api-tls podName:9f146bb0-cc29-438d-9d30-fd688c38213d nodeName:}" failed. No retries permitted until 2026-07-17 18:02:07.912070315 +0000 UTC m=+1896.522739682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9f146bb0-cc29-438d-9d30-fd688c38213d-maas-api-tls") pod "maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" (UID: "9f146bb0-cc29-438d-9d30-fd688c38213d") : secret "maas-api-e2e-mt-7548b62e-serving-cert" not found Jul 17 18:02:07.412663 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.412644 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f146bb0-cc29-438d-9d30-fd688c38213d-openshift-service-ca\") pod \"maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg\" (UID: \"9f146bb0-cc29-438d-9d30-fd688c38213d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" Jul 17 18:02:07.420299 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.420269 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vlrj\" (UniqueName: \"kubernetes.io/projected/9f146bb0-cc29-438d-9d30-fd688c38213d-kube-api-access-7vlrj\") pod \"maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg\" (UID: \"9f146bb0-cc29-438d-9d30-fd688c38213d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" Jul 17 18:02:07.917048 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.917016 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f146bb0-cc29-438d-9d30-fd688c38213d-maas-api-tls\") pod \"maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg\" (UID: \"9f146bb0-cc29-438d-9d30-fd688c38213d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" Jul 17 18:02:07.919423 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:07.919402 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f146bb0-cc29-438d-9d30-fd688c38213d-maas-api-tls\") pod \"maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg\" (UID: \"9f146bb0-cc29-438d-9d30-fd688c38213d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" Jul 17 18:02:08.180733 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:08.180613 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" Jul 17 18:02:08.313961 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:08.313882 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg"] Jul 17 18:02:08.315714 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:02:08.315672 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f146bb0_cc29_438d_9d30_fd688c38213d.slice/crio-a8e9f99ef9d2379e86e7b5ee122f6cc33184c1e399a2dc1a95e16ceaf25b00e7 WatchSource:0}: Error finding container a8e9f99ef9d2379e86e7b5ee122f6cc33184c1e399a2dc1a95e16ceaf25b00e7: Status 404 returned error can't find the container with id a8e9f99ef9d2379e86e7b5ee122f6cc33184c1e399a2dc1a95e16ceaf25b00e7 Jul 17 18:02:09.016961 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:09.016926 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" event={"ID":"9f146bb0-cc29-438d-9d30-fd688c38213d","Type":"ContainerStarted","Data":"a8e9f99ef9d2379e86e7b5ee122f6cc33184c1e399a2dc1a95e16ceaf25b00e7"} Jul 17 18:02:11.028776 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:11.028671 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" event={"ID":"9f146bb0-cc29-438d-9d30-fd688c38213d","Type":"ContainerStarted","Data":"e97e86e6db2747a4150d870a1dbeb607fc92794e006d1e1bdf0a428a6f58e4c5"} Jul 17 18:02:11.029137 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:11.028816 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" Jul 17 18:02:11.047061 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:11.047017 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" podStartSLOduration=1.6258518180000001 podStartE2EDuration="4.046998683s" totalImagesPullingTime="2.421146865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:02:11.04617857 +0000 UTC m=+1899.656847953" watchObservedRunningTime="2026-07-17 18:02:11.046998683 +0000 UTC m=+1899.657668062" Jul 17 18:02:17.038534 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:17.038495 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg" Jul 17 18:02:22.915393 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:22.913770 2557 patch_prober.go:28] interesting pod/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:36384->10.132.0.53:15021: read: connection reset by peer" start-of-body= Jul 17 18:02:22.915393 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:22.913842 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" podUID="c8c12654-aa5a-4bbd-89a7-488744948b82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:36384->10.132.0.53:15021: read: connection reset by peer" Jul 17 18:02:23.088591 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:23.088557 2557 generic.go:356] "Generic (PLEG): container finished" podID="c8c12654-aa5a-4bbd-89a7-488744948b82" containerID="f6da450ece6ee469ece0c42c5533c9ab205c1a6a8c0ec7ac5223f467955bfec8" exitCode=0 Jul 17 18:02:23.088801 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:23.088630 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" event={"ID":"c8c12654-aa5a-4bbd-89a7-488744948b82","Type":"ContainerDied","Data":"f6da450ece6ee469ece0c42c5533c9ab205c1a6a8c0ec7ac5223f467955bfec8"} Jul 17 18:02:23.089128 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:23.089109 2557 scope.go:117] "RemoveContainer" containerID="f6da450ece6ee469ece0c42c5533c9ab205c1a6a8c0ec7ac5223f467955bfec8" Jul 17 18:02:23.090178 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:23.090146 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:02:23.090253 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:23.090220 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:02:23.090294 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:23.090277 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:02:24.110168 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:24.110127 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" event={"ID":"c8c12654-aa5a-4bbd-89a7-488744948b82","Type":"ContainerStarted","Data":"eb31f5bba1a315435ee847b947ad100282572ce8afdc1fdff99a9d4441e6d808"} Jul 17 18:02:24.781417 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:24.781374 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:24.781622 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:24.781503 2557 patch_prober.go:28] interesting pod/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 17 18:02:24.781622 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:24.781546 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" podUID="c8c12654-aa5a-4bbd-89a7-488744948b82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 17 18:02:25.782149 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:25.782105 2557 patch_prober.go:28] interesting pod/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 17 18:02:25.782699 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:25.782194 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" podUID="c8c12654-aa5a-4bbd-89a7-488744948b82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 17 18:02:26.781617 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:26.781576 2557 patch_prober.go:28] interesting pod/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 17 18:02:26.781964 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:26.781929 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" podUID="c8c12654-aa5a-4bbd-89a7-488744948b82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 17 18:02:27.781156 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:27.781113 2557 patch_prober.go:28] interesting pod/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 17 18:02:27.781644 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:27.781179 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" podUID="c8c12654-aa5a-4bbd-89a7-488744948b82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 17 18:02:28.784884 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:28.784852 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:28.785348 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:28.785262 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:02:28.785891 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:02:28.785871 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:05:32.017254 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:05:32.017225 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 18:05:32.024697 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:05:32.024649 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 18:06:45.402480 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:45.402444 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf"] Jul 17 18:06:45.402956 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:45.402649 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" podUID="c8c12654-aa5a-4bbd-89a7-488744948b82" containerName="istio-proxy" containerID="cri-o://eb31f5bba1a315435ee847b947ad100282572ce8afdc1fdff99a9d4441e6d808" gracePeriod=30 Jul 17 18:06:50.660112 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.660079 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:06:50.742573 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.742471 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-podinfo\") pod \"c8c12654-aa5a-4bbd-89a7-488744948b82\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " Jul 17 18:06:50.742573 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.742516 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rh7n\" (UniqueName: \"kubernetes.io/projected/c8c12654-aa5a-4bbd-89a7-488744948b82-kube-api-access-8rh7n\") pod \"c8c12654-aa5a-4bbd-89a7-488744948b82\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " Jul 17 18:06:50.742573 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.742539 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8c12654-aa5a-4bbd-89a7-488744948b82-istiod-ca-cert\") pod \"c8c12654-aa5a-4bbd-89a7-488744948b82\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " Jul 17 18:06:50.742573 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.742559 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-credential-socket\") pod \"c8c12654-aa5a-4bbd-89a7-488744948b82\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " Jul 17 18:06:50.742926 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.742702 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-data\") pod \"c8c12654-aa5a-4bbd-89a7-488744948b82\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " Jul 17 18:06:50.742926 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.742757 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-workload-certs\") pod \"c8c12654-aa5a-4bbd-89a7-488744948b82\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " Jul 17 18:06:50.742926 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.742836 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-workload-socket\") pod \"c8c12654-aa5a-4bbd-89a7-488744948b82\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " Jul 17 18:06:50.742926 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.742867 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-token\") pod \"c8c12654-aa5a-4bbd-89a7-488744948b82\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " Jul 17 18:06:50.742926 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.742897 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-envoy\") pod \"c8c12654-aa5a-4bbd-89a7-488744948b82\" (UID: \"c8c12654-aa5a-4bbd-89a7-488744948b82\") " Jul 17 18:06:50.743180 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.743034 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c8c12654-aa5a-4bbd-89a7-488744948b82" (UID: "c8c12654-aa5a-4bbd-89a7-488744948b82"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:06:50.743180 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.743092 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c8c12654-aa5a-4bbd-89a7-488744948b82" (UID: "c8c12654-aa5a-4bbd-89a7-488744948b82"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:06:50.743180 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.743138 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8c12654-aa5a-4bbd-89a7-488744948b82-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c8c12654-aa5a-4bbd-89a7-488744948b82" (UID: "c8c12654-aa5a-4bbd-89a7-488744948b82"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:06:50.743180 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.743170 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c8c12654-aa5a-4bbd-89a7-488744948b82" (UID: "c8c12654-aa5a-4bbd-89a7-488744948b82"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:06:50.743388 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.743336 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-workload-certs\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:06:50.743388 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.743353 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-workload-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:06:50.743388 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.743365 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8c12654-aa5a-4bbd-89a7-488744948b82-istiod-ca-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:06:50.743388 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.743377 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-credential-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:06:50.743617 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.743577 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-data" (OuterVolumeSpecName: "istio-data") pod "c8c12654-aa5a-4bbd-89a7-488744948b82" (UID: "c8c12654-aa5a-4bbd-89a7-488744948b82"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:06:50.745040 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.745009 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c8c12654-aa5a-4bbd-89a7-488744948b82" (UID: "c8c12654-aa5a-4bbd-89a7-488744948b82"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:06:50.745040 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.745033 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8c12654-aa5a-4bbd-89a7-488744948b82-kube-api-access-8rh7n" (OuterVolumeSpecName: "kube-api-access-8rh7n") pod "c8c12654-aa5a-4bbd-89a7-488744948b82" (UID: "c8c12654-aa5a-4bbd-89a7-488744948b82"). InnerVolumeSpecName "kube-api-access-8rh7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:06:50.745214 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.745080 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-token" (OuterVolumeSpecName: "istio-token") pod "c8c12654-aa5a-4bbd-89a7-488744948b82" (UID: "c8c12654-aa5a-4bbd-89a7-488744948b82"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:06:50.745214 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.745101 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c8c12654-aa5a-4bbd-89a7-488744948b82" (UID: "c8c12654-aa5a-4bbd-89a7-488744948b82"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:06:50.844363 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.844322 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-podinfo\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:06:50.844363 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.844357 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rh7n\" (UniqueName: \"kubernetes.io/projected/c8c12654-aa5a-4bbd-89a7-488744948b82-kube-api-access-8rh7n\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:06:50.844363 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.844368 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-data\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:06:50.844601 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.844376 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-token\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:06:50.844601 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:50.844384 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8c12654-aa5a-4bbd-89a7-488744948b82-istio-envoy\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:06:51.458561 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:51.458526 2557 generic.go:356] "Generic (PLEG): container finished" podID="c8c12654-aa5a-4bbd-89a7-488744948b82" containerID="eb31f5bba1a315435ee847b947ad100282572ce8afdc1fdff99a9d4441e6d808" exitCode=0 Jul 17 18:06:51.458769 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:51.458574 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" Jul 17 18:06:51.458769 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:51.458605 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" event={"ID":"c8c12654-aa5a-4bbd-89a7-488744948b82","Type":"ContainerDied","Data":"eb31f5bba1a315435ee847b947ad100282572ce8afdc1fdff99a9d4441e6d808"} Jul 17 18:06:51.458769 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:51.458656 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf" event={"ID":"c8c12654-aa5a-4bbd-89a7-488744948b82","Type":"ContainerDied","Data":"f824ef415a8dd6343bc403b90eb5170539be615ec7384b08de9df9221b5eaeb4"} Jul 17 18:06:51.458769 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:51.458702 2557 scope.go:117] "RemoveContainer" containerID="eb31f5bba1a315435ee847b947ad100282572ce8afdc1fdff99a9d4441e6d808" Jul 17 18:06:51.467955 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:51.467937 2557 scope.go:117] "RemoveContainer" containerID="f6da450ece6ee469ece0c42c5533c9ab205c1a6a8c0ec7ac5223f467955bfec8" Jul 17 18:06:51.475959 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:51.475942 2557 scope.go:117] "RemoveContainer" containerID="eb31f5bba1a315435ee847b947ad100282572ce8afdc1fdff99a9d4441e6d808" Jul 17 18:06:51.476213 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:06:51.476198 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb31f5bba1a315435ee847b947ad100282572ce8afdc1fdff99a9d4441e6d808\": container with ID starting with eb31f5bba1a315435ee847b947ad100282572ce8afdc1fdff99a9d4441e6d808 not found: ID does not exist" containerID="eb31f5bba1a315435ee847b947ad100282572ce8afdc1fdff99a9d4441e6d808" Jul 17 18:06:51.476257 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:51.476221 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb31f5bba1a315435ee847b947ad100282572ce8afdc1fdff99a9d4441e6d808"} err="failed to get container status \"eb31f5bba1a315435ee847b947ad100282572ce8afdc1fdff99a9d4441e6d808\": rpc error: code = NotFound desc = could not find container \"eb31f5bba1a315435ee847b947ad100282572ce8afdc1fdff99a9d4441e6d808\": container with ID starting with eb31f5bba1a315435ee847b947ad100282572ce8afdc1fdff99a9d4441e6d808 not found: ID does not exist" Jul 17 18:06:51.476257 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:51.476236 2557 scope.go:117] "RemoveContainer" containerID="f6da450ece6ee469ece0c42c5533c9ab205c1a6a8c0ec7ac5223f467955bfec8" Jul 17 18:06:51.476449 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:06:51.476433 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6da450ece6ee469ece0c42c5533c9ab205c1a6a8c0ec7ac5223f467955bfec8\": container with ID starting with f6da450ece6ee469ece0c42c5533c9ab205c1a6a8c0ec7ac5223f467955bfec8 not found: ID does not exist" containerID="f6da450ece6ee469ece0c42c5533c9ab205c1a6a8c0ec7ac5223f467955bfec8" Jul 17 18:06:51.476492 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:51.476454 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6da450ece6ee469ece0c42c5533c9ab205c1a6a8c0ec7ac5223f467955bfec8"} err="failed to get container status \"f6da450ece6ee469ece0c42c5533c9ab205c1a6a8c0ec7ac5223f467955bfec8\": rpc error: code = NotFound desc = could not find container \"f6da450ece6ee469ece0c42c5533c9ab205c1a6a8c0ec7ac5223f467955bfec8\": container with ID starting with f6da450ece6ee469ece0c42c5533c9ab205c1a6a8c0ec7ac5223f467955bfec8 not found: ID does not exist" Jul 17 18:06:51.496840 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:51.496817 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf"] Jul 17 18:06:51.498672 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:51.498654 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7548b62e-openshift-default-65b8946475-kwmzf"] Jul 17 18:06:51.878606 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:06:51.878573 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8c12654-aa5a-4bbd-89a7-488744948b82" path="/var/lib/kubelet/pods/c8c12654-aa5a-4bbd-89a7-488744948b82/volumes" Jul 17 18:07:42.482272 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.482237 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr"] Jul 17 18:07:42.482824 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.482807 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8c12654-aa5a-4bbd-89a7-488744948b82" containerName="istio-proxy" Jul 17 18:07:42.482889 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.482826 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8c12654-aa5a-4bbd-89a7-488744948b82" containerName="istio-proxy" Jul 17 18:07:42.482889 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.482845 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8c12654-aa5a-4bbd-89a7-488744948b82" containerName="istio-proxy" Jul 17 18:07:42.482889 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.482854 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8c12654-aa5a-4bbd-89a7-488744948b82" containerName="istio-proxy" Jul 17 18:07:42.483015 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.482934 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8c12654-aa5a-4bbd-89a7-488744948b82" containerName="istio-proxy" Jul 17 18:07:42.486422 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.486401 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.489643 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.489621 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-72cf7b-openshift-default-dockercfg-sz2jf\"" Jul 17 18:07:42.511729 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.511699 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr"] Jul 17 18:07:42.608857 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.608820 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-credential-socket\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.608857 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.608860 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-workload-certs\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.609105 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.608883 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-workload-socket\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.609105 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.608898 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n85zs\" (UniqueName: \"kubernetes.io/projected/f4ce5b62-f910-4483-8bac-0c949c89437e-kube-api-access-n85zs\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.609105 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.609004 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-token\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.609105 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.609044 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4ce5b62-f910-4483-8bac-0c949c89437e-istiod-ca-cert\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.609267 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.609111 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-data\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.609267 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.609133 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-envoy\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.609267 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.609190 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-podinfo\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.709919 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.709877 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-data\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.710118 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.709927 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-envoy\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.710118 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.710044 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-podinfo\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.710118 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.710107 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-credential-socket\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.710295 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.710132 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-workload-certs\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.710295 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.710162 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-workload-socket\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.710295 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.710188 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n85zs\" (UniqueName: \"kubernetes.io/projected/f4ce5b62-f910-4483-8bac-0c949c89437e-kube-api-access-n85zs\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.710460 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.710309 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-data\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.710515 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.710473 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-credential-socket\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.710515 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.710498 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-workload-certs\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.710614 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.710521 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-workload-socket\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.710711 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.710662 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-token\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.710776 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.710722 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4ce5b62-f910-4483-8bac-0c949c89437e-istiod-ca-cert\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.711284 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.711262 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4ce5b62-f910-4483-8bac-0c949c89437e-istiod-ca-cert\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.712345 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.712317 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-envoy\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.712494 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.712476 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-podinfo\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.724296 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.724270 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-token\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.725396 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.725377 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n85zs\" (UniqueName: \"kubernetes.io/projected/f4ce5b62-f910-4483-8bac-0c949c89437e-kube-api-access-n85zs\") pod \"e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.799350 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.799266 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:42.944754 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.944689 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr"] Jul 17 18:07:42.947164 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:07:42.947131 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ce5b62_f910_4483_8bac_0c949c89437e.slice/crio-736b57d002293c66fc85ca9db2a672988f672f8da05ab394775bbf069ad5be2a WatchSource:0}: Error finding container 736b57d002293c66fc85ca9db2a672988f672f8da05ab394775bbf069ad5be2a: Status 404 returned error can't find the container with id 736b57d002293c66fc85ca9db2a672988f672f8da05ab394775bbf069ad5be2a Jul 17 18:07:42.949343 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.949310 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:07:42.949404 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.949376 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:07:42.949444 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:42.949403 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:07:43.725232 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:43.725194 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" event={"ID":"f4ce5b62-f910-4483-8bac-0c949c89437e","Type":"ContainerStarted","Data":"de08b3ae4f25f59df6413551cb78c380c170eacaeb8bf1ca791718b6c665fdf2"} Jul 17 18:07:43.725564 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:43.725247 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" event={"ID":"f4ce5b62-f910-4483-8bac-0c949c89437e","Type":"ContainerStarted","Data":"736b57d002293c66fc85ca9db2a672988f672f8da05ab394775bbf069ad5be2a"} Jul 17 18:07:43.756083 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:43.756016 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" podStartSLOduration=1.7559966089999999 podStartE2EDuration="1.755996609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:07:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:07:43.754531563 +0000 UTC m=+2232.365200945" watchObservedRunningTime="2026-07-17 18:07:43.755996609 +0000 UTC m=+2232.366665999" Jul 17 18:07:43.799847 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:43.799813 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:44.805087 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:44.805051 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:45.055648 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.055563 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q"] Jul 17 18:07:45.056147 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.056126 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8c12654-aa5a-4bbd-89a7-488744948b82" containerName="istio-proxy" Jul 17 18:07:45.059427 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.059408 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" Jul 17 18:07:45.062006 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.061985 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-72cf7b-serving-cert\"" Jul 17 18:07:45.086468 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.086438 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q"] Jul 17 18:07:45.239378 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.239350 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eea9ecc9-7ece-41c2-8551-80f81c7e7fdb-maas-api-tls\") pod \"maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q\" (UID: \"eea9ecc9-7ece-41c2-8551-80f81c7e7fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" Jul 17 18:07:45.239553 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.239417 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea9ecc9-7ece-41c2-8551-80f81c7e7fdb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q\" (UID: \"eea9ecc9-7ece-41c2-8551-80f81c7e7fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" Jul 17 18:07:45.239553 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.239454 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg998\" (UniqueName: \"kubernetes.io/projected/eea9ecc9-7ece-41c2-8551-80f81c7e7fdb-kube-api-access-dg998\") pod \"maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q\" (UID: \"eea9ecc9-7ece-41c2-8551-80f81c7e7fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" Jul 17 18:07:45.340339 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.340304 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eea9ecc9-7ece-41c2-8551-80f81c7e7fdb-maas-api-tls\") pod \"maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q\" (UID: \"eea9ecc9-7ece-41c2-8551-80f81c7e7fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" Jul 17 18:07:45.340515 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.340403 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea9ecc9-7ece-41c2-8551-80f81c7e7fdb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q\" (UID: \"eea9ecc9-7ece-41c2-8551-80f81c7e7fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" Jul 17 18:07:45.340515 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.340438 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg998\" (UniqueName: \"kubernetes.io/projected/eea9ecc9-7ece-41c2-8551-80f81c7e7fdb-kube-api-access-dg998\") pod \"maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q\" (UID: \"eea9ecc9-7ece-41c2-8551-80f81c7e7fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" Jul 17 18:07:45.341115 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.341095 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea9ecc9-7ece-41c2-8551-80f81c7e7fdb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q\" (UID: \"eea9ecc9-7ece-41c2-8551-80f81c7e7fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" Jul 17 18:07:45.342862 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.342846 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eea9ecc9-7ece-41c2-8551-80f81c7e7fdb-maas-api-tls\") pod \"maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q\" (UID: \"eea9ecc9-7ece-41c2-8551-80f81c7e7fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" Jul 17 18:07:45.361750 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.361719 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg998\" (UniqueName: \"kubernetes.io/projected/eea9ecc9-7ece-41c2-8551-80f81c7e7fdb-kube-api-access-dg998\") pod \"maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q\" (UID: \"eea9ecc9-7ece-41c2-8551-80f81c7e7fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" Jul 17 18:07:45.370568 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.370545 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" Jul 17 18:07:45.544731 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.544693 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q"] Jul 17 18:07:45.547582 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:07:45.547556 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea9ecc9_7ece_41c2_8551_80f81c7e7fdb.slice/crio-b3baf879d712f408ccdf197cb25d8400326ad92621d1d4b3a56a7c0ad26364c8 WatchSource:0}: Error finding container b3baf879d712f408ccdf197cb25d8400326ad92621d1d4b3a56a7c0ad26364c8: Status 404 returned error can't find the container with id b3baf879d712f408ccdf197cb25d8400326ad92621d1d4b3a56a7c0ad26364c8 Jul 17 18:07:45.549138 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.549114 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 18:07:45.737066 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.736982 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" event={"ID":"eea9ecc9-7ece-41c2-8551-80f81c7e7fdb","Type":"ContainerStarted","Data":"b3baf879d712f408ccdf197cb25d8400326ad92621d1d4b3a56a7c0ad26364c8"} Jul 17 18:07:45.737249 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.737122 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:45.738102 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:45.738084 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:07:46.743773 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:46.743736 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" event={"ID":"eea9ecc9-7ece-41c2-8551-80f81c7e7fdb","Type":"ContainerStarted","Data":"3158373c54e858ba0f2dde0df7472cd251410ef73b212a9a6a3a70a998876321"} Jul 17 18:07:46.744166 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:46.743803 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" Jul 17 18:07:51.374301 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.374238 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" podStartSLOduration=6.771029974 podStartE2EDuration="7.374216022s" totalImagesPullingTime="603.186048ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:07:46.79463245 +0000 UTC m=+2235.405301832" watchObservedRunningTime="2026-07-17 18:07:51.374216022 +0000 UTC m=+2239.984885405" Jul 17 18:07:51.374713 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.374616 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw"] Jul 17 18:07:51.378982 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.378956 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.382164 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.382140 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3145cb-openshift-default-dockercfg-6vh7w\"" Jul 17 18:07:51.398308 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.398288 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-workload-certs\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.398403 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.398329 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-credential-socket\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.398403 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.398348 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhxnw\" (UniqueName: \"kubernetes.io/projected/7a70ab1b-05c5-4e33-b016-beb354594074-kube-api-access-hhxnw\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.398403 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.398371 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a70ab1b-05c5-4e33-b016-beb354594074-istio-token\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.398500 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.398422 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-workload-socket\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.398500 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.398460 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a70ab1b-05c5-4e33-b016-beb354594074-istio-podinfo\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.398565 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.398500 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-istio-envoy\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.398565 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.398532 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-istio-data\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.398626 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.398574 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a70ab1b-05c5-4e33-b016-beb354594074-istiod-ca-cert\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.414520 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.414494 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw"] Jul 17 18:07:51.499286 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.499250 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a70ab1b-05c5-4e33-b016-beb354594074-istio-podinfo\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.499477 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.499295 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-istio-envoy\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.499477 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.499325 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-istio-data\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.499477 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.499362 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a70ab1b-05c5-4e33-b016-beb354594074-istiod-ca-cert\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.499477 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.499428 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-workload-certs\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.499477 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.499469 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-credential-socket\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.499769 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.499580 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhxnw\" (UniqueName: \"kubernetes.io/projected/7a70ab1b-05c5-4e33-b016-beb354594074-kube-api-access-hhxnw\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.499769 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.499611 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a70ab1b-05c5-4e33-b016-beb354594074-istio-token\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.499769 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.499638 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-workload-socket\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.499940 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.499858 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-istio-data\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.499940 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.499908 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-credential-socket\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.500047 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.499970 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-workload-certs\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.500285 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.500260 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-workload-socket\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.500486 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.500468 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a70ab1b-05c5-4e33-b016-beb354594074-istiod-ca-cert\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.501844 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.501821 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-istio-envoy\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.501994 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.501977 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a70ab1b-05c5-4e33-b016-beb354594074-istio-podinfo\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.516117 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.516093 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a70ab1b-05c5-4e33-b016-beb354594074-istio-token\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.517928 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.517906 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhxnw\" (UniqueName: \"kubernetes.io/projected/7a70ab1b-05c5-4e33-b016-beb354594074-kube-api-access-hhxnw\") pod \"e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.690170 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.690073 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:51.842422 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.842389 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw"] Jul 17 18:07:51.843491 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:07:51.843447 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a70ab1b_05c5_4e33_b016_beb354594074.slice/crio-b6cb874180b5783ba9a5ff31648d372bdb73bc0bd001cfe31f6d43431e21d239 WatchSource:0}: Error finding container b6cb874180b5783ba9a5ff31648d372bdb73bc0bd001cfe31f6d43431e21d239: Status 404 returned error can't find the container with id b6cb874180b5783ba9a5ff31648d372bdb73bc0bd001cfe31f6d43431e21d239 Jul 17 18:07:51.845799 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.845763 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:07:51.845909 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.845829 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:07:51.845909 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:51.845864 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:07:52.755029 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:52.754995 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q" Jul 17 18:07:52.778539 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:52.778504 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" event={"ID":"7a70ab1b-05c5-4e33-b016-beb354594074","Type":"ContainerStarted","Data":"d1f4e26667957dfa07d09ff56fdae669a15709185dd09ce1ec71dbaa57d1fb92"} Jul 17 18:07:52.778714 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:52.778559 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" event={"ID":"7a70ab1b-05c5-4e33-b016-beb354594074","Type":"ContainerStarted","Data":"b6cb874180b5783ba9a5ff31648d372bdb73bc0bd001cfe31f6d43431e21d239"} Jul 17 18:07:52.827209 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:52.827159 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" podStartSLOduration=1.82714457 podStartE2EDuration="1.82714457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:07:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:07:52.826175658 +0000 UTC m=+2241.436845041" watchObservedRunningTime="2026-07-17 18:07:52.82714457 +0000 UTC m=+2241.437814010" Jul 17 18:07:53.690212 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:53.690182 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:53.695360 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:53.695336 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:53.783663 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:53.783633 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:53.784559 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:53.784542 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:07:54.025885 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.025808 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76"] Jul 17 18:07:54.028956 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.028938 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" Jul 17 18:07:54.039364 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.039342 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-3145cb-serving-cert\"" Jul 17 18:07:54.053781 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.053746 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76"] Jul 17 18:07:54.126966 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.126927 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ee6b549-6ccc-49d1-be41-258d87d813fb-maas-api-tls\") pod \"maas-api-e2e-inf-b-3145cb-558d789686-j4m76\" (UID: \"5ee6b549-6ccc-49d1-be41-258d87d813fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" Jul 17 18:07:54.127163 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.127041 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee6b549-6ccc-49d1-be41-258d87d813fb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3145cb-558d789686-j4m76\" (UID: \"5ee6b549-6ccc-49d1-be41-258d87d813fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" Jul 17 18:07:54.127163 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.127089 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccw7v\" (UniqueName: \"kubernetes.io/projected/5ee6b549-6ccc-49d1-be41-258d87d813fb-kube-api-access-ccw7v\") pod \"maas-api-e2e-inf-b-3145cb-558d789686-j4m76\" (UID: \"5ee6b549-6ccc-49d1-be41-258d87d813fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" Jul 17 18:07:54.228594 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.228560 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ee6b549-6ccc-49d1-be41-258d87d813fb-maas-api-tls\") pod \"maas-api-e2e-inf-b-3145cb-558d789686-j4m76\" (UID: \"5ee6b549-6ccc-49d1-be41-258d87d813fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" Jul 17 18:07:54.228777 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.228605 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee6b549-6ccc-49d1-be41-258d87d813fb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3145cb-558d789686-j4m76\" (UID: \"5ee6b549-6ccc-49d1-be41-258d87d813fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" Jul 17 18:07:54.228777 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.228642 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccw7v\" (UniqueName: \"kubernetes.io/projected/5ee6b549-6ccc-49d1-be41-258d87d813fb-kube-api-access-ccw7v\") pod \"maas-api-e2e-inf-b-3145cb-558d789686-j4m76\" (UID: \"5ee6b549-6ccc-49d1-be41-258d87d813fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" Jul 17 18:07:54.229356 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.229331 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee6b549-6ccc-49d1-be41-258d87d813fb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3145cb-558d789686-j4m76\" (UID: \"5ee6b549-6ccc-49d1-be41-258d87d813fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" Jul 17 18:07:54.231013 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.230991 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ee6b549-6ccc-49d1-be41-258d87d813fb-maas-api-tls\") pod \"maas-api-e2e-inf-b-3145cb-558d789686-j4m76\" (UID: \"5ee6b549-6ccc-49d1-be41-258d87d813fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" Jul 17 18:07:54.240271 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.240248 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccw7v\" (UniqueName: \"kubernetes.io/projected/5ee6b549-6ccc-49d1-be41-258d87d813fb-kube-api-access-ccw7v\") pod \"maas-api-e2e-inf-b-3145cb-558d789686-j4m76\" (UID: \"5ee6b549-6ccc-49d1-be41-258d87d813fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" Jul 17 18:07:54.340149 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.340116 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" Jul 17 18:07:54.495268 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.495244 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76"] Jul 17 18:07:54.497934 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:07:54.497895 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee6b549_6ccc_49d1_be41_258d87d813fb.slice/crio-c8c36c234fe460c7c263968afdc6c976549e582af95e7427fba7beced0f5b794 WatchSource:0}: Error finding container c8c36c234fe460c7c263968afdc6c976549e582af95e7427fba7beced0f5b794: Status 404 returned error can't find the container with id c8c36c234fe460c7c263968afdc6c976549e582af95e7427fba7beced0f5b794 Jul 17 18:07:54.791386 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:54.791293 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" event={"ID":"5ee6b549-6ccc-49d1-be41-258d87d813fb","Type":"ContainerStarted","Data":"c8c36c234fe460c7c263968afdc6c976549e582af95e7427fba7beced0f5b794"} Jul 17 18:07:55.803000 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:55.802962 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" event={"ID":"5ee6b549-6ccc-49d1-be41-258d87d813fb","Type":"ContainerStarted","Data":"eef02d264f29bc7864ac74888b6ea2060192080dd887023f1079737ff79d538b"} Jul 17 18:07:55.803513 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:55.803075 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" Jul 17 18:07:55.831610 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:07:55.831557 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" podStartSLOduration=2.364215212 podStartE2EDuration="2.831541768s" totalImagesPullingTime="467.326556ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:07:55.829771439 +0000 UTC m=+2244.440440822" watchObservedRunningTime="2026-07-17 18:07:55.831541768 +0000 UTC m=+2244.442211150" Jul 17 18:08:01.778874 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:01.778829 2557 patch_prober.go:28] interesting pod/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 17 18:08:01.779262 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:01.778894 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" podUID="f4ce5b62-f910-4483-8bac-0c949c89437e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 17 18:08:01.813982 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:01.813954 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3145cb-558d789686-j4m76" Jul 17 18:08:02.841211 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:02.841177 2557 generic.go:356] "Generic (PLEG): container finished" podID="f4ce5b62-f910-4483-8bac-0c949c89437e" containerID="de08b3ae4f25f59df6413551cb78c380c170eacaeb8bf1ca791718b6c665fdf2" exitCode=0 Jul 17 18:08:02.841708 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:02.841252 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" event={"ID":"f4ce5b62-f910-4483-8bac-0c949c89437e","Type":"ContainerDied","Data":"de08b3ae4f25f59df6413551cb78c380c170eacaeb8bf1ca791718b6c665fdf2"} Jul 17 18:08:02.841792 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:02.841722 2557 scope.go:117] "RemoveContainer" containerID="de08b3ae4f25f59df6413551cb78c380c170eacaeb8bf1ca791718b6c665fdf2" Jul 17 18:08:02.842731 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:02.842702 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:08:02.842797 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:02.842774 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:08:02.842838 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:02.842807 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:08:03.847740 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:03.847706 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" event={"ID":"f4ce5b62-f910-4483-8bac-0c949c89437e","Type":"ContainerStarted","Data":"09ce53b39c8efd2d41366409d5a2112330317f9e7e7ac4e2b37ea68a3fb39ffc"} Jul 17 18:08:04.800707 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:04.800653 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:08:04.801115 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:04.801020 2557 patch_prober.go:28] interesting pod/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 17 18:08:04.801291 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:04.801267 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" podUID="f4ce5b62-f910-4483-8bac-0c949c89437e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 17 18:08:05.800135 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:05.800088 2557 patch_prober.go:28] interesting pod/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 17 18:08:05.800643 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:05.800160 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" podUID="f4ce5b62-f910-4483-8bac-0c949c89437e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 17 18:08:06.800349 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:06.800243 2557 patch_prober.go:28] interesting pod/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 17 18:08:06.800349 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:06.800320 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" podUID="f4ce5b62-f910-4483-8bac-0c949c89437e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 17 18:08:07.835544 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:07.835506 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:08:07.836051 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:07.835872 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:08:07.836888 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:07.836864 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:08:09.244833 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:09.243482 2557 patch_prober.go:28] interesting pod/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:53854->10.132.0.57:15021: read: connection reset by peer" start-of-body= Jul 17 18:08:09.244833 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:09.243565 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" podUID="7a70ab1b-05c5-4e33-b016-beb354594074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:53854->10.132.0.57:15021: read: connection reset by peer" Jul 17 18:08:09.880213 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:09.880179 2557 generic.go:356] "Generic (PLEG): container finished" podID="7a70ab1b-05c5-4e33-b016-beb354594074" containerID="d1f4e26667957dfa07d09ff56fdae669a15709185dd09ce1ec71dbaa57d1fb92" exitCode=0 Jul 17 18:08:09.880397 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:09.880249 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" event={"ID":"7a70ab1b-05c5-4e33-b016-beb354594074","Type":"ContainerDied","Data":"d1f4e26667957dfa07d09ff56fdae669a15709185dd09ce1ec71dbaa57d1fb92"} Jul 17 18:08:09.880672 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:09.880659 2557 scope.go:117] "RemoveContainer" containerID="d1f4e26667957dfa07d09ff56fdae669a15709185dd09ce1ec71dbaa57d1fb92" Jul 17 18:08:09.881734 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:09.881705 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:08:09.881844 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:09.881787 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:08:09.881908 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:09.881838 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:08:10.892469 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:10.892424 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" event={"ID":"7a70ab1b-05c5-4e33-b016-beb354594074","Type":"ContainerStarted","Data":"1482c20888fbac7f22d9e84b6192b2135136c39e18a4cacbdf7d928a98c01112"} Jul 17 18:08:11.691101 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:11.691064 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:08:11.691474 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:11.691446 2557 patch_prober.go:28] interesting pod/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 17 18:08:11.691701 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:11.691643 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" podUID="7a70ab1b-05c5-4e33-b016-beb354594074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 17 18:08:12.690594 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:12.690553 2557 patch_prober.go:28] interesting pod/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 17 18:08:12.691222 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:12.691187 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" podUID="7a70ab1b-05c5-4e33-b016-beb354594074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 17 18:08:13.691511 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:13.691466 2557 patch_prober.go:28] interesting pod/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 17 18:08:13.692140 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:13.692104 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" podUID="7a70ab1b-05c5-4e33-b016-beb354594074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 17 18:08:14.690573 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:14.690533 2557 patch_prober.go:28] interesting pod/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 17 18:08:14.690911 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:14.690875 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" podUID="7a70ab1b-05c5-4e33-b016-beb354594074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 17 18:08:15.694003 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:15.693974 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:08:15.694455 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:15.694372 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:08:15.695166 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:08:15.695148 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:09:43.835987 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:43.835948 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr"] Jul 17 18:09:43.836506 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:43.836156 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" podUID="f4ce5b62-f910-4483-8bac-0c949c89437e" containerName="istio-proxy" containerID="cri-o://09ce53b39c8efd2d41366409d5a2112330317f9e7e7ac4e2b37ea68a3fb39ffc" gracePeriod=30 Jul 17 18:09:49.088779 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.088753 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:09:49.253327 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.253243 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-workload-socket\") pod \"f4ce5b62-f910-4483-8bac-0c949c89437e\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " Jul 17 18:09:49.253327 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.253276 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-workload-certs\") pod \"f4ce5b62-f910-4483-8bac-0c949c89437e\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " Jul 17 18:09:49.253327 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.253316 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-envoy\") pod \"f4ce5b62-f910-4483-8bac-0c949c89437e\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " Jul 17 18:09:49.253716 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.253383 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4ce5b62-f910-4483-8bac-0c949c89437e-istiod-ca-cert\") pod \"f4ce5b62-f910-4483-8bac-0c949c89437e\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " Jul 17 18:09:49.253716 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.253410 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-credential-socket\") pod \"f4ce5b62-f910-4483-8bac-0c949c89437e\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " Jul 17 18:09:49.253716 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.253474 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-data\") pod \"f4ce5b62-f910-4483-8bac-0c949c89437e\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " Jul 17 18:09:49.253716 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.253512 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n85zs\" (UniqueName: \"kubernetes.io/projected/f4ce5b62-f910-4483-8bac-0c949c89437e-kube-api-access-n85zs\") pod \"f4ce5b62-f910-4483-8bac-0c949c89437e\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " Jul 17 18:09:49.253716 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.253541 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-token\") pod \"f4ce5b62-f910-4483-8bac-0c949c89437e\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " Jul 17 18:09:49.253716 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.253574 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-podinfo\") pod \"f4ce5b62-f910-4483-8bac-0c949c89437e\" (UID: \"f4ce5b62-f910-4483-8bac-0c949c89437e\") " Jul 17 18:09:49.253716 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.253567 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4ce5b62-f910-4483-8bac-0c949c89437e" (UID: "f4ce5b62-f910-4483-8bac-0c949c89437e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:09:49.253716 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.253606 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4ce5b62-f910-4483-8bac-0c949c89437e" (UID: "f4ce5b62-f910-4483-8bac-0c949c89437e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:09:49.254136 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.253751 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4ce5b62-f910-4483-8bac-0c949c89437e" (UID: "f4ce5b62-f910-4483-8bac-0c949c89437e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:09:49.254136 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.253849 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4ce5b62-f910-4483-8bac-0c949c89437e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4ce5b62-f910-4483-8bac-0c949c89437e" (UID: "f4ce5b62-f910-4483-8bac-0c949c89437e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:09:49.254136 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.254000 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4ce5b62-f910-4483-8bac-0c949c89437e-istiod-ca-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:49.254136 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.254018 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-credential-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:49.254136 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.254034 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-workload-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:49.254136 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.254047 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-workload-certs\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:49.254490 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.254464 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4ce5b62-f910-4483-8bac-0c949c89437e" (UID: "f4ce5b62-f910-4483-8bac-0c949c89437e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:09:49.255671 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.255652 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4ce5b62-f910-4483-8bac-0c949c89437e" (UID: "f4ce5b62-f910-4483-8bac-0c949c89437e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:09:49.255789 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.255762 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ce5b62-f910-4483-8bac-0c949c89437e-kube-api-access-n85zs" (OuterVolumeSpecName: "kube-api-access-n85zs") pod "f4ce5b62-f910-4483-8bac-0c949c89437e" (UID: "f4ce5b62-f910-4483-8bac-0c949c89437e"). InnerVolumeSpecName "kube-api-access-n85zs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:09:49.256026 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.256005 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4ce5b62-f910-4483-8bac-0c949c89437e" (UID: "f4ce5b62-f910-4483-8bac-0c949c89437e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:09:49.256085 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.256041 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4ce5b62-f910-4483-8bac-0c949c89437e" (UID: "f4ce5b62-f910-4483-8bac-0c949c89437e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:09:49.354909 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.354873 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-envoy\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:49.354909 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.354899 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-data\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:49.354909 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.354908 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n85zs\" (UniqueName: \"kubernetes.io/projected/f4ce5b62-f910-4483-8bac-0c949c89437e-kube-api-access-n85zs\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:49.354909 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.354917 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-token\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:49.355165 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.354925 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4ce5b62-f910-4483-8bac-0c949c89437e-istio-podinfo\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:49.422526 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.422491 2557 generic.go:356] "Generic (PLEG): container finished" podID="f4ce5b62-f910-4483-8bac-0c949c89437e" containerID="09ce53b39c8efd2d41366409d5a2112330317f9e7e7ac4e2b37ea68a3fb39ffc" exitCode=0 Jul 17 18:09:49.422726 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.422536 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" Jul 17 18:09:49.422726 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.422567 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" event={"ID":"f4ce5b62-f910-4483-8bac-0c949c89437e","Type":"ContainerDied","Data":"09ce53b39c8efd2d41366409d5a2112330317f9e7e7ac4e2b37ea68a3fb39ffc"} Jul 17 18:09:49.422726 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.422629 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr" event={"ID":"f4ce5b62-f910-4483-8bac-0c949c89437e","Type":"ContainerDied","Data":"736b57d002293c66fc85ca9db2a672988f672f8da05ab394775bbf069ad5be2a"} Jul 17 18:09:49.422726 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.422657 2557 scope.go:117] "RemoveContainer" containerID="09ce53b39c8efd2d41366409d5a2112330317f9e7e7ac4e2b37ea68a3fb39ffc" Jul 17 18:09:49.432279 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.432260 2557 scope.go:117] "RemoveContainer" containerID="de08b3ae4f25f59df6413551cb78c380c170eacaeb8bf1ca791718b6c665fdf2" Jul 17 18:09:49.447270 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.447248 2557 scope.go:117] "RemoveContainer" containerID="09ce53b39c8efd2d41366409d5a2112330317f9e7e7ac4e2b37ea68a3fb39ffc" Jul 17 18:09:49.447551 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:09:49.447531 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09ce53b39c8efd2d41366409d5a2112330317f9e7e7ac4e2b37ea68a3fb39ffc\": container with ID starting with 09ce53b39c8efd2d41366409d5a2112330317f9e7e7ac4e2b37ea68a3fb39ffc not found: ID does not exist" containerID="09ce53b39c8efd2d41366409d5a2112330317f9e7e7ac4e2b37ea68a3fb39ffc" Jul 17 18:09:49.447613 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.447559 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09ce53b39c8efd2d41366409d5a2112330317f9e7e7ac4e2b37ea68a3fb39ffc"} err="failed to get container status \"09ce53b39c8efd2d41366409d5a2112330317f9e7e7ac4e2b37ea68a3fb39ffc\": rpc error: code = NotFound desc = could not find container \"09ce53b39c8efd2d41366409d5a2112330317f9e7e7ac4e2b37ea68a3fb39ffc\": container with ID starting with 09ce53b39c8efd2d41366409d5a2112330317f9e7e7ac4e2b37ea68a3fb39ffc not found: ID does not exist" Jul 17 18:09:49.447613 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.447578 2557 scope.go:117] "RemoveContainer" containerID="de08b3ae4f25f59df6413551cb78c380c170eacaeb8bf1ca791718b6c665fdf2" Jul 17 18:09:49.447934 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:09:49.447912 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de08b3ae4f25f59df6413551cb78c380c170eacaeb8bf1ca791718b6c665fdf2\": container with ID starting with de08b3ae4f25f59df6413551cb78c380c170eacaeb8bf1ca791718b6c665fdf2 not found: ID does not exist" containerID="de08b3ae4f25f59df6413551cb78c380c170eacaeb8bf1ca791718b6c665fdf2" Jul 17 18:09:49.448001 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.447939 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de08b3ae4f25f59df6413551cb78c380c170eacaeb8bf1ca791718b6c665fdf2"} err="failed to get container status \"de08b3ae4f25f59df6413551cb78c380c170eacaeb8bf1ca791718b6c665fdf2\": rpc error: code = NotFound desc = could not find container \"de08b3ae4f25f59df6413551cb78c380c170eacaeb8bf1ca791718b6c665fdf2\": container with ID starting with de08b3ae4f25f59df6413551cb78c380c170eacaeb8bf1ca791718b6c665fdf2 not found: ID does not exist" Jul 17 18:09:49.451940 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.451918 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr"] Jul 17 18:09:49.457911 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.457892 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-72cf7b-openshift-default-85d5868bc5-hhckr"] Jul 17 18:09:49.880406 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:49.880372 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4ce5b62-f910-4483-8bac-0c949c89437e" path="/var/lib/kubelet/pods/f4ce5b62-f910-4483-8bac-0c949c89437e/volumes" Jul 17 18:09:52.471573 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:52.471535 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw"] Jul 17 18:09:52.472051 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:52.471781 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" podUID="7a70ab1b-05c5-4e33-b016-beb354594074" containerName="istio-proxy" containerID="cri-o://1482c20888fbac7f22d9e84b6192b2135136c39e18a4cacbdf7d928a98c01112" gracePeriod=30 Jul 17 18:09:53.595532 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.595497 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn"] Jul 17 18:09:53.595930 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.595897 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ce5b62-f910-4483-8bac-0c949c89437e" containerName="istio-proxy" Jul 17 18:09:53.595930 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.595909 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ce5b62-f910-4483-8bac-0c949c89437e" containerName="istio-proxy" Jul 17 18:09:53.595930 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.595924 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ce5b62-f910-4483-8bac-0c949c89437e" containerName="istio-proxy" Jul 17 18:09:53.595930 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.595931 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ce5b62-f910-4483-8bac-0c949c89437e" containerName="istio-proxy" Jul 17 18:09:53.596061 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.595996 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ce5b62-f910-4483-8bac-0c949c89437e" containerName="istio-proxy" Jul 17 18:09:53.596061 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.596007 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ce5b62-f910-4483-8bac-0c949c89437e" containerName="istio-proxy" Jul 17 18:09:53.600709 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.600687 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.604590 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.604569 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-e63578-openshift-default-dockercfg-m8xfb\"" Jul 17 18:09:53.631178 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.631149 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn"] Jul 17 18:09:53.697700 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.697644 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-istio-envoy\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.697879 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.697716 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js96c\" (UniqueName: \"kubernetes.io/projected/037c2774-87c7-4153-8e65-18681194e900-kube-api-access-js96c\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.697879 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.697754 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-workload-certs\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.697879 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.697807 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/037c2774-87c7-4153-8e65-18681194e900-istio-podinfo\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.697879 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.697835 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037c2774-87c7-4153-8e65-18681194e900-istio-token\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.697879 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.697853 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-workload-socket\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.698055 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.697978 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-credential-socket\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.698055 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.698025 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-istio-data\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.698120 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.698053 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/037c2774-87c7-4153-8e65-18681194e900-istiod-ca-cert\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.799496 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.799461 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/037c2774-87c7-4153-8e65-18681194e900-istio-podinfo\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.799727 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.799503 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037c2774-87c7-4153-8e65-18681194e900-istio-token\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.799727 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.799529 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-workload-socket\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.799727 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.799570 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-credential-socket\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.799727 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.799592 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-istio-data\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.799727 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.799609 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/037c2774-87c7-4153-8e65-18681194e900-istiod-ca-cert\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.799727 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.799715 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-istio-envoy\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.800054 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.799768 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js96c\" (UniqueName: \"kubernetes.io/projected/037c2774-87c7-4153-8e65-18681194e900-kube-api-access-js96c\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.800054 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.799793 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-workload-certs\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.800180 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.800101 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-credential-socket\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.800180 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.800135 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-workload-socket\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.800379 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.800357 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-istio-data\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.800438 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.800372 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-workload-certs\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.800635 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.800610 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/037c2774-87c7-4153-8e65-18681194e900-istiod-ca-cert\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.802210 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.802187 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-istio-envoy\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.802313 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.802292 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/037c2774-87c7-4153-8e65-18681194e900-istio-podinfo\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.812757 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.812735 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js96c\" (UniqueName: \"kubernetes.io/projected/037c2774-87c7-4153-8e65-18681194e900-kube-api-access-js96c\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.823450 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.823429 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037c2774-87c7-4153-8e65-18681194e900-istio-token\") pod \"e2e-api-a-e63578-openshift-default-64495c7847-jt7xn\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:53.911633 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:53.911540 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:54.105106 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:54.105078 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn"] Jul 17 18:09:54.106576 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:09:54.106542 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod037c2774_87c7_4153_8e65_18681194e900.slice/crio-988f2fd2cf64783671e3c8007dafcf0be6de8d143b08a9f00835e76e9e148fcc WatchSource:0}: Error finding container 988f2fd2cf64783671e3c8007dafcf0be6de8d143b08a9f00835e76e9e148fcc: Status 404 returned error can't find the container with id 988f2fd2cf64783671e3c8007dafcf0be6de8d143b08a9f00835e76e9e148fcc Jul 17 18:09:54.108650 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:54.108611 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:09:54.108772 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:54.108708 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:09:54.108772 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:54.108738 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:09:54.452236 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:54.452201 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" event={"ID":"037c2774-87c7-4153-8e65-18681194e900","Type":"ContainerStarted","Data":"71a96d24f492f3738457f951595141d34126f6dae0f623658c30f325b433c34d"} Jul 17 18:09:54.452422 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:54.452259 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" event={"ID":"037c2774-87c7-4153-8e65-18681194e900","Type":"ContainerStarted","Data":"988f2fd2cf64783671e3c8007dafcf0be6de8d143b08a9f00835e76e9e148fcc"} Jul 17 18:09:54.912410 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:54.912363 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:55.916736 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:55.916708 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:55.966712 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:55.966645 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" podStartSLOduration=2.966629932 podStartE2EDuration="2.966629932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:09:54.511809916 +0000 UTC m=+2363.122479299" watchObservedRunningTime="2026-07-17 18:09:55.966629932 +0000 UTC m=+2364.577299314" Jul 17 18:09:56.463254 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:56.463224 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:56.464289 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:56.464267 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:09:57.728505 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.728481 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:09:57.734883 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.734830 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a70ab1b-05c5-4e33-b016-beb354594074-istiod-ca-cert\") pod \"7a70ab1b-05c5-4e33-b016-beb354594074\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " Jul 17 18:09:57.734883 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.734873 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-workload-certs\") pod \"7a70ab1b-05c5-4e33-b016-beb354594074\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " Jul 17 18:09:57.735051 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.734893 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhxnw\" (UniqueName: \"kubernetes.io/projected/7a70ab1b-05c5-4e33-b016-beb354594074-kube-api-access-hhxnw\") pod \"7a70ab1b-05c5-4e33-b016-beb354594074\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " Jul 17 18:09:57.735111 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.735063 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-istio-data\") pod \"7a70ab1b-05c5-4e33-b016-beb354594074\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " Jul 17 18:09:57.735170 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.735136 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-credential-socket\") pod \"7a70ab1b-05c5-4e33-b016-beb354594074\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " Jul 17 18:09:57.735170 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.735123 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a70ab1b-05c5-4e33-b016-beb354594074" (UID: "7a70ab1b-05c5-4e33-b016-beb354594074"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:09:57.735276 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.735174 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-workload-socket\") pod \"7a70ab1b-05c5-4e33-b016-beb354594074\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " Jul 17 18:09:57.735276 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.735199 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a70ab1b-05c5-4e33-b016-beb354594074-istio-podinfo\") pod \"7a70ab1b-05c5-4e33-b016-beb354594074\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " Jul 17 18:09:57.735276 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.735228 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a70ab1b-05c5-4e33-b016-beb354594074-istio-token\") pod \"7a70ab1b-05c5-4e33-b016-beb354594074\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " Jul 17 18:09:57.735276 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.735259 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a70ab1b-05c5-4e33-b016-beb354594074-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a70ab1b-05c5-4e33-b016-beb354594074" (UID: "7a70ab1b-05c5-4e33-b016-beb354594074"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:09:57.735476 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.735268 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-istio-envoy\") pod \"7a70ab1b-05c5-4e33-b016-beb354594074\" (UID: \"7a70ab1b-05c5-4e33-b016-beb354594074\") " Jul 17 18:09:57.735476 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.735418 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a70ab1b-05c5-4e33-b016-beb354594074" (UID: "7a70ab1b-05c5-4e33-b016-beb354594074"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:09:57.735476 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.735432 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a70ab1b-05c5-4e33-b016-beb354594074" (UID: "7a70ab1b-05c5-4e33-b016-beb354594074"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:09:57.735742 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.735725 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a70ab1b-05c5-4e33-b016-beb354594074-istiod-ca-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:57.735831 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.735746 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-workload-certs\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:57.735831 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.735758 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-credential-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:57.735831 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.735759 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a70ab1b-05c5-4e33-b016-beb354594074" (UID: "7a70ab1b-05c5-4e33-b016-beb354594074"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:09:57.735831 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.735770 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-workload-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:57.737145 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.737116 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a70ab1b-05c5-4e33-b016-beb354594074-kube-api-access-hhxnw" (OuterVolumeSpecName: "kube-api-access-hhxnw") pod "7a70ab1b-05c5-4e33-b016-beb354594074" (UID: "7a70ab1b-05c5-4e33-b016-beb354594074"). InnerVolumeSpecName "kube-api-access-hhxnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:09:57.737351 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.737332 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a70ab1b-05c5-4e33-b016-beb354594074" (UID: "7a70ab1b-05c5-4e33-b016-beb354594074"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:09:57.737613 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.737594 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a70ab1b-05c5-4e33-b016-beb354594074-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a70ab1b-05c5-4e33-b016-beb354594074" (UID: "7a70ab1b-05c5-4e33-b016-beb354594074"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:09:57.737613 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.737598 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a70ab1b-05c5-4e33-b016-beb354594074-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a70ab1b-05c5-4e33-b016-beb354594074" (UID: "7a70ab1b-05c5-4e33-b016-beb354594074"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:09:57.836959 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.836924 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a70ab1b-05c5-4e33-b016-beb354594074-istio-podinfo\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:57.836959 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.836952 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a70ab1b-05c5-4e33-b016-beb354594074-istio-token\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:57.836959 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.836961 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-istio-envoy\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:57.837192 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.836969 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhxnw\" (UniqueName: \"kubernetes.io/projected/7a70ab1b-05c5-4e33-b016-beb354594074-kube-api-access-hhxnw\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:57.837192 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:57.836980 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a70ab1b-05c5-4e33-b016-beb354594074-istio-data\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:09:58.477334 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:58.477297 2557 generic.go:356] "Generic (PLEG): container finished" podID="7a70ab1b-05c5-4e33-b016-beb354594074" containerID="1482c20888fbac7f22d9e84b6192b2135136c39e18a4cacbdf7d928a98c01112" exitCode=0 Jul 17 18:09:58.477508 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:58.477342 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" Jul 17 18:09:58.477508 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:58.477382 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" event={"ID":"7a70ab1b-05c5-4e33-b016-beb354594074","Type":"ContainerDied","Data":"1482c20888fbac7f22d9e84b6192b2135136c39e18a4cacbdf7d928a98c01112"} Jul 17 18:09:58.477508 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:58.477438 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw" event={"ID":"7a70ab1b-05c5-4e33-b016-beb354594074","Type":"ContainerDied","Data":"b6cb874180b5783ba9a5ff31648d372bdb73bc0bd001cfe31f6d43431e21d239"} Jul 17 18:09:58.477508 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:58.477467 2557 scope.go:117] "RemoveContainer" containerID="1482c20888fbac7f22d9e84b6192b2135136c39e18a4cacbdf7d928a98c01112" Jul 17 18:09:58.486076 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:58.486056 2557 scope.go:117] "RemoveContainer" containerID="d1f4e26667957dfa07d09ff56fdae669a15709185dd09ce1ec71dbaa57d1fb92" Jul 17 18:09:58.493847 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:58.493827 2557 scope.go:117] "RemoveContainer" containerID="1482c20888fbac7f22d9e84b6192b2135136c39e18a4cacbdf7d928a98c01112" Jul 17 18:09:58.494099 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:09:58.494081 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1482c20888fbac7f22d9e84b6192b2135136c39e18a4cacbdf7d928a98c01112\": container with ID starting with 1482c20888fbac7f22d9e84b6192b2135136c39e18a4cacbdf7d928a98c01112 not found: ID does not exist" containerID="1482c20888fbac7f22d9e84b6192b2135136c39e18a4cacbdf7d928a98c01112" Jul 17 18:09:58.494147 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:58.494112 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1482c20888fbac7f22d9e84b6192b2135136c39e18a4cacbdf7d928a98c01112"} err="failed to get container status \"1482c20888fbac7f22d9e84b6192b2135136c39e18a4cacbdf7d928a98c01112\": rpc error: code = NotFound desc = could not find container \"1482c20888fbac7f22d9e84b6192b2135136c39e18a4cacbdf7d928a98c01112\": container with ID starting with 1482c20888fbac7f22d9e84b6192b2135136c39e18a4cacbdf7d928a98c01112 not found: ID does not exist" Jul 17 18:09:58.494147 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:58.494131 2557 scope.go:117] "RemoveContainer" containerID="d1f4e26667957dfa07d09ff56fdae669a15709185dd09ce1ec71dbaa57d1fb92" Jul 17 18:09:58.494377 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:09:58.494359 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1f4e26667957dfa07d09ff56fdae669a15709185dd09ce1ec71dbaa57d1fb92\": container with ID starting with d1f4e26667957dfa07d09ff56fdae669a15709185dd09ce1ec71dbaa57d1fb92 not found: ID does not exist" containerID="d1f4e26667957dfa07d09ff56fdae669a15709185dd09ce1ec71dbaa57d1fb92" Jul 17 18:09:58.494433 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:58.494382 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f4e26667957dfa07d09ff56fdae669a15709185dd09ce1ec71dbaa57d1fb92"} err="failed to get container status \"d1f4e26667957dfa07d09ff56fdae669a15709185dd09ce1ec71dbaa57d1fb92\": rpc error: code = NotFound desc = could not find container \"d1f4e26667957dfa07d09ff56fdae669a15709185dd09ce1ec71dbaa57d1fb92\": container with ID starting with d1f4e26667957dfa07d09ff56fdae669a15709185dd09ce1ec71dbaa57d1fb92 not found: ID does not exist" Jul 17 18:09:58.507135 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:58.507111 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw"] Jul 17 18:09:58.518900 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:58.518878 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-3145cb-openshift-default-5bb79685c9-tctnw"] Jul 17 18:09:59.878065 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:09:59.878032 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a70ab1b-05c5-4e33-b016-beb354594074" path="/var/lib/kubelet/pods/7a70ab1b-05c5-4e33-b016-beb354594074/volumes" Jul 17 18:10:02.034496 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.034457 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn"] Jul 17 18:10:02.035058 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.035042 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a70ab1b-05c5-4e33-b016-beb354594074" containerName="istio-proxy" Jul 17 18:10:02.035122 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.035060 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a70ab1b-05c5-4e33-b016-beb354594074" containerName="istio-proxy" Jul 17 18:10:02.035122 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.035080 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a70ab1b-05c5-4e33-b016-beb354594074" containerName="istio-proxy" Jul 17 18:10:02.035122 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.035090 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a70ab1b-05c5-4e33-b016-beb354594074" containerName="istio-proxy" Jul 17 18:10:02.035270 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.035177 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a70ab1b-05c5-4e33-b016-beb354594074" containerName="istio-proxy" Jul 17 18:10:02.035270 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.035188 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a70ab1b-05c5-4e33-b016-beb354594074" containerName="istio-proxy" Jul 17 18:10:02.040118 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.040098 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.044405 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.044386 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c9e4ef-openshift-default-dockercfg-dmx2q\"" Jul 17 18:10:02.069866 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.069832 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn"] Jul 17 18:10:02.074488 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.074460 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-workload-socket\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.074648 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.074495 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4km74\" (UniqueName: \"kubernetes.io/projected/12d1a085-9787-4be6-8212-d9f52b163e02-kube-api-access-4km74\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.074648 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.074521 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12d1a085-9787-4be6-8212-d9f52b163e02-istio-podinfo\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.074648 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.074599 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-istio-envoy\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.074648 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.074620 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-credential-socket\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.074893 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.074671 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-workload-certs\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.074893 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.074722 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-istio-data\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.074893 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.074747 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12d1a085-9787-4be6-8212-d9f52b163e02-istiod-ca-cert\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.074893 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.074781 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d1a085-9787-4be6-8212-d9f52b163e02-istio-token\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.176297 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.176261 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12d1a085-9787-4be6-8212-d9f52b163e02-istiod-ca-cert\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.176507 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.176325 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d1a085-9787-4be6-8212-d9f52b163e02-istio-token\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.176507 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.176382 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-workload-socket\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.176633 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.176506 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4km74\" (UniqueName: \"kubernetes.io/projected/12d1a085-9787-4be6-8212-d9f52b163e02-kube-api-access-4km74\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.176633 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.176543 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12d1a085-9787-4be6-8212-d9f52b163e02-istio-podinfo\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.176633 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.176587 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-istio-envoy\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.176633 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.176621 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-credential-socket\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.176891 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.176701 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-workload-certs\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.176891 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.176741 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-istio-data\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.176891 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.176746 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-workload-socket\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.177052 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.177032 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-credential-socket\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.177112 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.177061 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-workload-certs\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.177112 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.177104 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12d1a085-9787-4be6-8212-d9f52b163e02-istiod-ca-cert\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.177227 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.177120 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-istio-data\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.178968 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.178940 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-istio-envoy\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.179390 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.179370 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12d1a085-9787-4be6-8212-d9f52b163e02-istio-podinfo\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.209489 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.209455 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d1a085-9787-4be6-8212-d9f52b163e02-istio-token\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.212552 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.212506 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4km74\" (UniqueName: \"kubernetes.io/projected/12d1a085-9787-4be6-8212-d9f52b163e02-kube-api-access-4km74\") pod \"e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.350083 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.350043 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:02.511368 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.511335 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn"] Jul 17 18:10:02.518993 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:10:02.518964 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d1a085_9787_4be6_8212_d9f52b163e02.slice/crio-cb8b27e87f99cb4d012947fd48fb6cf579f0b10ee0245fb77af69bd2facdf800 WatchSource:0}: Error finding container cb8b27e87f99cb4d012947fd48fb6cf579f0b10ee0245fb77af69bd2facdf800: Status 404 returned error can't find the container with id cb8b27e87f99cb4d012947fd48fb6cf579f0b10ee0245fb77af69bd2facdf800 Jul 17 18:10:02.521062 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.521028 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:10:02.521164 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.521115 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:10:02.521164 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:02.521143 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:10:03.505582 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:03.505547 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" event={"ID":"12d1a085-9787-4be6-8212-d9f52b163e02","Type":"ContainerStarted","Data":"cc9b013f6868a0f279d2be9573c0036b0de6791ec6d4c0cfc11a454c7388c178"} Jul 17 18:10:03.505988 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:03.505602 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" event={"ID":"12d1a085-9787-4be6-8212-d9f52b163e02","Type":"ContainerStarted","Data":"cb8b27e87f99cb4d012947fd48fb6cf579f0b10ee0245fb77af69bd2facdf800"} Jul 17 18:10:03.550352 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:03.550294 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" podStartSLOduration=2.550276482 podStartE2EDuration="2.550276482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:10:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:03.550026233 +0000 UTC m=+2372.160695614" watchObservedRunningTime="2026-07-17 18:10:03.550276482 +0000 UTC m=+2372.160945863" Jul 17 18:10:04.351086 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:04.351054 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:04.355521 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:04.355498 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:04.511283 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:04.511253 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:04.512199 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:04.512177 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:10.552638 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:10.552605 2557 generic.go:356] "Generic (PLEG): container finished" podID="037c2774-87c7-4153-8e65-18681194e900" containerID="71a96d24f492f3738457f951595141d34126f6dae0f623658c30f325b433c34d" exitCode=0 Jul 17 18:10:10.553064 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:10.552693 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" event={"ID":"037c2774-87c7-4153-8e65-18681194e900","Type":"ContainerDied","Data":"71a96d24f492f3738457f951595141d34126f6dae0f623658c30f325b433c34d"} Jul 17 18:10:10.553128 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:10.553115 2557 scope.go:117] "RemoveContainer" containerID="71a96d24f492f3738457f951595141d34126f6dae0f623658c30f325b433c34d" Jul 17 18:10:10.554095 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:10.554065 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:10:10.554200 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:10.554133 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:10:10.554200 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:10.554164 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:10:11.463845 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:11.463813 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:10:11.559643 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:11.559608 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" event={"ID":"037c2774-87c7-4153-8e65-18681194e900","Type":"ContainerStarted","Data":"f39e6d1bacec3cff5fe2917c2e879661a5ffb8749ee74790a2deb79096b6de83"} Jul 17 18:10:11.912397 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:11.912361 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:10:11.913671 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:11.913641 2557 patch_prober.go:28] interesting pod/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 17 18:10:11.913839 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:11.913707 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" podUID="037c2774-87c7-4153-8e65-18681194e900" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 17 18:10:12.912147 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:12.912103 2557 patch_prober.go:28] interesting pod/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 17 18:10:12.912768 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:12.912730 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" podUID="037c2774-87c7-4153-8e65-18681194e900" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 17 18:10:13.912756 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:13.912712 2557 patch_prober.go:28] interesting pod/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 17 18:10:13.913266 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:13.912793 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" podUID="037c2774-87c7-4153-8e65-18681194e900" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 17 18:10:14.912654 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:14.912612 2557 patch_prober.go:28] interesting pod/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 17 18:10:14.912884 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:14.912704 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" podUID="037c2774-87c7-4153-8e65-18681194e900" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 17 18:10:15.932471 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:15.932425 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:10:15.932967 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:15.932879 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:10:15.934259 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:15.934231 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:10:19.859068 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:19.858304 2557 patch_prober.go:28] interesting pod/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": read tcp 10.132.0.2:40238->10.132.0.60:15021: read: connection reset by peer" start-of-body= Jul 17 18:10:19.859068 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:19.858410 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" podUID="12d1a085-9787-4be6-8212-d9f52b163e02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": read tcp 10.132.0.2:40238->10.132.0.60:15021: read: connection reset by peer" Jul 17 18:10:20.616243 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:20.616205 2557 generic.go:356] "Generic (PLEG): container finished" podID="12d1a085-9787-4be6-8212-d9f52b163e02" containerID="cc9b013f6868a0f279d2be9573c0036b0de6791ec6d4c0cfc11a454c7388c178" exitCode=0 Jul 17 18:10:20.616483 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:20.616270 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" event={"ID":"12d1a085-9787-4be6-8212-d9f52b163e02","Type":"ContainerDied","Data":"cc9b013f6868a0f279d2be9573c0036b0de6791ec6d4c0cfc11a454c7388c178"} Jul 17 18:10:20.616726 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:20.616713 2557 scope.go:117] "RemoveContainer" containerID="cc9b013f6868a0f279d2be9573c0036b0de6791ec6d4c0cfc11a454c7388c178" Jul 17 18:10:20.617788 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:20.617757 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:10:20.617904 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:20.617846 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:10:20.617904 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:20.617888 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:10:21.623303 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:21.623268 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" event={"ID":"12d1a085-9787-4be6-8212-d9f52b163e02","Type":"ContainerStarted","Data":"1156ec448dd48862e96272856c6364f945250b70110fbcaf280a85ffb96d1b45"} Jul 17 18:10:22.351303 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:22.351271 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:22.351506 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:22.351482 2557 patch_prober.go:28] interesting pod/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 17 18:10:22.351577 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:22.351559 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" podUID="12d1a085-9787-4be6-8212-d9f52b163e02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 17 18:10:23.350652 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:23.350617 2557 patch_prober.go:28] interesting pod/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 17 18:10:23.351083 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:23.350705 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" podUID="12d1a085-9787-4be6-8212-d9f52b163e02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 17 18:10:24.351272 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:24.351240 2557 patch_prober.go:28] interesting pod/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 17 18:10:24.351666 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:24.351300 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" podUID="12d1a085-9787-4be6-8212-d9f52b163e02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 17 18:10:25.351218 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:25.351182 2557 patch_prober.go:28] interesting pod/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 17 18:10:25.351402 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:25.351235 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" podUID="12d1a085-9787-4be6-8212-d9f52b163e02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 17 18:10:26.354915 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:26.354884 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:26.355348 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:26.355148 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:26.355949 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:26.355925 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:32.049568 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:32.049537 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 18:10:32.058364 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:32.058343 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 18:10:33.220922 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:33.220889 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn"] Jul 17 18:10:33.221352 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:33.221088 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" podUID="037c2774-87c7-4153-8e65-18681194e900" containerName="istio-proxy" containerID="cri-o://f39e6d1bacec3cff5fe2917c2e879661a5ffb8749ee74790a2deb79096b6de83" gracePeriod=30 Jul 17 18:10:38.467735 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.467707 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:10:38.655958 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.655926 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-istio-data\") pod \"037c2774-87c7-4153-8e65-18681194e900\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " Jul 17 18:10:38.656137 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.655964 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js96c\" (UniqueName: \"kubernetes.io/projected/037c2774-87c7-4153-8e65-18681194e900-kube-api-access-js96c\") pod \"037c2774-87c7-4153-8e65-18681194e900\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " Jul 17 18:10:38.656137 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.656008 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/037c2774-87c7-4153-8e65-18681194e900-istiod-ca-cert\") pod \"037c2774-87c7-4153-8e65-18681194e900\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " Jul 17 18:10:38.656137 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.656060 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037c2774-87c7-4153-8e65-18681194e900-istio-token\") pod \"037c2774-87c7-4153-8e65-18681194e900\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " Jul 17 18:10:38.656137 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.656076 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/037c2774-87c7-4153-8e65-18681194e900-istio-podinfo\") pod \"037c2774-87c7-4153-8e65-18681194e900\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " Jul 17 18:10:38.656137 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.656128 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-workload-certs\") pod \"037c2774-87c7-4153-8e65-18681194e900\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " Jul 17 18:10:38.656408 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.656184 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-workload-socket\") pod \"037c2774-87c7-4153-8e65-18681194e900\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " Jul 17 18:10:38.656408 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.656224 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-credential-socket\") pod \"037c2774-87c7-4153-8e65-18681194e900\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " Jul 17 18:10:38.656408 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.656252 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-istio-envoy\") pod \"037c2774-87c7-4153-8e65-18681194e900\" (UID: \"037c2774-87c7-4153-8e65-18681194e900\") " Jul 17 18:10:38.656576 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.656497 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "037c2774-87c7-4153-8e65-18681194e900" (UID: "037c2774-87c7-4153-8e65-18681194e900"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:10:38.656576 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.656517 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/037c2774-87c7-4153-8e65-18681194e900-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "037c2774-87c7-4153-8e65-18681194e900" (UID: "037c2774-87c7-4153-8e65-18681194e900"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:10:38.656576 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.656514 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "037c2774-87c7-4153-8e65-18681194e900" (UID: "037c2774-87c7-4153-8e65-18681194e900"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:10:38.656770 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.656700 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "037c2774-87c7-4153-8e65-18681194e900" (UID: "037c2774-87c7-4153-8e65-18681194e900"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:10:38.656862 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.656837 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-istio-data" (OuterVolumeSpecName: "istio-data") pod "037c2774-87c7-4153-8e65-18681194e900" (UID: "037c2774-87c7-4153-8e65-18681194e900"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:10:38.657025 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.657005 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-workload-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:38.657093 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.657029 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-credential-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:38.657093 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.657044 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-istio-data\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:38.657093 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.657058 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/037c2774-87c7-4153-8e65-18681194e900-istiod-ca-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:38.657093 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.657072 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-workload-certs\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:38.658377 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.658353 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/037c2774-87c7-4153-8e65-18681194e900-istio-token" (OuterVolumeSpecName: "istio-token") pod "037c2774-87c7-4153-8e65-18681194e900" (UID: "037c2774-87c7-4153-8e65-18681194e900"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:10:38.658483 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.658384 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/037c2774-87c7-4153-8e65-18681194e900-kube-api-access-js96c" (OuterVolumeSpecName: "kube-api-access-js96c") pod "037c2774-87c7-4153-8e65-18681194e900" (UID: "037c2774-87c7-4153-8e65-18681194e900"). InnerVolumeSpecName "kube-api-access-js96c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:10:38.658601 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.658581 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "037c2774-87c7-4153-8e65-18681194e900" (UID: "037c2774-87c7-4153-8e65-18681194e900"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:10:38.658601 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.658586 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/037c2774-87c7-4153-8e65-18681194e900-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "037c2774-87c7-4153-8e65-18681194e900" (UID: "037c2774-87c7-4153-8e65-18681194e900"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:10:38.718007 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.717973 2557 generic.go:356] "Generic (PLEG): container finished" podID="037c2774-87c7-4153-8e65-18681194e900" containerID="f39e6d1bacec3cff5fe2917c2e879661a5ffb8749ee74790a2deb79096b6de83" exitCode=0 Jul 17 18:10:38.718191 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.718017 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" Jul 17 18:10:38.718191 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.718016 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" event={"ID":"037c2774-87c7-4153-8e65-18681194e900","Type":"ContainerDied","Data":"f39e6d1bacec3cff5fe2917c2e879661a5ffb8749ee74790a2deb79096b6de83"} Jul 17 18:10:38.718191 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.718152 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn" event={"ID":"037c2774-87c7-4153-8e65-18681194e900","Type":"ContainerDied","Data":"988f2fd2cf64783671e3c8007dafcf0be6de8d143b08a9f00835e76e9e148fcc"} Jul 17 18:10:38.718191 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.718188 2557 scope.go:117] "RemoveContainer" containerID="f39e6d1bacec3cff5fe2917c2e879661a5ffb8749ee74790a2deb79096b6de83" Jul 17 18:10:38.727829 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.727807 2557 scope.go:117] "RemoveContainer" containerID="71a96d24f492f3738457f951595141d34126f6dae0f623658c30f325b433c34d" Jul 17 18:10:38.736249 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.736222 2557 scope.go:117] "RemoveContainer" containerID="f39e6d1bacec3cff5fe2917c2e879661a5ffb8749ee74790a2deb79096b6de83" Jul 17 18:10:38.736511 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:10:38.736490 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f39e6d1bacec3cff5fe2917c2e879661a5ffb8749ee74790a2deb79096b6de83\": container with ID starting with f39e6d1bacec3cff5fe2917c2e879661a5ffb8749ee74790a2deb79096b6de83 not found: ID does not exist" containerID="f39e6d1bacec3cff5fe2917c2e879661a5ffb8749ee74790a2deb79096b6de83" Jul 17 18:10:38.736557 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.736522 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f39e6d1bacec3cff5fe2917c2e879661a5ffb8749ee74790a2deb79096b6de83"} err="failed to get container status \"f39e6d1bacec3cff5fe2917c2e879661a5ffb8749ee74790a2deb79096b6de83\": rpc error: code = NotFound desc = could not find container \"f39e6d1bacec3cff5fe2917c2e879661a5ffb8749ee74790a2deb79096b6de83\": container with ID starting with f39e6d1bacec3cff5fe2917c2e879661a5ffb8749ee74790a2deb79096b6de83 not found: ID does not exist" Jul 17 18:10:38.736557 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.736539 2557 scope.go:117] "RemoveContainer" containerID="71a96d24f492f3738457f951595141d34126f6dae0f623658c30f325b433c34d" Jul 17 18:10:38.736786 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:10:38.736771 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71a96d24f492f3738457f951595141d34126f6dae0f623658c30f325b433c34d\": container with ID starting with 71a96d24f492f3738457f951595141d34126f6dae0f623658c30f325b433c34d not found: ID does not exist" containerID="71a96d24f492f3738457f951595141d34126f6dae0f623658c30f325b433c34d" Jul 17 18:10:38.736834 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.736790 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71a96d24f492f3738457f951595141d34126f6dae0f623658c30f325b433c34d"} err="failed to get container status \"71a96d24f492f3738457f951595141d34126f6dae0f623658c30f325b433c34d\": rpc error: code = NotFound desc = could not find container \"71a96d24f492f3738457f951595141d34126f6dae0f623658c30f325b433c34d\": container with ID starting with 71a96d24f492f3738457f951595141d34126f6dae0f623658c30f325b433c34d not found: ID does not exist" Jul 17 18:10:38.758103 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.758077 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js96c\" (UniqueName: \"kubernetes.io/projected/037c2774-87c7-4153-8e65-18681194e900-kube-api-access-js96c\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:38.758103 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.758100 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037c2774-87c7-4153-8e65-18681194e900-istio-token\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:38.758225 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.758112 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/037c2774-87c7-4153-8e65-18681194e900-istio-podinfo\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:38.758225 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.758120 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/037c2774-87c7-4153-8e65-18681194e900-istio-envoy\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:38.761607 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.761581 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn"] Jul 17 18:10:38.768432 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:38.768387 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-e63578-openshift-default-64495c7847-jt7xn"] Jul 17 18:10:39.878021 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:39.877989 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="037c2774-87c7-4153-8e65-18681194e900" path="/var/lib/kubelet/pods/037c2774-87c7-4153-8e65-18681194e900/volumes" Jul 17 18:10:49.487480 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:49.487444 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn"] Jul 17 18:10:49.487966 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:49.487645 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" podUID="12d1a085-9787-4be6-8212-d9f52b163e02" containerName="istio-proxy" containerID="cri-o://1156ec448dd48862e96272856c6364f945250b70110fbcaf280a85ffb96d1b45" gracePeriod=30 Jul 17 18:10:50.444910 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.444878 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g"] Jul 17 18:10:50.445284 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.445271 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="037c2774-87c7-4153-8e65-18681194e900" containerName="istio-proxy" Jul 17 18:10:50.445331 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.445285 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="037c2774-87c7-4153-8e65-18681194e900" containerName="istio-proxy" Jul 17 18:10:50.445331 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.445306 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="037c2774-87c7-4153-8e65-18681194e900" containerName="istio-proxy" Jul 17 18:10:50.445331 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.445312 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="037c2774-87c7-4153-8e65-18681194e900" containerName="istio-proxy" Jul 17 18:10:50.445432 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.445373 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="037c2774-87c7-4153-8e65-18681194e900" containerName="istio-proxy" Jul 17 18:10:50.445432 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.445384 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="037c2774-87c7-4153-8e65-18681194e900" containerName="istio-proxy" Jul 17 18:10:50.449925 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.449904 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.453798 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.453772 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0a98d9-openshift-default-dockercfg-f9mzq\"" Jul 17 18:10:50.467420 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.467397 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g"] Jul 17 18:10:50.472161 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.472132 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-workload-socket\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.472270 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.472182 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-workload-certs\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.472270 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.472246 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqp49\" (UniqueName: \"kubernetes.io/projected/0c47825c-bff6-4cf9-b944-8fbf28809cbc-kube-api-access-nqp49\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.472396 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.472353 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-envoy\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.472396 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.472386 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-credential-socket\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.472504 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.472415 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-podinfo\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.472504 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.472455 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-data\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.472504 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.472480 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-token\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.472745 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.472549 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istiod-ca-cert\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.573512 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.573475 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istiod-ca-cert\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.573967 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.573533 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-workload-socket\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.573967 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.573559 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-workload-certs\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.573967 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.573576 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqp49\" (UniqueName: \"kubernetes.io/projected/0c47825c-bff6-4cf9-b944-8fbf28809cbc-kube-api-access-nqp49\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.573967 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.573627 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-envoy\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.573967 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.573643 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-credential-socket\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.573967 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.573665 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-podinfo\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.573967 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.573710 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-data\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.573967 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.573732 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-token\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.574402 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.574033 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-workload-socket\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.574402 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.574194 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-credential-socket\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.574402 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.574234 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-workload-certs\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.574402 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.574347 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istiod-ca-cert\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.574582 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.574466 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-data\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.576080 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.576054 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-envoy\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.576366 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.576347 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-podinfo\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.582571 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.582544 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-token\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.583358 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.583339 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqp49\" (UniqueName: \"kubernetes.io/projected/0c47825c-bff6-4cf9-b944-8fbf28809cbc-kube-api-access-nqp49\") pod \"e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.761024 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.760902 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:50.923016 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.922991 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g"] Jul 17 18:10:50.924333 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:10:50.924306 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c47825c_bff6_4cf9_b944_8fbf28809cbc.slice/crio-d6d354fbbae05df8c166a4b257568cb0b794ebef62db7eb70204531f08eb045f WatchSource:0}: Error finding container d6d354fbbae05df8c166a4b257568cb0b794ebef62db7eb70204531f08eb045f: Status 404 returned error can't find the container with id d6d354fbbae05df8c166a4b257568cb0b794ebef62db7eb70204531f08eb045f Jul 17 18:10:50.926434 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.926398 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:10:50.926528 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.926477 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:10:50.926590 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:50.926545 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:10:51.790258 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:51.790221 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" event={"ID":"0c47825c-bff6-4cf9-b944-8fbf28809cbc","Type":"ContainerStarted","Data":"5100b7fe0ed3b73eba4864ac9362d69121df1ea383dc6a17bc9cfdcc243109b0"} Jul 17 18:10:51.790648 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:51.790282 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" event={"ID":"0c47825c-bff6-4cf9-b944-8fbf28809cbc","Type":"ContainerStarted","Data":"d6d354fbbae05df8c166a4b257568cb0b794ebef62db7eb70204531f08eb045f"} Jul 17 18:10:51.814772 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:51.814723 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" podStartSLOduration=1.8147086529999998 podStartE2EDuration="1.814708653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:10:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:51.814038448 +0000 UTC m=+2420.424707829" watchObservedRunningTime="2026-07-17 18:10:51.814708653 +0000 UTC m=+2420.425378027" Jul 17 18:10:52.761332 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:52.761300 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:52.766644 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:52.766616 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:52.796204 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:52.796177 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:52.797249 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:52.797225 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:10:54.749886 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.749826 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:54.809092 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.809057 2557 generic.go:356] "Generic (PLEG): container finished" podID="12d1a085-9787-4be6-8212-d9f52b163e02" containerID="1156ec448dd48862e96272856c6364f945250b70110fbcaf280a85ffb96d1b45" exitCode=0 Jul 17 18:10:54.809263 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.809109 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" Jul 17 18:10:54.809263 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.809143 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" event={"ID":"12d1a085-9787-4be6-8212-d9f52b163e02","Type":"ContainerDied","Data":"1156ec448dd48862e96272856c6364f945250b70110fbcaf280a85ffb96d1b45"} Jul 17 18:10:54.809263 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.809202 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn" event={"ID":"12d1a085-9787-4be6-8212-d9f52b163e02","Type":"ContainerDied","Data":"cb8b27e87f99cb4d012947fd48fb6cf579f0b10ee0245fb77af69bd2facdf800"} Jul 17 18:10:54.809263 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.809225 2557 scope.go:117] "RemoveContainer" containerID="1156ec448dd48862e96272856c6364f945250b70110fbcaf280a85ffb96d1b45" Jul 17 18:10:54.813310 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.813291 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12d1a085-9787-4be6-8212-d9f52b163e02-istio-podinfo\") pod \"12d1a085-9787-4be6-8212-d9f52b163e02\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " Jul 17 18:10:54.813429 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.813345 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-istio-data\") pod \"12d1a085-9787-4be6-8212-d9f52b163e02\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " Jul 17 18:10:54.813489 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.813470 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-workload-socket\") pod \"12d1a085-9787-4be6-8212-d9f52b163e02\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " Jul 17 18:10:54.813547 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.813505 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d1a085-9787-4be6-8212-d9f52b163e02-istio-token\") pod \"12d1a085-9787-4be6-8212-d9f52b163e02\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " Jul 17 18:10:54.813601 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.813557 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12d1a085-9787-4be6-8212-d9f52b163e02-istiod-ca-cert\") pod \"12d1a085-9787-4be6-8212-d9f52b163e02\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " Jul 17 18:10:54.813660 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.813602 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-credential-socket\") pod \"12d1a085-9787-4be6-8212-d9f52b163e02\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " Jul 17 18:10:54.813660 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.813642 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-workload-certs\") pod \"12d1a085-9787-4be6-8212-d9f52b163e02\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " Jul 17 18:10:54.813806 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.813723 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4km74\" (UniqueName: \"kubernetes.io/projected/12d1a085-9787-4be6-8212-d9f52b163e02-kube-api-access-4km74\") pod \"12d1a085-9787-4be6-8212-d9f52b163e02\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " Jul 17 18:10:54.813806 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.813776 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-istio-envoy\") pod \"12d1a085-9787-4be6-8212-d9f52b163e02\" (UID: \"12d1a085-9787-4be6-8212-d9f52b163e02\") " Jul 17 18:10:54.814251 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.813943 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12d1a085-9787-4be6-8212-d9f52b163e02" (UID: "12d1a085-9787-4be6-8212-d9f52b163e02"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:10:54.814251 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.814140 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-credential-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:54.814251 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.814182 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12d1a085-9787-4be6-8212-d9f52b163e02" (UID: "12d1a085-9787-4be6-8212-d9f52b163e02"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:10:54.814461 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.814282 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12d1a085-9787-4be6-8212-d9f52b163e02-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12d1a085-9787-4be6-8212-d9f52b163e02" (UID: "12d1a085-9787-4be6-8212-d9f52b163e02"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:10:54.814524 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.814474 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12d1a085-9787-4be6-8212-d9f52b163e02" (UID: "12d1a085-9787-4be6-8212-d9f52b163e02"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:10:54.814524 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.814504 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-istio-data" (OuterVolumeSpecName: "istio-data") pod "12d1a085-9787-4be6-8212-d9f52b163e02" (UID: "12d1a085-9787-4be6-8212-d9f52b163e02"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:10:54.815583 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.815563 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12d1a085-9787-4be6-8212-d9f52b163e02-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12d1a085-9787-4be6-8212-d9f52b163e02" (UID: "12d1a085-9787-4be6-8212-d9f52b163e02"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:10:54.816448 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.816428 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12d1a085-9787-4be6-8212-d9f52b163e02" (UID: "12d1a085-9787-4be6-8212-d9f52b163e02"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:10:54.816527 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.816452 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12d1a085-9787-4be6-8212-d9f52b163e02-istio-token" (OuterVolumeSpecName: "istio-token") pod "12d1a085-9787-4be6-8212-d9f52b163e02" (UID: "12d1a085-9787-4be6-8212-d9f52b163e02"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:10:54.816663 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.816641 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12d1a085-9787-4be6-8212-d9f52b163e02-kube-api-access-4km74" (OuterVolumeSpecName: "kube-api-access-4km74") pod "12d1a085-9787-4be6-8212-d9f52b163e02" (UID: "12d1a085-9787-4be6-8212-d9f52b163e02"). InnerVolumeSpecName "kube-api-access-4km74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:10:54.820315 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.820285 2557 scope.go:117] "RemoveContainer" containerID="cc9b013f6868a0f279d2be9573c0036b0de6791ec6d4c0cfc11a454c7388c178" Jul 17 18:10:54.837108 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.837086 2557 scope.go:117] "RemoveContainer" containerID="1156ec448dd48862e96272856c6364f945250b70110fbcaf280a85ffb96d1b45" Jul 17 18:10:54.837385 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:10:54.837362 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1156ec448dd48862e96272856c6364f945250b70110fbcaf280a85ffb96d1b45\": container with ID starting with 1156ec448dd48862e96272856c6364f945250b70110fbcaf280a85ffb96d1b45 not found: ID does not exist" containerID="1156ec448dd48862e96272856c6364f945250b70110fbcaf280a85ffb96d1b45" Jul 17 18:10:54.837448 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.837399 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1156ec448dd48862e96272856c6364f945250b70110fbcaf280a85ffb96d1b45"} err="failed to get container status \"1156ec448dd48862e96272856c6364f945250b70110fbcaf280a85ffb96d1b45\": rpc error: code = NotFound desc = could not find container \"1156ec448dd48862e96272856c6364f945250b70110fbcaf280a85ffb96d1b45\": container with ID starting with 1156ec448dd48862e96272856c6364f945250b70110fbcaf280a85ffb96d1b45 not found: ID does not exist" Jul 17 18:10:54.837448 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.837420 2557 scope.go:117] "RemoveContainer" containerID="cc9b013f6868a0f279d2be9573c0036b0de6791ec6d4c0cfc11a454c7388c178" Jul 17 18:10:54.837772 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:10:54.837661 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc9b013f6868a0f279d2be9573c0036b0de6791ec6d4c0cfc11a454c7388c178\": container with ID starting with cc9b013f6868a0f279d2be9573c0036b0de6791ec6d4c0cfc11a454c7388c178 not found: ID does not exist" containerID="cc9b013f6868a0f279d2be9573c0036b0de6791ec6d4c0cfc11a454c7388c178" Jul 17 18:10:54.837772 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.837704 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc9b013f6868a0f279d2be9573c0036b0de6791ec6d4c0cfc11a454c7388c178"} err="failed to get container status \"cc9b013f6868a0f279d2be9573c0036b0de6791ec6d4c0cfc11a454c7388c178\": rpc error: code = NotFound desc = could not find container \"cc9b013f6868a0f279d2be9573c0036b0de6791ec6d4c0cfc11a454c7388c178\": container with ID starting with cc9b013f6868a0f279d2be9573c0036b0de6791ec6d4c0cfc11a454c7388c178 not found: ID does not exist" Jul 17 18:10:54.915388 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.915342 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-istio-envoy\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:54.915388 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.915383 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12d1a085-9787-4be6-8212-d9f52b163e02-istio-podinfo\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:54.915388 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.915396 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-istio-data\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:54.915617 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.915409 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-workload-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:54.915617 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.915423 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d1a085-9787-4be6-8212-d9f52b163e02-istio-token\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:54.915617 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.915438 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12d1a085-9787-4be6-8212-d9f52b163e02-istiod-ca-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:54.915617 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.915450 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d1a085-9787-4be6-8212-d9f52b163e02-workload-certs\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:54.915617 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:54.915465 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4km74\" (UniqueName: \"kubernetes.io/projected/12d1a085-9787-4be6-8212-d9f52b163e02-kube-api-access-4km74\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:10:55.153556 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:55.153519 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn"] Jul 17 18:10:55.161410 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:55.161383 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c9e4ef-openshift-default-55795f6d49-kqtbn"] Jul 17 18:10:55.878638 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:55.878607 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12d1a085-9787-4be6-8212-d9f52b163e02" path="/var/lib/kubelet/pods/12d1a085-9787-4be6-8212-d9f52b163e02/volumes" Jul 17 18:10:59.035512 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.035472 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p"] Jul 17 18:10:59.035911 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.035897 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12d1a085-9787-4be6-8212-d9f52b163e02" containerName="istio-proxy" Jul 17 18:10:59.035911 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.035913 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="12d1a085-9787-4be6-8212-d9f52b163e02" containerName="istio-proxy" Jul 17 18:10:59.036003 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.035926 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12d1a085-9787-4be6-8212-d9f52b163e02" containerName="istio-proxy" Jul 17 18:10:59.036003 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.035931 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="12d1a085-9787-4be6-8212-d9f52b163e02" containerName="istio-proxy" Jul 17 18:10:59.036066 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.036007 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="12d1a085-9787-4be6-8212-d9f52b163e02" containerName="istio-proxy" Jul 17 18:10:59.036066 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.036017 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="12d1a085-9787-4be6-8212-d9f52b163e02" containerName="istio-proxy" Jul 17 18:10:59.040471 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.040450 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.043717 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.043699 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-37d0b7-openshift-default-dockercfg-s29nl\"" Jul 17 18:10:59.054637 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.054615 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p"] Jul 17 18:10:59.156162 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.156122 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-workload-certs\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.156378 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.156214 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-workload-socket\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.156378 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.156260 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c07476da-f7a1-46ea-b532-29b559341e5e-istio-podinfo\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.156378 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.156291 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c07476da-f7a1-46ea-b532-29b559341e5e-istio-token\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.156378 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.156315 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-istio-envoy\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.156378 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.156338 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-istio-data\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.156378 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.156361 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c07476da-f7a1-46ea-b532-29b559341e5e-istiod-ca-cert\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.156622 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.156395 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c458g\" (UniqueName: \"kubernetes.io/projected/c07476da-f7a1-46ea-b532-29b559341e5e-kube-api-access-c458g\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.156622 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.156496 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-credential-socket\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.257796 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.257758 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-workload-certs\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.257796 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.257801 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-workload-socket\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.258041 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.257821 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c07476da-f7a1-46ea-b532-29b559341e5e-istio-podinfo\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.258041 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.257841 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c07476da-f7a1-46ea-b532-29b559341e5e-istio-token\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.258041 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.257857 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-istio-envoy\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.258041 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.257872 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-istio-data\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.258041 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.257889 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c07476da-f7a1-46ea-b532-29b559341e5e-istiod-ca-cert\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.258041 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.257927 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c458g\" (UniqueName: \"kubernetes.io/projected/c07476da-f7a1-46ea-b532-29b559341e5e-kube-api-access-c458g\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.258041 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.257995 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-credential-socket\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.258384 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.258232 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-workload-certs\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.258384 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.258297 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-workload-socket\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.258384 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.258359 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-istio-data\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.258536 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.258438 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-credential-socket\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.258873 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.258853 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c07476da-f7a1-46ea-b532-29b559341e5e-istiod-ca-cert\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.260364 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.260342 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-istio-envoy\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.260410 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.260366 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c07476da-f7a1-46ea-b532-29b559341e5e-istio-podinfo\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.278669 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.278634 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c07476da-f7a1-46ea-b532-29b559341e5e-istio-token\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.278818 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.278786 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c458g\" (UniqueName: \"kubernetes.io/projected/c07476da-f7a1-46ea-b532-29b559341e5e-kube-api-access-c458g\") pod \"e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.350842 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.350811 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:10:59.499250 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.499221 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p"] Jul 17 18:10:59.501223 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:10:59.501192 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc07476da_f7a1_46ea_b532_29b559341e5e.slice/crio-e5a17b6b2c5b8e33e84057a5037e3d39b5bb7bae7c993255d5bc15b087666a70 WatchSource:0}: Error finding container e5a17b6b2c5b8e33e84057a5037e3d39b5bb7bae7c993255d5bc15b087666a70: Status 404 returned error can't find the container with id e5a17b6b2c5b8e33e84057a5037e3d39b5bb7bae7c993255d5bc15b087666a70 Jul 17 18:10:59.503298 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.503265 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:10:59.503374 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.503328 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:10:59.503374 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.503357 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:10:59.836398 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.836355 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" event={"ID":"c07476da-f7a1-46ea-b532-29b559341e5e","Type":"ContainerStarted","Data":"3167d77f1ec0cb7fff23ec512437d2241aa5325bf199b49157d8778541730d96"} Jul 17 18:10:59.836567 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.836422 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" event={"ID":"c07476da-f7a1-46ea-b532-29b559341e5e","Type":"ContainerStarted","Data":"e5a17b6b2c5b8e33e84057a5037e3d39b5bb7bae7c993255d5bc15b087666a70"} Jul 17 18:10:59.859673 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:10:59.859620 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" podStartSLOduration=0.859604245 podStartE2EDuration="859.604245ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:10:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:59.858794763 +0000 UTC m=+2428.469464147" watchObservedRunningTime="2026-07-17 18:10:59.859604245 +0000 UTC m=+2428.470273627" Jul 17 18:11:00.351770 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:00.351739 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:11:00.356788 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:00.356762 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:11:00.841777 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:00.841751 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:11:00.842859 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:00.842839 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:11:00.912450 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:00.912417 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx"] Jul 17 18:11:00.916205 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:00.916184 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" Jul 17 18:11:00.921509 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:00.921484 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-37d0b7-serving-cert\"" Jul 17 18:11:00.939410 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:00.939384 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx"] Jul 17 18:11:00.975556 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:00.975235 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0bc9caf-a173-4b2b-9bc4-5408a3ee7015-openshift-service-ca\") pod \"maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx\" (UID: \"d0bc9caf-a173-4b2b-9bc4-5408a3ee7015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" Jul 17 18:11:00.975556 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:00.975271 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0bc9caf-a173-4b2b-9bc4-5408a3ee7015-maas-api-tls\") pod \"maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx\" (UID: \"d0bc9caf-a173-4b2b-9bc4-5408a3ee7015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" Jul 17 18:11:00.975556 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:00.975342 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhjjq\" (UniqueName: \"kubernetes.io/projected/d0bc9caf-a173-4b2b-9bc4-5408a3ee7015-kube-api-access-lhjjq\") pod \"maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx\" (UID: \"d0bc9caf-a173-4b2b-9bc4-5408a3ee7015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" Jul 17 18:11:01.076883 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:01.076833 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0bc9caf-a173-4b2b-9bc4-5408a3ee7015-openshift-service-ca\") pod \"maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx\" (UID: \"d0bc9caf-a173-4b2b-9bc4-5408a3ee7015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" Jul 17 18:11:01.077085 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:01.076889 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0bc9caf-a173-4b2b-9bc4-5408a3ee7015-maas-api-tls\") pod \"maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx\" (UID: \"d0bc9caf-a173-4b2b-9bc4-5408a3ee7015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" Jul 17 18:11:01.077622 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:01.076942 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhjjq\" (UniqueName: \"kubernetes.io/projected/d0bc9caf-a173-4b2b-9bc4-5408a3ee7015-kube-api-access-lhjjq\") pod \"maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx\" (UID: \"d0bc9caf-a173-4b2b-9bc4-5408a3ee7015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" Jul 17 18:11:01.078011 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:01.077673 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0bc9caf-a173-4b2b-9bc4-5408a3ee7015-openshift-service-ca\") pod \"maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx\" (UID: \"d0bc9caf-a173-4b2b-9bc4-5408a3ee7015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" Jul 17 18:11:01.089215 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:01.083721 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0bc9caf-a173-4b2b-9bc4-5408a3ee7015-maas-api-tls\") pod \"maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx\" (UID: \"d0bc9caf-a173-4b2b-9bc4-5408a3ee7015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" Jul 17 18:11:01.094327 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:01.093566 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhjjq\" (UniqueName: \"kubernetes.io/projected/d0bc9caf-a173-4b2b-9bc4-5408a3ee7015-kube-api-access-lhjjq\") pod \"maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx\" (UID: \"d0bc9caf-a173-4b2b-9bc4-5408a3ee7015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" Jul 17 18:11:01.228879 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:01.228846 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" Jul 17 18:11:01.383009 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:01.382983 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx"] Jul 17 18:11:01.385724 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:11:01.385667 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0bc9caf_a173_4b2b_9bc4_5408a3ee7015.slice/crio-7b1c5b282e99f6a846bce7f5a99a15118cfc38fb08a9523b1adb40f56127da5e WatchSource:0}: Error finding container 7b1c5b282e99f6a846bce7f5a99a15118cfc38fb08a9523b1adb40f56127da5e: Status 404 returned error can't find the container with id 7b1c5b282e99f6a846bce7f5a99a15118cfc38fb08a9523b1adb40f56127da5e Jul 17 18:11:01.847755 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:01.847716 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" event={"ID":"d0bc9caf-a173-4b2b-9bc4-5408a3ee7015","Type":"ContainerStarted","Data":"7b1c5b282e99f6a846bce7f5a99a15118cfc38fb08a9523b1adb40f56127da5e"} Jul 17 18:11:02.856349 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:02.856316 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" event={"ID":"d0bc9caf-a173-4b2b-9bc4-5408a3ee7015","Type":"ContainerStarted","Data":"8570ceba2e34d16168d38dc44d3773b13da9c18bdf238ea3488862c1afddf83e"} Jul 17 18:11:02.856781 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:02.856385 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" Jul 17 18:11:02.878987 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:02.878936 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" podStartSLOduration=2.379957963 podStartE2EDuration="2.878921035s" totalImagesPullingTime="498.963072ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:11:02.877265516 +0000 UTC m=+2431.487934901" watchObservedRunningTime="2026-07-17 18:11:02.878921035 +0000 UTC m=+2431.489590417" Jul 17 18:11:08.838901 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:08.838856 2557 patch_prober.go:28] interesting pod/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 17 18:11:08.839312 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:08.838944 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" podUID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 17 18:11:08.868205 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:08.868177 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx" Jul 17 18:11:10.904563 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:10.904523 2557 generic.go:356] "Generic (PLEG): container finished" podID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" containerID="5100b7fe0ed3b73eba4864ac9362d69121df1ea383dc6a17bc9cfdcc243109b0" exitCode=0 Jul 17 18:11:10.905011 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:10.904587 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" event={"ID":"0c47825c-bff6-4cf9-b944-8fbf28809cbc","Type":"ContainerDied","Data":"5100b7fe0ed3b73eba4864ac9362d69121df1ea383dc6a17bc9cfdcc243109b0"} Jul 17 18:11:10.905011 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:10.904996 2557 scope.go:117] "RemoveContainer" containerID="5100b7fe0ed3b73eba4864ac9362d69121df1ea383dc6a17bc9cfdcc243109b0" Jul 17 18:11:10.906124 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:10.906085 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:11:10.906240 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:10.906196 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:11:10.906240 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:10.906233 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:11:11.918373 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:11.918337 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" event={"ID":"0c47825c-bff6-4cf9-b944-8fbf28809cbc","Type":"ContainerStarted","Data":"d5e59122438583b0e8bcadac94cc5d1c9c41b2cdec0e6bf064ffa0bbc66b13d3"} Jul 17 18:11:12.761726 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:12.761668 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:11:12.761904 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:12.761851 2557 patch_prober.go:28] interesting pod/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 17 18:11:12.761950 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:12.761897 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" podUID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 17 18:11:13.762261 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:13.762221 2557 patch_prober.go:28] interesting pod/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 17 18:11:13.762721 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:13.762283 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" podUID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 17 18:11:14.761604 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:14.761517 2557 patch_prober.go:28] interesting pod/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 17 18:11:14.761604 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:14.761573 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" podUID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 17 18:11:15.761364 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:15.761318 2557 patch_prober.go:28] interesting pod/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 17 18:11:15.761769 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:15.761394 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" podUID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 17 18:11:16.765369 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:16.765337 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:11:16.765772 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:16.765722 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:11:16.766372 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:16.766351 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:11:16.883832 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:16.883790 2557 patch_prober.go:28] interesting pod/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 17 18:11:16.884013 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:16.883847 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" podUID="c07476da-f7a1-46ea-b532-29b559341e5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 17 18:11:17.961509 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:17.961475 2557 generic.go:356] "Generic (PLEG): container finished" podID="c07476da-f7a1-46ea-b532-29b559341e5e" containerID="3167d77f1ec0cb7fff23ec512437d2241aa5325bf199b49157d8778541730d96" exitCode=0 Jul 17 18:11:17.961944 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:17.961544 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" event={"ID":"c07476da-f7a1-46ea-b532-29b559341e5e","Type":"ContainerDied","Data":"3167d77f1ec0cb7fff23ec512437d2241aa5325bf199b49157d8778541730d96"} Jul 17 18:11:17.962115 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:17.962098 2557 scope.go:117] "RemoveContainer" containerID="3167d77f1ec0cb7fff23ec512437d2241aa5325bf199b49157d8778541730d96" Jul 17 18:11:17.963062 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:17.963035 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:11:17.963117 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:17.963105 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:11:17.963154 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:17.963138 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:11:18.968659 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:18.968620 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" event={"ID":"c07476da-f7a1-46ea-b532-29b559341e5e","Type":"ContainerStarted","Data":"d2f158a47e2415b04a025b98afc8fa94e273de041d36bf18dcd4fdd793c81d9a"} Jul 17 18:11:19.351423 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:19.351394 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:11:19.351583 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:19.351557 2557 patch_prober.go:28] interesting pod/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 17 18:11:19.351623 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:19.351603 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" podUID="c07476da-f7a1-46ea-b532-29b559341e5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 17 18:11:20.351808 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:20.351769 2557 patch_prober.go:28] interesting pod/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 17 18:11:20.352269 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:20.351825 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" podUID="c07476da-f7a1-46ea-b532-29b559341e5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 17 18:11:21.351339 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:21.351301 2557 patch_prober.go:28] interesting pod/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 17 18:11:21.351524 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:21.351355 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" podUID="c07476da-f7a1-46ea-b532-29b559341e5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 17 18:11:22.351220 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:22.351182 2557 patch_prober.go:28] interesting pod/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 17 18:11:22.351606 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:22.351238 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" podUID="c07476da-f7a1-46ea-b532-29b559341e5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 17 18:11:23.355186 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:23.355156 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:11:23.355665 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:23.355534 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:11:23.356181 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:11:23.356159 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:15:32.090092 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:15:32.090064 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 18:15:32.098792 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:15:32.098767 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 18:17:28.195773 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:28.195725 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g"] Jul 17 18:17:28.196362 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:28.196033 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" podUID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" containerName="istio-proxy" containerID="cri-o://d5e59122438583b0e8bcadac94cc5d1c9c41b2cdec0e6bf064ffa0bbc66b13d3" gracePeriod=30 Jul 17 18:17:31.767931 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:31.767889 2557 patch_prober.go:28] interesting pod/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 18:17:31.768313 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:31.767953 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" podUID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 18:17:33.461537 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.461469 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:17:33.648764 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.648734 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-workload-certs\") pod \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " Jul 17 18:17:33.648952 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.648778 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-envoy\") pod \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " Jul 17 18:17:33.648952 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.648808 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-token\") pod \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " Jul 17 18:17:33.648952 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.648844 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-podinfo\") pod \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " Jul 17 18:17:33.648952 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.648873 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-data\") pod \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " Jul 17 18:17:33.648952 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.648914 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-credential-socket\") pod \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " Jul 17 18:17:33.648952 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.648944 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-workload-socket\") pod \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " Jul 17 18:17:33.649290 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.649011 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqp49\" (UniqueName: \"kubernetes.io/projected/0c47825c-bff6-4cf9-b944-8fbf28809cbc-kube-api-access-nqp49\") pod \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " Jul 17 18:17:33.649290 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.649021 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c47825c-bff6-4cf9-b944-8fbf28809cbc" (UID: "0c47825c-bff6-4cf9-b944-8fbf28809cbc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:33.649290 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.649037 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istiod-ca-cert\") pod \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\" (UID: \"0c47825c-bff6-4cf9-b944-8fbf28809cbc\") " Jul 17 18:17:33.649290 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.649212 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c47825c-bff6-4cf9-b944-8fbf28809cbc" (UID: "0c47825c-bff6-4cf9-b944-8fbf28809cbc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:33.649491 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.649316 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c47825c-bff6-4cf9-b944-8fbf28809cbc" (UID: "0c47825c-bff6-4cf9-b944-8fbf28809cbc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:33.649491 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.649336 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c47825c-bff6-4cf9-b944-8fbf28809cbc" (UID: "0c47825c-bff6-4cf9-b944-8fbf28809cbc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:17:33.649664 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.649530 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-credential-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:33.649664 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.649552 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-workload-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:33.649664 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.649567 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istiod-ca-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:33.649664 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.649581 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-workload-certs\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:33.649869 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.649757 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c47825c-bff6-4cf9-b944-8fbf28809cbc" (UID: "0c47825c-bff6-4cf9-b944-8fbf28809cbc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:33.651163 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.651137 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c47825c-bff6-4cf9-b944-8fbf28809cbc" (UID: "0c47825c-bff6-4cf9-b944-8fbf28809cbc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:33.651389 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.651370 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c47825c-bff6-4cf9-b944-8fbf28809cbc" (UID: "0c47825c-bff6-4cf9-b944-8fbf28809cbc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:17:33.651535 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.651516 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c47825c-bff6-4cf9-b944-8fbf28809cbc-kube-api-access-nqp49" (OuterVolumeSpecName: "kube-api-access-nqp49") pod "0c47825c-bff6-4cf9-b944-8fbf28809cbc" (UID: "0c47825c-bff6-4cf9-b944-8fbf28809cbc"). InnerVolumeSpecName "kube-api-access-nqp49". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:17:33.651612 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.651528 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c47825c-bff6-4cf9-b944-8fbf28809cbc" (UID: "0c47825c-bff6-4cf9-b944-8fbf28809cbc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:17:33.751130 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.751048 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-token\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:33.751130 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.751078 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-podinfo\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:33.751130 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.751087 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-data\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:33.751130 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.751097 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqp49\" (UniqueName: \"kubernetes.io/projected/0c47825c-bff6-4cf9-b944-8fbf28809cbc-kube-api-access-nqp49\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:33.751130 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.751105 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c47825c-bff6-4cf9-b944-8fbf28809cbc-istio-envoy\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:33.926422 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.926385 2557 generic.go:356] "Generic (PLEG): container finished" podID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" containerID="d5e59122438583b0e8bcadac94cc5d1c9c41b2cdec0e6bf064ffa0bbc66b13d3" exitCode=0 Jul 17 18:17:33.926597 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.926457 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" Jul 17 18:17:33.926597 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.926468 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" event={"ID":"0c47825c-bff6-4cf9-b944-8fbf28809cbc","Type":"ContainerDied","Data":"d5e59122438583b0e8bcadac94cc5d1c9c41b2cdec0e6bf064ffa0bbc66b13d3"} Jul 17 18:17:33.926597 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.926551 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g" event={"ID":"0c47825c-bff6-4cf9-b944-8fbf28809cbc","Type":"ContainerDied","Data":"d6d354fbbae05df8c166a4b257568cb0b794ebef62db7eb70204531f08eb045f"} Jul 17 18:17:33.926749 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.926570 2557 scope.go:117] "RemoveContainer" containerID="d5e59122438583b0e8bcadac94cc5d1c9c41b2cdec0e6bf064ffa0bbc66b13d3" Jul 17 18:17:33.935606 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.935583 2557 scope.go:117] "RemoveContainer" containerID="5100b7fe0ed3b73eba4864ac9362d69121df1ea383dc6a17bc9cfdcc243109b0" Jul 17 18:17:33.944645 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.944510 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g"] Jul 17 18:17:33.944984 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.944954 2557 scope.go:117] "RemoveContainer" containerID="d5e59122438583b0e8bcadac94cc5d1c9c41b2cdec0e6bf064ffa0bbc66b13d3" Jul 17 18:17:33.945283 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:17:33.945265 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5e59122438583b0e8bcadac94cc5d1c9c41b2cdec0e6bf064ffa0bbc66b13d3\": container with ID starting with d5e59122438583b0e8bcadac94cc5d1c9c41b2cdec0e6bf064ffa0bbc66b13d3 not found: ID does not exist" containerID="d5e59122438583b0e8bcadac94cc5d1c9c41b2cdec0e6bf064ffa0bbc66b13d3" Jul 17 18:17:33.945346 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.945291 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e59122438583b0e8bcadac94cc5d1c9c41b2cdec0e6bf064ffa0bbc66b13d3"} err="failed to get container status \"d5e59122438583b0e8bcadac94cc5d1c9c41b2cdec0e6bf064ffa0bbc66b13d3\": rpc error: code = NotFound desc = could not find container \"d5e59122438583b0e8bcadac94cc5d1c9c41b2cdec0e6bf064ffa0bbc66b13d3\": container with ID starting with d5e59122438583b0e8bcadac94cc5d1c9c41b2cdec0e6bf064ffa0bbc66b13d3 not found: ID does not exist" Jul 17 18:17:33.945346 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.945307 2557 scope.go:117] "RemoveContainer" containerID="5100b7fe0ed3b73eba4864ac9362d69121df1ea383dc6a17bc9cfdcc243109b0" Jul 17 18:17:33.945540 ip-10-0-130-245 kubenswrapper[2557]: E0717 18:17:33.945524 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5100b7fe0ed3b73eba4864ac9362d69121df1ea383dc6a17bc9cfdcc243109b0\": container with ID starting with 5100b7fe0ed3b73eba4864ac9362d69121df1ea383dc6a17bc9cfdcc243109b0 not found: ID does not exist" containerID="5100b7fe0ed3b73eba4864ac9362d69121df1ea383dc6a17bc9cfdcc243109b0" Jul 17 18:17:33.945581 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.945542 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5100b7fe0ed3b73eba4864ac9362d69121df1ea383dc6a17bc9cfdcc243109b0"} err="failed to get container status \"5100b7fe0ed3b73eba4864ac9362d69121df1ea383dc6a17bc9cfdcc243109b0\": rpc error: code = NotFound desc = could not find container \"5100b7fe0ed3b73eba4864ac9362d69121df1ea383dc6a17bc9cfdcc243109b0\": container with ID starting with 5100b7fe0ed3b73eba4864ac9362d69121df1ea383dc6a17bc9cfdcc243109b0 not found: ID does not exist" Jul 17 18:17:33.947203 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:33.947183 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0a98d9-openshift-default-686894667f-mcn4g"] Jul 17 18:17:35.728581 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:35.728550 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p"] Jul 17 18:17:35.728998 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:35.728774 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" podUID="c07476da-f7a1-46ea-b532-29b559341e5e" containerName="istio-proxy" containerID="cri-o://d2f158a47e2415b04a025b98afc8fa94e273de041d36bf18dcd4fdd793c81d9a" gracePeriod=30 Jul 17 18:17:35.878544 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:35.878508 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" path="/var/lib/kubelet/pods/0c47825c-bff6-4cf9-b944-8fbf28809cbc/volumes" Jul 17 18:17:36.424687 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:36.424640 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-849b75d88f-t8pjf_5caa57cd-5a11-4443-8036-74871c015526/authorino/0.log" Jul 17 18:17:38.357720 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:38.357662 2557 patch_prober.go:28] interesting pod/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 18:17:38.358100 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:38.357737 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" podUID="c07476da-f7a1-46ea-b532-29b559341e5e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 18:17:40.967968 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:40.967934 2557 generic.go:356] "Generic (PLEG): container finished" podID="c07476da-f7a1-46ea-b532-29b559341e5e" containerID="d2f158a47e2415b04a025b98afc8fa94e273de041d36bf18dcd4fdd793c81d9a" exitCode=0 Jul 17 18:17:40.968352 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:40.968001 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" event={"ID":"c07476da-f7a1-46ea-b532-29b559341e5e","Type":"ContainerDied","Data":"d2f158a47e2415b04a025b98afc8fa94e273de041d36bf18dcd4fdd793c81d9a"} Jul 17 18:17:40.968352 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:40.968061 2557 scope.go:117] "RemoveContainer" containerID="3167d77f1ec0cb7fff23ec512437d2241aa5325bf199b49157d8778541730d96" Jul 17 18:17:41.008063 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.008038 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:17:41.106774 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.106739 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-workload-socket\") pod \"c07476da-f7a1-46ea-b532-29b559341e5e\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " Jul 17 18:17:41.106774 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.106789 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-workload-certs\") pod \"c07476da-f7a1-46ea-b532-29b559341e5e\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " Jul 17 18:17:41.107043 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.106813 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-credential-socket\") pod \"c07476da-f7a1-46ea-b532-29b559341e5e\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " Jul 17 18:17:41.107043 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.106857 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-istio-data\") pod \"c07476da-f7a1-46ea-b532-29b559341e5e\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " Jul 17 18:17:41.107043 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.106881 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c07476da-f7a1-46ea-b532-29b559341e5e-istio-token\") pod \"c07476da-f7a1-46ea-b532-29b559341e5e\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " Jul 17 18:17:41.107043 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.106931 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c458g\" (UniqueName: \"kubernetes.io/projected/c07476da-f7a1-46ea-b532-29b559341e5e-kube-api-access-c458g\") pod \"c07476da-f7a1-46ea-b532-29b559341e5e\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " Jul 17 18:17:41.107043 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.106984 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-istio-envoy\") pod \"c07476da-f7a1-46ea-b532-29b559341e5e\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " Jul 17 18:17:41.107043 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.107023 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c07476da-f7a1-46ea-b532-29b559341e5e-istio-podinfo\") pod \"c07476da-f7a1-46ea-b532-29b559341e5e\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " Jul 17 18:17:41.107358 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.107060 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c07476da-f7a1-46ea-b532-29b559341e5e" (UID: "c07476da-f7a1-46ea-b532-29b559341e5e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:41.107358 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.107072 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c07476da-f7a1-46ea-b532-29b559341e5e-istiod-ca-cert\") pod \"c07476da-f7a1-46ea-b532-29b559341e5e\" (UID: \"c07476da-f7a1-46ea-b532-29b559341e5e\") " Jul 17 18:17:41.107358 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.107097 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c07476da-f7a1-46ea-b532-29b559341e5e" (UID: "c07476da-f7a1-46ea-b532-29b559341e5e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:41.107358 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.107201 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c07476da-f7a1-46ea-b532-29b559341e5e" (UID: "c07476da-f7a1-46ea-b532-29b559341e5e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:41.107572 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.107439 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c07476da-f7a1-46ea-b532-29b559341e5e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c07476da-f7a1-46ea-b532-29b559341e5e" (UID: "c07476da-f7a1-46ea-b532-29b559341e5e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:17:41.107572 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.107519 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-workload-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:41.107572 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.107541 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-workload-certs\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:41.107572 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.107555 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-credential-socket\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:41.108121 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.108091 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-istio-data" (OuterVolumeSpecName: "istio-data") pod "c07476da-f7a1-46ea-b532-29b559341e5e" (UID: "c07476da-f7a1-46ea-b532-29b559341e5e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:41.109256 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.109227 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c07476da-f7a1-46ea-b532-29b559341e5e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c07476da-f7a1-46ea-b532-29b559341e5e" (UID: "c07476da-f7a1-46ea-b532-29b559341e5e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:17:41.109367 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.109348 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c07476da-f7a1-46ea-b532-29b559341e5e-istio-token" (OuterVolumeSpecName: "istio-token") pod "c07476da-f7a1-46ea-b532-29b559341e5e" (UID: "c07476da-f7a1-46ea-b532-29b559341e5e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:17:41.109421 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.109361 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c07476da-f7a1-46ea-b532-29b559341e5e-kube-api-access-c458g" (OuterVolumeSpecName: "kube-api-access-c458g") pod "c07476da-f7a1-46ea-b532-29b559341e5e" (UID: "c07476da-f7a1-46ea-b532-29b559341e5e"). InnerVolumeSpecName "kube-api-access-c458g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:17:41.109421 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.109374 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c07476da-f7a1-46ea-b532-29b559341e5e" (UID: "c07476da-f7a1-46ea-b532-29b559341e5e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:41.208126 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.208086 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-istio-data\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:41.208126 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.208117 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c07476da-f7a1-46ea-b532-29b559341e5e-istio-token\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:41.208126 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.208130 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c458g\" (UniqueName: \"kubernetes.io/projected/c07476da-f7a1-46ea-b532-29b559341e5e-kube-api-access-c458g\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:41.208413 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.208144 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c07476da-f7a1-46ea-b532-29b559341e5e-istio-envoy\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:41.208413 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.208155 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c07476da-f7a1-46ea-b532-29b559341e5e-istio-podinfo\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:41.208413 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.208166 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c07476da-f7a1-46ea-b532-29b559341e5e-istiod-ca-cert\") on node \"ip-10-0-130-245.ec2.internal\" DevicePath \"\"" Jul 17 18:17:41.975152 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.975118 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" Jul 17 18:17:41.975152 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.975131 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p" event={"ID":"c07476da-f7a1-46ea-b532-29b559341e5e","Type":"ContainerDied","Data":"e5a17b6b2c5b8e33e84057a5037e3d39b5bb7bae7c993255d5bc15b087666a70"} Jul 17 18:17:41.975663 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.975192 2557 scope.go:117] "RemoveContainer" containerID="d2f158a47e2415b04a025b98afc8fa94e273de041d36bf18dcd4fdd793c81d9a" Jul 17 18:17:41.993389 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:41.993363 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p"] Jul 17 18:17:42.000109 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:42.000084 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-37d0b7-openshift-default-789457bbd7-65v4p"] Jul 17 18:17:43.091502 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:43.091471 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5f54cb78-c8lg8_496789b4-7606-43a8-adc6-48cc03d6a930/copy-manifests/0.log" Jul 17 18:17:43.104472 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:43.104449 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5f54cb78-c8lg8_496789b4-7606-43a8-adc6-48cc03d6a930/manager/0.log" Jul 17 18:17:43.878143 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:43.878110 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c07476da-f7a1-46ea-b532-29b559341e5e" path="/var/lib/kubelet/pods/c07476da-f7a1-46ea-b532-29b559341e5e/volumes" Jul 17 18:17:44.290322 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:44.290244 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-a-72cf7b-68599857d-rrn6q_eea9ecc9-7ece-41c2-8551-80f81c7e7fdb/maas-api/0.log" Jul 17 18:17:44.410209 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:44.410182 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-b-3145cb-558d789686-j4m76_5ee6b549-6ccc-49d1-be41-258d87d813fb/maas-api/0.log" Jul 17 18:17:44.777356 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:44.777312 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-mt-7548b62e-58c94d7d56-tnrhg_9f146bb0-cc29-438d-9d30-fd688c38213d/maas-api/0.log" Jul 17 18:17:45.040741 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:45.040657 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-b-37d0b7-689c597f57-rcncx_d0bc9caf-a173-4b2b-9bc4-5408a3ee7015/maas-api/0.log" Jul 17 18:17:45.287338 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:45.287309 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29738520-xdckp_a15751df-7903-413e-80b8-90b365f2584f/cleanup/0.log" Jul 17 18:17:45.523873 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:45.523848 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-ait-1d1f23e1-29738520-p5dvj_839a8041-0030-463f-94ec-fdeebe008251/cleanup/0.log" Jul 17 18:17:45.768350 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:45.768313 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-ait-ee229465-29738520-45nzf_95bba85d-3878-4515-a36a-05916e82829c/cleanup/0.log" Jul 17 18:17:46.240889 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:46.240855 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-derive-84841c77-29738520-p5gwd_ff0d3bcb-10be-49ac-a40d-ef7753c52bcb/cleanup/0.log" Jul 17 18:17:46.732119 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:46.732082 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-migrate-24f8a1bf-29738520-kl2m9_df493131-0b3d-4f3e-a99a-54d34aa1fff3/cleanup/0.log" Jul 17 18:17:48.837308 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:48.837276 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-849b75d88f-t8pjf_5caa57cd-5a11-4443-8036-74871c015526/authorino/0.log" Jul 17 18:17:49.718033 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:49.718006 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bx4tb_85fa241d-1df4-459a-9f20-eed15a878957/manager/0.log" Jul 17 18:17:50.090727 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:50.090666 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678k5kfm_a8642dbf-2d25-4e11-819c-209f7d49be2d/istio-proxy/0.log" Jul 17 18:17:50.596277 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:50.596248 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-58lrs_41b215b1-f7dd-4d82-8212-834fdeb62040/istio-proxy/1.log" Jul 17 18:17:50.973700 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:50.973604 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56bc46498-h9pbn_3d528fdc-e45b-40e6-9e43-95633b1fa9d4/router/0.log" Jul 17 18:17:51.592281 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:51.592250 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-8fccx_93c9b461-bf9c-4d71-976d-eead863a4b90/main/0.log" Jul 17 18:17:51.715524 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:17:51.715491 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6twxz_fdf35d77-f622-4d00-985e-0dc4923eecb8/main/0.log" Jul 17 18:18:00.548978 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:00.548946 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xb5jt_6b702b8e-c450-4d9c-b339-6d1f30922e66/global-pull-secret-syncer/0.log" Jul 17 18:18:00.687627 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:00.687598 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d4j6d_59876b7a-57d9-4692-be8d-2a279ee9b885/konnectivity-agent/0.log" Jul 17 18:18:00.760874 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:00.760844 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-245.ec2.internal_2d08157d5f37b263915c19440df08566/haproxy/0.log" Jul 17 18:18:05.729647 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:05.729607 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-849b75d88f-t8pjf_5caa57cd-5a11-4443-8036-74871c015526/authorino/0.log" Jul 17 18:18:06.147412 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:06.147372 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bx4tb_85fa241d-1df4-459a-9f20-eed15a878957/manager/0.log" Jul 17 18:18:07.992463 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:07.992434 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-gdq5z_6334beb9-4604-4aa0-ba7a-5c7d8aca63c7/cluster-monitoring-operator/0.log" Jul 17 18:18:08.172534 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:08.172508 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7l5mp_67e68352-005b-4fc7-8584-8b8246c8ea5b/node-exporter/0.log" Jul 17 18:18:08.218810 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:08.218787 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7l5mp_67e68352-005b-4fc7-8584-8b8246c8ea5b/kube-rbac-proxy/0.log" Jul 17 18:18:08.260572 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:08.260504 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7l5mp_67e68352-005b-4fc7-8584-8b8246c8ea5b/init-textfile/0.log" Jul 17 18:18:08.727833 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:08.727804 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-bwbnd_18d7219d-b076-4058-b092-65fd60c11d7f/prometheus-operator-admission-webhook/0.log" Jul 17 18:18:09.885082 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.885052 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b"] Jul 17 18:18:09.885479 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.885465 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c07476da-f7a1-46ea-b532-29b559341e5e" containerName="istio-proxy" Jul 17 18:18:09.885534 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.885481 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c07476da-f7a1-46ea-b532-29b559341e5e" containerName="istio-proxy" Jul 17 18:18:09.885534 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.885494 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" containerName="istio-proxy" Jul 17 18:18:09.885534 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.885500 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" containerName="istio-proxy" Jul 17 18:18:09.885534 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.885516 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" containerName="istio-proxy" Jul 17 18:18:09.885534 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.885521 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" containerName="istio-proxy" Jul 17 18:18:09.885778 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.885538 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c07476da-f7a1-46ea-b532-29b559341e5e" containerName="istio-proxy" Jul 17 18:18:09.885778 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.885548 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c07476da-f7a1-46ea-b532-29b559341e5e" containerName="istio-proxy" Jul 17 18:18:09.885778 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.885625 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" containerName="istio-proxy" Jul 17 18:18:09.885778 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.885634 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c47825c-bff6-4cf9-b944-8fbf28809cbc" containerName="istio-proxy" Jul 17 18:18:09.885778 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.885640 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c07476da-f7a1-46ea-b532-29b559341e5e" containerName="istio-proxy" Jul 17 18:18:09.885778 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.885650 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c07476da-f7a1-46ea-b532-29b559341e5e" containerName="istio-proxy" Jul 17 18:18:09.890122 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.890106 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:09.892192 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.892174 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ncz5z\"/\"kube-root-ca.crt\"" Jul 17 18:18:09.893053 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.893035 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ncz5z\"/\"openshift-service-ca.crt\"" Jul 17 18:18:09.893166 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.893038 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ncz5z\"/\"default-dockercfg-9zsnx\"" Jul 17 18:18:09.897525 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.897504 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b"] Jul 17 18:18:09.974976 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.974936 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/083077ad-07c3-4a29-96f1-b9d2df0a3e3d-podres\") pod \"perf-node-gather-daemonset-xl67b\" (UID: \"083077ad-07c3-4a29-96f1-b9d2df0a3e3d\") " pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:09.974976 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.974980 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/083077ad-07c3-4a29-96f1-b9d2df0a3e3d-lib-modules\") pod \"perf-node-gather-daemonset-xl67b\" (UID: \"083077ad-07c3-4a29-96f1-b9d2df0a3e3d\") " pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:09.975242 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.975011 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/083077ad-07c3-4a29-96f1-b9d2df0a3e3d-sys\") pod \"perf-node-gather-daemonset-xl67b\" (UID: \"083077ad-07c3-4a29-96f1-b9d2df0a3e3d\") " pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:09.975242 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.975136 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/083077ad-07c3-4a29-96f1-b9d2df0a3e3d-proc\") pod \"perf-node-gather-daemonset-xl67b\" (UID: \"083077ad-07c3-4a29-96f1-b9d2df0a3e3d\") " pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:09.975242 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:09.975187 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z58vg\" (UniqueName: \"kubernetes.io/projected/083077ad-07c3-4a29-96f1-b9d2df0a3e3d-kube-api-access-z58vg\") pod \"perf-node-gather-daemonset-xl67b\" (UID: \"083077ad-07c3-4a29-96f1-b9d2df0a3e3d\") " pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:10.076074 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:10.076039 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/083077ad-07c3-4a29-96f1-b9d2df0a3e3d-podres\") pod \"perf-node-gather-daemonset-xl67b\" (UID: \"083077ad-07c3-4a29-96f1-b9d2df0a3e3d\") " pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:10.076074 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:10.076078 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/083077ad-07c3-4a29-96f1-b9d2df0a3e3d-lib-modules\") pod \"perf-node-gather-daemonset-xl67b\" (UID: \"083077ad-07c3-4a29-96f1-b9d2df0a3e3d\") " pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:10.076289 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:10.076102 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/083077ad-07c3-4a29-96f1-b9d2df0a3e3d-sys\") pod \"perf-node-gather-daemonset-xl67b\" (UID: \"083077ad-07c3-4a29-96f1-b9d2df0a3e3d\") " pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:10.076289 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:10.076175 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/083077ad-07c3-4a29-96f1-b9d2df0a3e3d-sys\") pod \"perf-node-gather-daemonset-xl67b\" (UID: \"083077ad-07c3-4a29-96f1-b9d2df0a3e3d\") " pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:10.076289 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:10.076220 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/083077ad-07c3-4a29-96f1-b9d2df0a3e3d-proc\") pod \"perf-node-gather-daemonset-xl67b\" (UID: \"083077ad-07c3-4a29-96f1-b9d2df0a3e3d\") " pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:10.076289 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:10.076231 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/083077ad-07c3-4a29-96f1-b9d2df0a3e3d-podres\") pod \"perf-node-gather-daemonset-xl67b\" (UID: \"083077ad-07c3-4a29-96f1-b9d2df0a3e3d\") " pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:10.076289 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:10.076265 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z58vg\" (UniqueName: \"kubernetes.io/projected/083077ad-07c3-4a29-96f1-b9d2df0a3e3d-kube-api-access-z58vg\") pod \"perf-node-gather-daemonset-xl67b\" (UID: \"083077ad-07c3-4a29-96f1-b9d2df0a3e3d\") " pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:10.076475 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:10.076230 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/083077ad-07c3-4a29-96f1-b9d2df0a3e3d-lib-modules\") pod \"perf-node-gather-daemonset-xl67b\" (UID: \"083077ad-07c3-4a29-96f1-b9d2df0a3e3d\") " pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:10.076475 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:10.076311 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/083077ad-07c3-4a29-96f1-b9d2df0a3e3d-proc\") pod \"perf-node-gather-daemonset-xl67b\" (UID: \"083077ad-07c3-4a29-96f1-b9d2df0a3e3d\") " pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:10.084075 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:10.084051 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z58vg\" (UniqueName: \"kubernetes.io/projected/083077ad-07c3-4a29-96f1-b9d2df0a3e3d-kube-api-access-z58vg\") pod \"perf-node-gather-daemonset-xl67b\" (UID: \"083077ad-07c3-4a29-96f1-b9d2df0a3e3d\") " pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:10.125215 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:10.125180 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-wfhtj_d4be86d0-8e39-4124-9fd9-3303385a17aa/networking-console-plugin/0.log" Jul 17 18:18:10.200460 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:10.200369 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:10.338387 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:10.338363 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b"] Jul 17 18:18:10.340598 ip-10-0-130-245 kubenswrapper[2557]: W0717 18:18:10.340572 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod083077ad_07c3_4a29_96f1_b9d2df0a3e3d.slice/crio-06bb829f7a95e1bd0cf85e6457ff25b0877b857c6138ecb7141b547104e3ff86 WatchSource:0}: Error finding container 06bb829f7a95e1bd0cf85e6457ff25b0877b857c6138ecb7141b547104e3ff86: Status 404 returned error can't find the container with id 06bb829f7a95e1bd0cf85e6457ff25b0877b857c6138ecb7141b547104e3ff86 Jul 17 18:18:10.707533 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:10.707501 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/1.log" Jul 17 18:18:10.711620 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:10.711599 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qq5gg_fb8b4834-5dba-4cce-b4f7-60407b1b05cc/console-operator/2.log" Jul 17 18:18:11.126156 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:11.126118 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" event={"ID":"083077ad-07c3-4a29-96f1-b9d2df0a3e3d","Type":"ContainerStarted","Data":"f487227b6256e0fd30b3a41cf4b286f2dea40623e95c98cca024eb412a1d1d92"} Jul 17 18:18:11.126554 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:11.126178 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" event={"ID":"083077ad-07c3-4a29-96f1-b9d2df0a3e3d","Type":"ContainerStarted","Data":"06bb829f7a95e1bd0cf85e6457ff25b0877b857c6138ecb7141b547104e3ff86"} Jul 17 18:18:11.126554 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:11.126218 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:11.142502 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:11.142453 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" podStartSLOduration=2.142439016 podStartE2EDuration="2.142439016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:18:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:18:11.142129688 +0000 UTC m=+2859.752799072" watchObservedRunningTime="2026-07-17 18:18:11.142439016 +0000 UTC m=+2859.753108398" Jul 17 18:18:11.160189 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:11.160165 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bf998f697-lrtz5_3a8d18bf-b811-4b68-b622-b18c0e55caae/console/0.log" Jul 17 18:18:11.194245 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:11.194220 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-dpj2s_8aa582e3-8011-4aa9-962b-d0a75d9f40bc/download-server/0.log" Jul 17 18:18:11.745483 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:11.745453 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-ghg86_6d78bf45-20a3-493b-bf56-0a4d930b8bb7/volume-data-source-validator/0.log" Jul 17 18:18:12.698764 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:12.698735 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-79kq8_7be1d83f-e7e1-4051-bcbd-7c579ee86cd6/dns/0.log" Jul 17 18:18:12.725325 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:12.725300 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-79kq8_7be1d83f-e7e1-4051-bcbd-7c579ee86cd6/kube-rbac-proxy/0.log" Jul 17 18:18:12.859891 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:12.859856 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lk5gp_19e37a6a-c87e-4fdc-b7e3-a077511a962e/dns-node-resolver/0.log" Jul 17 18:18:13.443805 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:13.443779 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mpdl4_95be5822-5b78-4e56-aae0-9c8ad4a8ecd7/node-ca/0.log" Jul 17 18:18:14.313221 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:14.313184 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678k5kfm_a8642dbf-2d25-4e11-819c-209f7d49be2d/istio-proxy/0.log" Jul 17 18:18:14.499990 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:14.499945 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-58lrs_41b215b1-f7dd-4d82-8212-834fdeb62040/istio-proxy/0.log" Jul 17 18:18:14.527578 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:14.527544 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-58lrs_41b215b1-f7dd-4d82-8212-834fdeb62040/istio-proxy/1.log" Jul 17 18:18:14.608566 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:14.608536 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56bc46498-h9pbn_3d528fdc-e45b-40e6-9e43-95633b1fa9d4/router/0.log" Jul 17 18:18:15.274135 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:15.274108 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qb5g6_00e27498-09f4-464c-b08b-45a0b3cb2786/serve-healthcheck-canary/0.log" Jul 17 18:18:15.765762 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:15.765735 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-qlvv2_ccfd68b0-0222-4940-9793-f503e6edc300/insights-operator/0.log" Jul 17 18:18:15.767504 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:15.767485 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-qlvv2_ccfd68b0-0222-4940-9793-f503e6edc300/insights-operator/1.log" Jul 17 18:18:15.852844 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:15.852815 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jg62z_2fce1ae6-eff2-4165-8a96-d5dc0521d595/kube-rbac-proxy/0.log" Jul 17 18:18:15.874189 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:15.874164 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jg62z_2fce1ae6-eff2-4165-8a96-d5dc0521d595/exporter/0.log" Jul 17 18:18:15.894128 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:15.894097 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jg62z_2fce1ae6-eff2-4165-8a96-d5dc0521d595/extractor/0.log" Jul 17 18:18:17.142259 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:17.142235 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ncz5z/perf-node-gather-daemonset-xl67b" Jul 17 18:18:18.732831 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:18.732793 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5f54cb78-c8lg8_496789b4-7606-43a8-adc6-48cc03d6a930/manager/0.log" Jul 17 18:18:18.752766 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:18.752743 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5f54cb78-c8lg8_496789b4-7606-43a8-adc6-48cc03d6a930/copy-manifests/0.log" Jul 17 18:18:20.105642 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:20.105618 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76cbd9fc7d-n8vbv_96d9f7e3-0f69-40e7-a453-795dce81b983/manager/0.log" Jul 17 18:18:20.295495 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:20.295416 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678k5kfm_a8642dbf-2d25-4e11-819c-209f7d49be2d/istio-proxy/0.log" Jul 17 18:18:20.451155 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:20.451124 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-58lrs_41b215b1-f7dd-4d82-8212-834fdeb62040/istio-proxy/0.log" Jul 17 18:18:20.482778 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:20.482749 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-58lrs_41b215b1-f7dd-4d82-8212-834fdeb62040/istio-proxy/1.log" Jul 17 18:18:20.536570 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:20.536539 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56bc46498-h9pbn_3d528fdc-e45b-40e6-9e43-95633b1fa9d4/router/0.log" Jul 17 18:18:21.694625 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:21.694593 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678k5kfm_a8642dbf-2d25-4e11-819c-209f7d49be2d/istio-proxy/0.log" Jul 17 18:18:21.850220 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:21.850196 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-58lrs_41b215b1-f7dd-4d82-8212-834fdeb62040/istio-proxy/0.log" Jul 17 18:18:21.884618 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:21.884572 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-58lrs_41b215b1-f7dd-4d82-8212-834fdeb62040/istio-proxy/1.log" Jul 17 18:18:21.946632 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:21.946602 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56bc46498-h9pbn_3d528fdc-e45b-40e6-9e43-95633b1fa9d4/router/0.log" Jul 17 18:18:24.789635 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:24.789554 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-mrlns_007ed456-188c-4c58-bc14-8e4b0d3806aa/migrator/0.log" Jul 17 18:18:24.811451 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:24.811420 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-mrlns_007ed456-188c-4c58-bc14-8e4b0d3806aa/graceful-termination/0.log" Jul 17 18:18:25.147330 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:25.147289 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-6jr7d_3398a5d5-1531-4672-906c-ce042e4d7eef/kube-storage-version-migrator-operator/1.log" Jul 17 18:18:25.148126 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:25.148104 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-6jr7d_3398a5d5-1531-4672-906c-ce042e4d7eef/kube-storage-version-migrator-operator/0.log" Jul 17 18:18:26.131887 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:26.131856 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5f57h_ac867d9e-ba94-420f-aca9-f95f6def7fe0/kube-multus/0.log" Jul 17 18:18:26.188612 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:26.188588 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6bpqj_6ce16731-5297-45af-9b0e-9aaf4a8dedb4/kube-multus-additional-cni-plugins/0.log" Jul 17 18:18:26.209805 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:26.209783 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6bpqj_6ce16731-5297-45af-9b0e-9aaf4a8dedb4/egress-router-binary-copy/0.log" Jul 17 18:18:26.231575 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:26.231549 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6bpqj_6ce16731-5297-45af-9b0e-9aaf4a8dedb4/cni-plugins/0.log" Jul 17 18:18:26.252453 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:26.252431 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6bpqj_6ce16731-5297-45af-9b0e-9aaf4a8dedb4/bond-cni-plugin/0.log" Jul 17 18:18:26.272345 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:26.272330 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6bpqj_6ce16731-5297-45af-9b0e-9aaf4a8dedb4/routeoverride-cni/0.log" Jul 17 18:18:26.300276 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:26.300210 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6bpqj_6ce16731-5297-45af-9b0e-9aaf4a8dedb4/whereabouts-cni-bincopy/0.log" Jul 17 18:18:26.318989 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:26.318956 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6bpqj_6ce16731-5297-45af-9b0e-9aaf4a8dedb4/whereabouts-cni/0.log" Jul 17 18:18:26.791117 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:26.791087 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v76hr_082d287c-1c8d-4d2f-adb5-82d542c434b8/network-metrics-daemon/0.log" Jul 17 18:18:26.818161 ip-10-0-130-245 kubenswrapper[2557]: I0717 18:18:26.818132 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v76hr_082d287c-1c8d-4d2f-adb5-82d542c434b8/kube-rbac-proxy/0.log"